Jul 18 00:38:26.143278 ip-10-0-142-221 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 18 00:38:26.143289 ip-10-0-142-221 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 18 00:38:26.143296 ip-10-0-142-221 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 18 00:38:26.143579 ip-10-0-142-221 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 18 00:38:36.352042 ip-10-0-142-221 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 18 00:38:36.352060 ip-10-0-142-221 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 31a6908c318b40b98cea6d5dd2f76664 --
Jul 18 00:40:24.636811 ip-10-0-142-221 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 00:40:24.969454 ip-10-0-142-221 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 00:40:24.969454 ip-10-0-142-221 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 00:40:24.969454 ip-10-0-142-221 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 00:40:24.969454 ip-10-0-142-221 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 00:40:24.969454 ip-10-0-142-221 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 00:40:24.969454 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.967631    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.971987    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.971999    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972003    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972007    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972010    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972013    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972017    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972019    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972022    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972026    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972030    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972033    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972035    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972039    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972042    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972045    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972048    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972051    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972054    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:24.984436 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972062    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972066    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972069    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972072    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972075    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972078    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972080    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972083    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972085    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972088    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972091    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972094    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972097    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972102    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972106    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972110    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972113    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972116    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972119    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972122    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:24.998873 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972126    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972129    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972132    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972134    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972137    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972140    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972143    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972145    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972148    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972150    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972153    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972155    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972158    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972160    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972163    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972165    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972168    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972171    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972175    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972177    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:25.000605 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972180    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972182    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972185    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972187    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972190    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972192    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972195    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972197    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972200    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972202    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972205    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972207    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972211    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972213    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972216    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972220    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972223    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972225    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972228    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:25.002908 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972231    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972233    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972236    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972238    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972240    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972243    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972246    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972248    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972250    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972254    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972257    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972259    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972262    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972265    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972268    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972270    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972273    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972277    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972280    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972283    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:25.014758 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972285    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.972993    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973000    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973003    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973006    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973009    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973012    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973016    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973019    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973022    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973024    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973027    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973030    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973033    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973036    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973039    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973041    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973044    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973047    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:25.017010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973050    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973054    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973058    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973062    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973064    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973067    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973070    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973073    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973075    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973078    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973081    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973083    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973086    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973088    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973091    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973094    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973096    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973099    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973102    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:25.018806 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973105    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973108    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973111    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973113    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973115    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973118    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973120    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973125    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973128    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973131    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973133    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973138    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973141    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973144    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973148    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973150    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973153    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973155    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973159    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973161    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:25.021048 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973164    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973167    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973169    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973172    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973174    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973177    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973180    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973182    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973186    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973189    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973192    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973195    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973197    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973199    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973202    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973205    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973207    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973210    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973212    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973215    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:25.034810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973217    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:25.034216 ip-10-0-142-221 systemd[1]: Started Kubernetes Kubelet.
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973220    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973222    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973226    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973229    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973231    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973233    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973236    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973238    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973241    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973244    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973247    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973249    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973252    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973255    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973257    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973260    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973263    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973265    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973268    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:25.036301 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973271    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973273    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973672    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973678    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973689    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973695    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973698    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973701    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973703    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973708    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973710    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973713    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973715    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973719    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973721    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973726    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973729    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973731    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973734    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973737    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:25.038478 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973739    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973742    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973744    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973747    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973749    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973752    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973755    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973757    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973760    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973763    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973766    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973812    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973817    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973820    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973823    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973826    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973829    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973831    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973834    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973837    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:25.053793 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973840    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973844    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973847    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973850    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973853    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973855    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973858    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973862    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973864    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973867    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973869    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973872    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973875    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973877    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973880    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973882    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973885    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973888    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973894    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:25.066832 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973898    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973901    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973904    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973906    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973909    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973912    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973914    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973917    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973919    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973922    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973927    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973930    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973932    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973936    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973938    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973940    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973943    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973945    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973948    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973950    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:25.069339 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973955    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973958    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973960    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973963    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973966    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973968    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973971    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973973    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973976    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973978    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973981    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973983    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973986    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973988    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973990    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973993    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973995    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.973998    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974000    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974003    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:25.082730 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974005    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974007    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974071    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974078    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974084    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974089    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974093    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974096    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974101    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974105    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974108    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974111    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974116    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974119    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974122    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974125    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974128    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974131    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974133    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974136    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974141    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974144    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974147    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974150    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 00:40:25.084541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974153    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974157    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974161    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974164    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974167    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974170    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974173    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974175    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974178    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974181    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974187    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974190    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974193    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974195    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974199    2569 flags.go:64] FLAG: --enable-server="true"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974202    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974207    2569 flags.go:64] FLAG: --event-burst="100"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974210    2569 flags.go:64] FLAG: --event-qps="50"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974212    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974215    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974219    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974223    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974226    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974229    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974232    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 18 00:40:25.237165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974235    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974237    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974240    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974243    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974246    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974249    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974252    2569 flags.go:64] FLAG: --feature-gates=""
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974255    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974258    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974262    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974265    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974268    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974271    2569 flags.go:64] FLAG: --help="false"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974273    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974277    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974280    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974283    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974287    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974290    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974293    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974296    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974299    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974302    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 00:40:25.252876 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974305    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974308    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974311    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974314    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974318    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974321    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974324    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974327    2569 flags.go:64] FLAG: --lock-file=""
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974330    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974332    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974335    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974341    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974343    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974346    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974349    2569 flags.go:64] FLAG: --logging-format="text"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974352    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974355    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974358    2569 flags.go:64] FLAG: --manifest-url=""
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974361    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974365    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974368    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974372    2569 flags.go:64] FLAG: --max-pods="110"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974375    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974378    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974381    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 00:40:25.265178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974384    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974388    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974391    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974394    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974401    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974404    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974407    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974410    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974413    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974419    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974422    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974425    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974429    2569 flags.go:64] FLAG: --port="10250"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974432    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974435    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0981b88a1aefb00e6"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974438    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974441    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974444    2569 flags.go:64] FLAG: --register-node="true"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974447    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974450    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974453    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974456    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974459    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974463    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974466    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 00:40:25.267113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974469    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974472    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974474    2569 flags.go:64] FLAG: --runonce="false"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974477    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974480    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974483    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974486    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974489    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974494    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974497    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974500    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974503    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974519    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974522    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974525    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974528    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974531    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974534    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974540    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974544    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974547    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974551    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974554    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974557    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974560    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 00:40:25.268115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974563    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974565    2569 flags.go:64] FLAG: --v="2"
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974571    2569 flags.go:64] FLAG: --version="false"
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974577    2569 flags.go:64] FLAG: --vmodule=""
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974582    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.974585    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974725    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974730    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974734    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974737    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974740    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974742    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974745    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974748    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974750    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974755    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974757    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974760    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974763    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974766    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974768    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:25.269810 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974771    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974774    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974776    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974779    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974782    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974787    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974791    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974793    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974796    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974798    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974801    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974803    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974806    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974809    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974811    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974813    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974816    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974818    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974821    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:25.271463 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974823    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974826    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974829    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974831    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974834    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974836    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974839    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974844    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974846    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974849    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974851    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974854    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974856    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974859    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974862    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974864    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974867    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974870    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974875    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:25.272310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974878    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974880    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974883    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974886    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974888    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974891    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974893    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974896    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974898    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974900    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974903    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974905    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974908    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974910    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974913    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974915    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974918    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974922    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974925    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974928    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:25.273334 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974932    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974935    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974938    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974940    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974943    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974945    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974948    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974951    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974953    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974956    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974958    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974962    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974966    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974968    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974971    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974973    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974975    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974978    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974981    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974984    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:25.274127 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974986    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974989    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974991    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974994    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974996    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.974999    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.975481    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.981948    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.981963    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.981978    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.981983    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982045    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982050    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982054    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:25.274720 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982057    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982060    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982063    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982066    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982069    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982072    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982075    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982081    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982084    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982087    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982090    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982093    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982095    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982098    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982100    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982103    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982105    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982108    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982111    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982114    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982116    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:25.275315 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982119    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982122    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982124    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982128    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982132    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982137    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982139    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982142    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982145    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982147    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982149    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982152    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982155    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982157    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982160    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982163    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982165    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982167    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982172    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982174    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:25.275937 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982177    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982180    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982182    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982185    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982188    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982190    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982193    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982195    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982198    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982200    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982203    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982205    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982208    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982210    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982213    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982215    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982218    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982221    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982224    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982226    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:25.276580 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982229    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982231    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982234    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982236    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982239    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982241    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982244    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982246    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982249    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982251    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982258    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982261    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982265    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982269    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982272    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982275    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982278    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982281    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:25.277157 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982283    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982287    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982290    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982293    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982296    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982299    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982301    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982304    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982307    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982309    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982312    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982314    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982317    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982320    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982322    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982325    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:25.277945 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982328    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.982333    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982446    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982451    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982453    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982456    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982459    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982461    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982465    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982469    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982471    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982474    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982477    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982479    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982482    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:25.278440 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982485    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982487    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982490    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982493    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982495    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982498    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982501    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982503    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982521    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982525    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982528    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982530    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982533    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982535    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982538    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982545    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982630    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982635    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982640    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982646    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:25.278935 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982651    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982655    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982660    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982665    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982669    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982676    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982683    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982698    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982703    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982713    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982719    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982726    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982732    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982737    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982741    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982746    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982751    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982755    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982760    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:25.279501 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982765    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982770    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982779    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.982784    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984501    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984674    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984681    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984685    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984689    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984691    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984694    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984698    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984702    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984705    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984708    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984710    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984713    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984716    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984719    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984722    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:25.280171 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984724    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984728    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984731    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984733    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984736    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984738    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984740    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984743    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984745    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984748    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984751    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984753    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984756    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984759    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984762    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984765    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984767    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984771    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984774    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:25.280828 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984777    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984780    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984782    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984785    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984789    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984792    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984795    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:24.984797    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.984804    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.984927    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.987566    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.988671    2569 server.go:1019] "Starting client certificate rotation"
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.988767    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 00:40:25.281593 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.988805    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 00:40:25.491067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.990623    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 00:40:25.491067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:24.991728    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 00:40:25.491067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.004072    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 18 00:40:25.491067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.006131    2569 log.go:25] "Validated CRI v1 image API"
Jul 18 00:40:25.491067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.006968    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 00:40:25.491067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.009193    2569 fs.go:135] Filesystem UUIDs: map[38a71ff0-3092-4480-97fe-8d4c9ad82f78:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f2e0dd5f-93fd-4256-b9dc-ca6fcf18b022:/dev/nvme0n1p3]
Jul 18 00:40:25.491067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.009214    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.014089    2569 manager.go:216] Machine: {Timestamp:2026-07-18 00:40:25.013613086 +0000 UTC m=+0.270407196 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100936 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec232aabd187499ca10cd0d49a6c0b29 SystemUUID:ec232aab-d187-499c-a10c-d0d49a6c0b29 BootID:31a6908c-318b-40b9-8cea-6d5dd2f76664 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:10:36:33:c1:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:10:36:33:c1:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:d7:bb:81:34:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.014212    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.014291    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.016678    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.016976    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.016998    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.018159    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.018169    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.018177    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.018798    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.019934    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.023014    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.023150    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.023179    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.023196    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.023214    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 00:40:25.493445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.023254    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.023267    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.023741    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.023768    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.026142    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.027995    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.028023    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029008    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029022    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029028    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029033    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029041    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029047    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029054    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029059    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029069    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029077    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029089    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.029096    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.030276    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.030285    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.033098    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-296ps"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.033311    2569 server.go:1268] "Started kubelet"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.033409    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.033390    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.033467    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.034815    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.035302    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.035396    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.035427    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.035683    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.039817    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-296ps"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.039684    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-221.ec2.internal.18c33b6ef0536423  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-221.ec2.internal,UID:ip-10-0-142-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-221.ec2.internal,},FirstTimestamp:2026-07-18 00:40:25.033286691 +0000 UTC m=+0.290080801,LastTimestamp:2026-07-18 00:40:25.033286691 +0000 UTC m=+0.290080801,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-221.ec2.internal,}"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.041025    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.044830    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.044832    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.045051    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.045399    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.045415    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 00:40:25.494034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.045430    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.045559    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.045574    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.046094    2569 factory.go:55] Registering systemd factory
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.046108    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.046796    2569 factory.go:153] Registering CRI-O factory
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.046811    2569 factory.go:223] Registration of the crio container factory successfully
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.046862    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.046885    2569 factory.go:103] Registering Raw factory
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.046901    2569 manager.go:1196] Started watching for new ooms in manager
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.046933    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.047061    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.047377    2569 manager.go:349] Starting recovery of all containers
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.059158    2569 manager.go:354] Recovery completed
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.064315    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.066162    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.066194    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.066210    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.066752    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.066766    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.066781    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.066799    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.068186    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.068213    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.068226    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.068919    2569 policy_none.go:49] "None policy: Start"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.068933    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.068943    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.069795    2569 policy_none.go:47] "Start"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.120074    2569 manager.go:337] "Starting Device Plugin manager"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.120114    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.120126    2569 server.go:87] "Starting device plugin registration server"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.120365    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.120376    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.120474    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.120589    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.120598    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.121080    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.121123    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.220942    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.222082    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.222116    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.222126    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.222156    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.227926    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.227945    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-221.ec2.internal\": node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.239960    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:25.495057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.279499    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.280692    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.280736    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.280762    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.280805    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.283136    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.340413    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.381198    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal"]
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.381274    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.382716    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.382742    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.382752    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.383931    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.384054    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.384081    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.384623    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.384653    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.384670    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.384627    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.384716    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.384725    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.385900    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.385921    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.386489    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.386528    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.386542    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.404045    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-221.ec2.internal\" not found" node="ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.408604    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-221.ec2.internal\" not found" node="ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.440887    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.447612    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4aba9e93320aeafca49a676d8341479-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal\" (UID: \"a4aba9e93320aeafca49a676d8341479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.447632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4aba9e93320aeafca49a676d8341479-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal\" (UID: \"a4aba9e93320aeafca49a676d8341479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.496384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.447649    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ee29b9f5c56eaea9fcbfaf63581c9a2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-221.ec2.internal\" (UID: \"3ee29b9f5c56eaea9fcbfaf63581c9a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.709235 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.541149    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:25.709235 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.548545    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4aba9e93320aeafca49a676d8341479-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal\" (UID: \"a4aba9e93320aeafca49a676d8341479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.709235 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.548570    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ee29b9f5c56eaea9fcbfaf63581c9a2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-221.ec2.internal\" (UID: \"3ee29b9f5c56eaea9fcbfaf63581c9a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.709235 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.548586    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4aba9e93320aeafca49a676d8341479-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal\" (UID: \"a4aba9e93320aeafca49a676d8341479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.709235 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.548617    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4aba9e93320aeafca49a676d8341479-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal\" (UID: \"a4aba9e93320aeafca49a676d8341479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.709235 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.548632    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4aba9e93320aeafca49a676d8341479-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal\" (UID: \"a4aba9e93320aeafca49a676d8341479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.709235 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.548661    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ee29b9f5c56eaea9fcbfaf63581c9a2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-221.ec2.internal\" (UID: \"3ee29b9f5c56eaea9fcbfaf63581c9a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:25.709235 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.641699    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:25.709543 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.709424    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:27.483495 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:25.711567    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:27.483495 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:25.742377    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:27.483495 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:27.387572    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:27.675008 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:27.488128    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:27.675008 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:27.532552    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 00:40:27.675008 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:27.532712    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 00:40:27.675008 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:27.588635    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:27.675008 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:27.590345    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 00:35:26 +0000 UTC" deadline="2028-02-11 15:30:33.316798238 +0000 UTC"
Jul 18 00:40:27.675008 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:27.590376    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13766h50m5.726426096s"
Jul 18 00:40:27.675008 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:27.645333    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:27.826816 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:27.689054    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:27.826816 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:27.789485    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:27.978990 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:27.889721    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-221.ec2.internal\" not found"
Jul 18 00:40:27.978990 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:27.912704    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:27.978990 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:27.936508    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 00:40:27.978990 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:27.941540    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee29b9f5c56eaea9fcbfaf63581c9a2.slice/crio-9d7aa5dfa1a671fe84b01f0f29d949fc83a01df328749184c22b1ac49063f4d6 WatchSource:0}: Error finding container 9d7aa5dfa1a671fe84b01f0f29d949fc83a01df328749184c22b1ac49063f4d6: Status 404 returned error can't find the container with id 9d7aa5dfa1a671fe84b01f0f29d949fc83a01df328749184c22b1ac49063f4d6
Jul 18 00:40:28.176939 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:27.994318    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:28.176939 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.003752    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 00:40:28.176939 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.005216    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal"
Jul 18 00:40:28.176939 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.012393    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 00:40:28.176939 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.020102    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:28.605723 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.569474    2569 apiserver.go:52] "Watching apiserver"
Jul 18 00:40:28.605723 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.590106    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 00:40:28.612313 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.612064    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.612617    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5g8kc","kube-system/konnectivity-agent-7trqs","openshift-dns/node-resolver-ct4gp","openshift-multus/multus-additional-cni-plugins-gt8rf","openshift-multus/multus-jlxpd","openshift-network-operator/iptables-alerter-ccnh4","openshift-ovn-kubernetes/ovnkube-node-fgtfv","kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4","openshift-cluster-node-tuning-operator/tuned-ctc7z","openshift-image-registry/node-ca-dchvn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal","openshift-multus/network-metrics-daemon-cjstx","openshift-network-diagnostics/network-check-target-vqhxj"]
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.615453    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.617914    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.618004    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.618386    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b48gg\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.618456    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.618709    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.618728    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.618966    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.619063    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.619658    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.620934    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.621351    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.622963    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.623630    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.623653    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-brvm5\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.623884    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.625069    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.625367    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.625395    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.625406    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.625551    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.625685    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.625739    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cfrqw\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.627476    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s2rdz\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.627673    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.627794    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.629892    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.629945    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.629894    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.629951    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 00:40:28.685441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.630209    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x2zbl\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.631856    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.632132    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.632408    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x6gwb\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.632521    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.632871    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.632927    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.634599    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.637318    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.637345    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.637435    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h6q29\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.637497    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.639631    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.640052    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.640132    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.640129    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w9cl5\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.641766    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.641812    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5hwpr"
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.641826    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.643446    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.643477    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.643978    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.644691    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4bdjh\""
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.650167    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5hwpr"
Jul 18 00:40:28.687538 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.668941    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:28.692278 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.691806    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700716    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-system-cni-dir\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700750    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-multus-socket-dir-parent\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700776    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjnw8\" (UniqueName: \"kubernetes.io/projected/f24c78df-9a55-455e-958d-63de113d1809-kube-api-access-qjnw8\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700826    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-sys-fs\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700850    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700872    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6tx7\" (UniqueName: \"kubernetes.io/projected/abb79bd5-9512-4cc8-a6c4-669d891ded8c-kube-api-access-m6tx7\") pod \"node-ca-dchvn\" (UID: \"abb79bd5-9512-4cc8-a6c4-669d891ded8c\") " pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700912    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-run-systemd\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700941    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-var-lib-openvswitch\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700960    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-log-socket\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700973    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-multus-cni-dir\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.700987    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-run-k8s-cni-cncf-io\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-hostroot\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701019    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-host\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701041    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10f69fbb-a959-4134-8bac-774133c880eb-ovnkube-script-lib\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.759437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701065    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6dqg\" (UniqueName: \"kubernetes.io/projected/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-kube-api-access-s6dqg\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e95a1c22-8d46-4a2a-992c-b256526539c5-dbus\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701109    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1-host-slash\") pod \"iptables-alerter-ccnh4\" (UID: \"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1\") " pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-node-log\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-run-ovn-kubernetes\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701177    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk7n7\" (UniqueName: \"kubernetes.io/projected/10f69fbb-a959-4134-8bac-774133c880eb-kube-api-access-hk7n7\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701216    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-os-release\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701244    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-cnibin\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7be8df99-0b89-4839-8d1b-4c0b4c1d8da3-agent-certs\") pod \"konnectivity-agent-7trqs\" (UID: \"7be8df99-0b89-4839-8d1b-4c0b4c1d8da3\") " pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701291    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7be8df99-0b89-4839-8d1b-4c0b4c1d8da3-konnectivity-ca\") pod \"konnectivity-agent-7trqs\" (UID: \"7be8df99-0b89-4839-8d1b-4c0b4c1d8da3\") " pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701312    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-slash\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701333    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-run-ovn\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10f69fbb-a959-4134-8bac-774133c880eb-ovn-node-metrics-cert\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701393    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701414    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-run\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701446    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-run-openvswitch\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.762882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701471    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701500    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-lib-modules\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701523    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d400b60-6ea5-4781-a3b8-f29316e869ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701545    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-etc-kubernetes\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-sysctl-conf\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701585    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-sys\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701607    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-os-release\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1-iptables-alerter-script\") pod \"iptables-alerter-ccnh4\" (UID: \"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1\") " pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-kubelet\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-cni-netd\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701725    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-var-lib-cni-multus\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-var-lib-kubelet\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701760    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d400b60-6ea5-4781-a3b8-f29316e869ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701777    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-run-netns\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e95a1c22-8d46-4a2a-992c-b256526539c5-kubelet-config\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:28.763681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfwkp\" (UniqueName: \"kubernetes.io/projected/9e41728b-827b-4dba-a64a-41984218f873-kube-api-access-hfwkp\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701857    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abb79bd5-9512-4cc8-a6c4-669d891ded8c-serviceca\") pod \"node-ca-dchvn\" (UID: \"abb79bd5-9512-4cc8-a6c4-669d891ded8c\") " pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701877    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-etc-openvswitch\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701899    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-multus-conf-dir\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701921    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f24c78df-9a55-455e-958d-63de113d1809-multus-daemon-config\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701943    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-socket-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701966    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-registration-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.701989    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ftrp\" (UniqueName: \"kubernetes.io/projected/af22323f-0098-447d-8322-b367e7b1867a-kube-api-access-6ftrp\") pod \"node-resolver-ct4gp\" (UID: \"af22323f-0098-447d-8322-b367e7b1867a\") " pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702015    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-systemd-units\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-device-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702062    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-tuned\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702119    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-cni-bin\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702146    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-var-lib-cni-bin\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-kubernetes\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7fc2965-56bb-4832-bc43-3abfdee96dea-tmp\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702235    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af22323f-0098-447d-8322-b367e7b1867a-hosts-file\") pod \"node-resolver-ct4gp\" (UID: \"af22323f-0098-447d-8322-b367e7b1867a\") " pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:28.764488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702250    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-system-cni-dir\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702263    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abb79bd5-9512-4cc8-a6c4-669d891ded8c-host\") pod \"node-ca-dchvn\" (UID: \"abb79bd5-9512-4cc8-a6c4-669d891ded8c\") " pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702311    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10f69fbb-a959-4134-8bac-774133c880eb-env-overrides\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-sysctl-d\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702359    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x77vn\" (UniqueName: \"kubernetes.io/projected/e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1-kube-api-access-x77vn\") pod \"iptables-alerter-ccnh4\" (UID: \"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1\") " pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10f69fbb-a959-4134-8bac-774133c880eb-ovnkube-config\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.702836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-cnibin\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.703067    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-systemd\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.703708    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af22323f-0098-447d-8322-b367e7b1867a-tmp-dir\") pod \"node-resolver-ct4gp\" (UID: \"af22323f-0098-447d-8322-b367e7b1867a\") " pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d400b60-6ea5-4781-a3b8-f29316e869ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9f5f\" (UniqueName: \"kubernetes.io/projected/6d400b60-6ea5-4781-a3b8-f29316e869ec-kube-api-access-c9f5f\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704489    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f24c78df-9a55-455e-958d-63de113d1809-cni-binary-copy\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-var-lib-kubelet\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704517    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-run-multus-certs\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704537    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.767473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-sysconfig\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.768474 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-run-netns\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.768474 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-modprobe-d\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.768474 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.704624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brxk7\" (UniqueName: \"kubernetes.io/projected/b7fc2965-56bb-4832-bc43-3abfdee96dea-kube-api-access-brxk7\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.804825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-modprobe-d\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.804867    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brxk7\" (UniqueName: \"kubernetes.io/projected/b7fc2965-56bb-4832-bc43-3abfdee96dea-kube-api-access-brxk7\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.804885    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-system-cni-dir\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.804958    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-multus-socket-dir-parent\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.804984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjnw8\" (UniqueName: \"kubernetes.io/projected/f24c78df-9a55-455e-958d-63de113d1809-kube-api-access-qjnw8\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805008    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805016    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-modprobe-d\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805034    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-sys-fs\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805039    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-system-cni-dir\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805060    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6tx7\" (UniqueName: \"kubernetes.io/projected/abb79bd5-9512-4cc8-a6c4-669d891ded8c-kube-api-access-m6tx7\") pod \"node-ca-dchvn\" (UID: \"abb79bd5-9512-4cc8-a6c4-669d891ded8c\") " pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805095    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-run-systemd\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-var-lib-openvswitch\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805130    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-multus-socket-dir-parent\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-log-socket\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:28.886687 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805214    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-multus-cni-dir\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-run-k8s-cni-cncf-io\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805262    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-hostroot\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805272    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805288    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-host\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805264    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-sys-fs\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10f69fbb-a959-4134-8bac-774133c880eb-ovnkube-script-lib\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805319    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-run-k8s-cni-cncf-io\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805309    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-var-lib-openvswitch\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805338    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-log-socket\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805213    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-run-systemd\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805340    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6dqg\" (UniqueName: \"kubernetes.io/projected/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-kube-api-access-s6dqg\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805380    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-hostroot\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e95a1c22-8d46-4a2a-992c-b256526539c5-dbus\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805411    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1-host-slash\") pod \"iptables-alerter-ccnh4\" (UID: \"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1\") " pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805450    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-node-log\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805460    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-multus-cni-dir\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805466    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-host\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.029820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805505    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-run-ovn-kubernetes\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805531    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk7n7\" (UniqueName: \"kubernetes.io/projected/10f69fbb-a959-4134-8bac-774133c880eb-kube-api-access-hk7n7\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805531    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-node-log\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805535    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e95a1c22-8d46-4a2a-992c-b256526539c5-dbus\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805553    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-os-release\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805576    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1-host-slash\") pod \"iptables-alerter-ccnh4\" (UID: \"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1\") " pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805591    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-run-ovn-kubernetes\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-cnibin\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7be8df99-0b89-4839-8d1b-4c0b4c1d8da3-agent-certs\") pod \"konnectivity-agent-7trqs\" (UID: \"7be8df99-0b89-4839-8d1b-4c0b4c1d8da3\") " pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805631    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-cnibin\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805652    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7be8df99-0b89-4839-8d1b-4c0b4c1d8da3-konnectivity-ca\") pod \"konnectivity-agent-7trqs\" (UID: \"7be8df99-0b89-4839-8d1b-4c0b4c1d8da3\") " pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-slash\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805695    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-os-release\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805715    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-slash\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805742    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-run-ovn\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805757    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10f69fbb-a959-4134-8bac-774133c880eb-ovn-node-metrics-cert\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805776    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805798    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-run\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.031655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805817    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-run-ovn\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-run-openvswitch\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805875    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-run\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.805897    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.805959    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret podName:e95a1c22-8d46-4a2a-992c-b256526539c5 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:29.305940168 +0000 UTC m=+3.018051448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret") pod "global-pull-secret-syncer-5g8kc" (UID: "e95a1c22-8d46-4a2a-992c-b256526539c5") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.805985    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806009    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10f69fbb-a959-4134-8bac-774133c880eb-ovnkube-script-lib\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806093    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-run-openvswitch\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-lib-modules\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806172    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806219    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d400b60-6ea5-4781-a3b8-f29316e869ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806239    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7be8df99-0b89-4839-8d1b-4c0b4c1d8da3-konnectivity-ca\") pod \"konnectivity-agent-7trqs\" (UID: \"7be8df99-0b89-4839-8d1b-4c0b4c1d8da3\") " pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806259    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-etc-kubernetes\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-sysctl-conf\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806308    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-sys\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806310    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-lib-modules\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.032487 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806341    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806358    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-etc-kubernetes\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-os-release\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806402    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1-iptables-alerter-script\") pod \"iptables-alerter-ccnh4\" (UID: \"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1\") " pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806427    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-kubelet\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-cni-netd\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806469    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-var-lib-cni-multus\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-var-lib-kubelet\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806506    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-sysctl-conf\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806517    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d400b60-6ea5-4781-a3b8-f29316e869ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806541    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-run-netns\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e95a1c22-8d46-4a2a-992c-b256526539c5-kubelet-config\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806569    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-cni-netd\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806578    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-os-release\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806591    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfwkp\" (UniqueName: \"kubernetes.io/projected/9e41728b-827b-4dba-a64a-41984218f873-kube-api-access-hfwkp\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abb79bd5-9512-4cc8-a6c4-669d891ded8c-serviceca\") pod \"node-ca-dchvn\" (UID: \"abb79bd5-9512-4cc8-a6c4-669d891ded8c\") " pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806625    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-sys\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.033796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-etc-openvswitch\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806664    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-multus-conf-dir\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.806685    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f24c78df-9a55-455e-958d-63de113d1809-multus-daemon-config\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-socket-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.806722    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs podName:9e41728b-827b-4dba-a64a-41984218f873 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:29.306708455 +0000 UTC m=+3.018819718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs") pod "network-metrics-daemon-cjstx" (UID: "9e41728b-827b-4dba-a64a-41984218f873") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806749    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-registration-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftrp\" (UniqueName: \"kubernetes.io/projected/af22323f-0098-447d-8322-b367e7b1867a-kube-api-access-6ftrp\") pod \"node-resolver-ct4gp\" (UID: \"af22323f-0098-447d-8322-b367e7b1867a\") " pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806801    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-socket-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-systemd-units\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806830    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-systemd-units\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806831    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d400b60-6ea5-4781-a3b8-f29316e869ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806846    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-device-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806876    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-kubelet\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-tuned\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806887    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-device-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-cni-bin\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.034430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806931    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-run-netns\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806935    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-var-lib-cni-bin\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806984    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e95a1c22-8d46-4a2a-992c-b256526539c5-kubelet-config\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807031    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-registration-dir\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807033    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-var-lib-cni-multus\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807078    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-var-lib-kubelet\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807127    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d400b60-6ea5-4781-a3b8-f29316e869ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807263    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-kubernetes\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807291    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7fc2965-56bb-4832-bc43-3abfdee96dea-tmp\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807318    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af22323f-0098-447d-8322-b367e7b1867a-hosts-file\") pod \"node-resolver-ct4gp\" (UID: \"af22323f-0098-447d-8322-b367e7b1867a\") " pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807343    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-system-cni-dir\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807367    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abb79bd5-9512-4cc8-a6c4-669d891ded8c-host\") pod \"node-ca-dchvn\" (UID: \"abb79bd5-9512-4cc8-a6c4-669d891ded8c\") " pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10f69fbb-a959-4134-8bac-774133c880eb-env-overrides\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-sysctl-d\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807463    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-multus-conf-dir\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807464    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x77vn\" (UniqueName: \"kubernetes.io/projected/e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1-kube-api-access-x77vn\") pod \"iptables-alerter-ccnh4\" (UID: \"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1\") " pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:29.035080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807700    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10f69fbb-a959-4134-8bac-774133c880eb-ovnkube-config\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807720    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d400b60-6ea5-4781-a3b8-f29316e869ec-system-cni-dir\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807725    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-cnibin\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-systemd\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807792    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af22323f-0098-447d-8322-b367e7b1867a-tmp-dir\") pod \"node-resolver-ct4gp\" (UID: \"af22323f-0098-447d-8322-b367e7b1867a\") " pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807796    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abb79bd5-9512-4cc8-a6c4-669d891ded8c-serviceca\") pod \"node-ca-dchvn\" (UID: \"abb79bd5-9512-4cc8-a6c4-669d891ded8c\") " pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807818    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d400b60-6ea5-4781-a3b8-f29316e869ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9f5f\" (UniqueName: \"kubernetes.io/projected/6d400b60-6ea5-4781-a3b8-f29316e869ec-kube-api-access-c9f5f\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807959    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af22323f-0098-447d-8322-b367e7b1867a-hosts-file\") pod \"node-resolver-ct4gp\" (UID: \"af22323f-0098-447d-8322-b367e7b1867a\") " pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807995    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f24c78df-9a55-455e-958d-63de113d1809-cni-binary-copy\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808023    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-var-lib-kubelet\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808047    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-run-multus-certs\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807767    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-cnibin\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808108    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.806985    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-var-lib-cni-bin\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808144    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10f69fbb-a959-4134-8bac-774133c880eb-ovnkube-config\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808166    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-systemd\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-sysconfig\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.035952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808184    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-kubernetes\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808216    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-run-netns\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808251    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-host-cni-bin\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808263    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d400b60-6ea5-4781-a3b8-f29316e869ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808276    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-run-netns\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807665    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f24c78df-9a55-455e-958d-63de113d1809-multus-daemon-config\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808336    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-var-lib-kubelet\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808345    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808378    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-sysconfig\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807344    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f69fbb-a959-4134-8bac-774133c880eb-etc-openvswitch\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.807416    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1-iptables-alerter-script\") pod \"iptables-alerter-ccnh4\" (UID: \"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1\") " pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808556    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af22323f-0098-447d-8322-b367e7b1867a-tmp-dir\") pod \"node-resolver-ct4gp\" (UID: \"af22323f-0098-447d-8322-b367e7b1867a\") " pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808618    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abb79bd5-9512-4cc8-a6c4-669d891ded8c-host\") pod \"node-ca-dchvn\" (UID: \"abb79bd5-9512-4cc8-a6c4-669d891ded8c\") " pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808664    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f24c78df-9a55-455e-958d-63de113d1809-host-run-multus-certs\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808740    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-sysctl-d\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808761    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f24c78df-9a55-455e-958d-63de113d1809-cni-binary-copy\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.808857    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10f69fbb-a959-4134-8bac-774133c880eb-env-overrides\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.810757    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7be8df99-0b89-4839-8d1b-4c0b4c1d8da3-agent-certs\") pod \"konnectivity-agent-7trqs\" (UID: \"7be8df99-0b89-4839-8d1b-4c0b4c1d8da3\") " pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:29.036711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.810845    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7fc2965-56bb-4832-bc43-3abfdee96dea-tmp\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.812728    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7fc2965-56bb-4832-bc43-3abfdee96dea-etc-tuned\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.814927    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjnw8\" (UniqueName: \"kubernetes.io/projected/f24c78df-9a55-455e-958d-63de113d1809-kube-api-access-qjnw8\") pod \"multus-jlxpd\" (UID: \"f24c78df-9a55-455e-958d-63de113d1809\") " pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.814954    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.814973    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.815007    2569 projected.go:196] Error preparing data for projected volume kube-api-access-jjfqb for pod openshift-network-diagnostics/network-check-target-vqhxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:28.815071    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb podName:3c403e2c-4fe0-49ff-96c8-ee92ef2db0de nodeName:}" failed. No retries permitted until 2026-07-18 00:40:29.315052963 +0000 UTC m=+3.027164249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jjfqb" (UniqueName: "kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb") pod "network-check-target-vqhxj" (UID: "3c403e2c-4fe0-49ff-96c8-ee92ef2db0de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.816983    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6dqg\" (UniqueName: \"kubernetes.io/projected/7cc5c5ff-de6f-46da-a2fd-02db6554cd90-kube-api-access-s6dqg\") pod \"aws-ebs-csi-driver-node-fcmx4\" (UID: \"7cc5c5ff-de6f-46da-a2fd-02db6554cd90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.817867    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brxk7\" (UniqueName: \"kubernetes.io/projected/b7fc2965-56bb-4832-bc43-3abfdee96dea-kube-api-access-brxk7\") pod \"tuned-ctc7z\" (UID: \"b7fc2965-56bb-4832-bc43-3abfdee96dea\") " pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.818384    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk7n7\" (UniqueName: \"kubernetes.io/projected/10f69fbb-a959-4134-8bac-774133c880eb-kube-api-access-hk7n7\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.819074    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfwkp\" (UniqueName: \"kubernetes.io/projected/9e41728b-827b-4dba-a64a-41984218f873-kube-api-access-hfwkp\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.819555    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x77vn\" (UniqueName: \"kubernetes.io/projected/e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1-kube-api-access-x77vn\") pod \"iptables-alerter-ccnh4\" (UID: \"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1\") " pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.820159    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ftrp\" (UniqueName: \"kubernetes.io/projected/af22323f-0098-447d-8322-b367e7b1867a-kube-api-access-6ftrp\") pod \"node-resolver-ct4gp\" (UID: \"af22323f-0098-447d-8322-b367e7b1867a\") " pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.820806    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10f69fbb-a959-4134-8bac-774133c880eb-ovn-node-metrics-cert\") pod \"ovnkube-node-fgtfv\" (UID: \"10f69fbb-a959-4134-8bac-774133c880eb\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.822276    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6tx7\" (UniqueName: \"kubernetes.io/projected/abb79bd5-9512-4cc8-a6c4-669d891ded8c-kube-api-access-m6tx7\") pod \"node-ca-dchvn\" (UID: \"abb79bd5-9512-4cc8-a6c4-669d891ded8c\") " pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.822637    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9f5f\" (UniqueName: \"kubernetes.io/projected/6d400b60-6ea5-4781-a3b8-f29316e869ec-kube-api-access-c9f5f\") pod \"multus-additional-cni-plugins-gt8rf\" (UID: \"6d400b60-6ea5-4781-a3b8-f29316e869ec\") " pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.833730    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal" event={"ID":"3ee29b9f5c56eaea9fcbfaf63581c9a2","Type":"ContainerStarted","Data":"9d7aa5dfa1a671fe84b01f0f29d949fc83a01df328749184c22b1ac49063f4d6"}
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.835055    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal" event={"ID":"a4aba9e93320aeafca49a676d8341479","Type":"ContainerStarted","Data":"967c78bfc3c1c42147c3d120e02cb5a75fb14a0d1c42df16cb1b366edb90d7bd"}
Jul 18 00:40:29.037506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.927753    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:29.038126 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.936839    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ct4gp"
Jul 18 00:40:29.038126 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.949560    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gt8rf"
Jul 18 00:40:29.038126 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.956306    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlxpd"
Jul 18 00:40:29.038126 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.969816    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ccnh4"
Jul 18 00:40:29.038126 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:28.977910    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4"
Jul 18 00:40:29.038126 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:29.015764    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:29.038126 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:29.025292    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ctc7z"
Jul 18 00:40:29.038126 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:29.032709    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dchvn"
Jul 18 00:40:29.311059 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:29.310979    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:29.311059 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:29.311053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:29.311269 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:29.311161    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:29.311269 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:29.311238    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret podName:e95a1c22-8d46-4a2a-992c-b256526539c5 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:30.311217488 +0000 UTC m=+4.023328768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret") pod "global-pull-secret-syncer-5g8kc" (UID: "e95a1c22-8d46-4a2a-992c-b256526539c5") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:29.311269 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:29.311164    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:29.311405 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:29.311314    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs podName:9e41728b-827b-4dba-a64a-41984218f873 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:30.311293056 +0000 UTC m=+4.023404337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs") pod "network-metrics-daemon-cjstx" (UID: "9e41728b-827b-4dba-a64a-41984218f873") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:29.411845 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:29.411802    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:29.412020 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:29.411991    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:29.412020 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:29.412014    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:29.412139 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:29.412029    2569 projected.go:196] Error preparing data for projected volume kube-api-access-jjfqb for pod openshift-network-diagnostics/network-check-target-vqhxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:29.412139 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:29.412101    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb podName:3c403e2c-4fe0-49ff-96c8-ee92ef2db0de nodeName:}" failed. No retries permitted until 2026-07-18 00:40:30.412079351 +0000 UTC m=+4.124190629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjfqb" (UniqueName: "kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb") pod "network-check-target-vqhxj" (UID: "3c403e2c-4fe0-49ff-96c8-ee92ef2db0de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:29.654125 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:29.654027    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:35:28 +0000 UTC" deadline="2028-04-08 21:11:01.20955731 +0000 UTC"
Jul 18 00:40:29.654125 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:29.654079    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15140h30m31.555483448s"
Jul 18 00:40:29.826162 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:29.826127    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:29.826774 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:29.826292    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:29.879782 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:29.879760    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f69fbb_a959_4134_8bac_774133c880eb.slice/crio-28fc20235a9023234c064ecec76bd0bc284527edaca396bb343eaf6b76d74667 WatchSource:0}: Error finding container 28fc20235a9023234c064ecec76bd0bc284527edaca396bb343eaf6b76d74667: Status 404 returned error can't find the container with id 28fc20235a9023234c064ecec76bd0bc284527edaca396bb343eaf6b76d74667
Jul 18 00:40:29.899376 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:29.899347    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fc2965_56bb_4832_bc43_3abfdee96dea.slice/crio-fa6d1c8b9db8517a641ae4da15bcd533d08468897b3ad501b1d37cbdb2030196 WatchSource:0}: Error finding container fa6d1c8b9db8517a641ae4da15bcd533d08468897b3ad501b1d37cbdb2030196: Status 404 returned error can't find the container with id fa6d1c8b9db8517a641ae4da15bcd533d08468897b3ad501b1d37cbdb2030196
Jul 18 00:40:29.902386 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:29.902338    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc5c5ff_de6f_46da_a2fd_02db6554cd90.slice/crio-83e05e91ad1870288766318b6621bfc2ea28b861b78acc1252c71716e4a3c8c1 WatchSource:0}: Error finding container 83e05e91ad1870288766318b6621bfc2ea28b861b78acc1252c71716e4a3c8c1: Status 404 returned error can't find the container with id 83e05e91ad1870288766318b6621bfc2ea28b861b78acc1252c71716e4a3c8c1
Jul 18 00:40:29.903112 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:29.903030    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb79bd5_9512_4cc8_a6c4_669d891ded8c.slice/crio-5c1a7bfd8e64e4e7eaf470219439cdedfc2c483d0934a2f02a4b0325ecd952a4 WatchSource:0}: Error finding container 5c1a7bfd8e64e4e7eaf470219439cdedfc2c483d0934a2f02a4b0325ecd952a4: Status 404 returned error can't find the container with id 5c1a7bfd8e64e4e7eaf470219439cdedfc2c483d0934a2f02a4b0325ecd952a4
Jul 18 00:40:29.904173 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:40:29.903873    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf22323f_0098_447d_8322_b367e7b1867a.slice/crio-cf490fa7d04f791aa6d6c4a561d3cb311ab851aff89d78ea4d711b9e70565419 WatchSource:0}: Error finding container cf490fa7d04f791aa6d6c4a561d3cb311ab851aff89d78ea4d711b9e70565419: Status 404 returned error can't find the container with id cf490fa7d04f791aa6d6c4a561d3cb311ab851aff89d78ea4d711b9e70565419
Jul 18 00:40:30.318164 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.317860    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:30.318164 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.318125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:30.318457 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.318164    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:30.318457 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.318253    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:30.318457 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.318262    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret podName:e95a1c22-8d46-4a2a-992c-b256526539c5 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:32.31823288 +0000 UTC m=+6.030344146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret") pod "global-pull-secret-syncer-5g8kc" (UID: "e95a1c22-8d46-4a2a-992c-b256526539c5") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:30.318457 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.318304    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs podName:9e41728b-827b-4dba-a64a-41984218f873 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:32.318288378 +0000 UTC m=+6.030399641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs") pod "network-metrics-daemon-cjstx" (UID: "9e41728b-827b-4dba-a64a-41984218f873") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:30.418995 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.418914    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:30.419153 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.419113    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:30.419153 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.419141    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:30.419274 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.419157    2569 projected.go:196] Error preparing data for projected volume kube-api-access-jjfqb for pod openshift-network-diagnostics/network-check-target-vqhxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:30.419274 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.419239    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb podName:3c403e2c-4fe0-49ff-96c8-ee92ef2db0de nodeName:}" failed. No retries permitted until 2026-07-18 00:40:32.419219339 +0000 UTC m=+6.131330603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjfqb" (UniqueName: "kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb") pod "network-check-target-vqhxj" (UID: "3c403e2c-4fe0-49ff-96c8-ee92ef2db0de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:30.654344 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.654247    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:35:28 +0000 UTC" deadline="2028-04-02 08:10:36.1991927 +0000 UTC"
Jul 18 00:40:30.654344 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.654294    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14983h30m5.544905104s"
Jul 18 00:40:30.831386 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.830840    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:30.831386 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.830971    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:30.831386 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.831003    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:30.831386 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:30.831145    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:30.862633 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.862595    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ctc7z" event={"ID":"b7fc2965-56bb-4832-bc43-3abfdee96dea","Type":"ContainerStarted","Data":"fa6d1c8b9db8517a641ae4da15bcd533d08468897b3ad501b1d37cbdb2030196"}
Jul 18 00:40:30.871397 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.871362    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerStarted","Data":"28fc20235a9023234c064ecec76bd0bc284527edaca396bb343eaf6b76d74667"}
Jul 18 00:40:30.885431 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.885399    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal" event={"ID":"3ee29b9f5c56eaea9fcbfaf63581c9a2","Type":"ContainerStarted","Data":"fc647136e649ecdfcfed99f2611b8bd45b2acd9cff268fd85a308da6dcc44c52"}
Jul 18 00:40:30.900499 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.900443    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-221.ec2.internal" podStartSLOduration=2.900424754 podStartE2EDuration="2.900424754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:30.899728671 +0000 UTC m=+4.611839958" watchObservedRunningTime="2026-07-18 00:40:30.900424754 +0000 UTC m=+4.612536041"
Jul 18 00:40:30.905379 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.905252    2569 generic.go:356] "Generic (PLEG): container finished" podID="a4aba9e93320aeafca49a676d8341479" containerID="5e12aaafd5c8c5c37a597cdfb145e2b2ea6610c4bc3e2a6c06133652e31e1863" exitCode=0
Jul 18 00:40:30.905537 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.905514    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal" event={"ID":"a4aba9e93320aeafca49a676d8341479","Type":"ContainerDied","Data":"5e12aaafd5c8c5c37a597cdfb145e2b2ea6610c4bc3e2a6c06133652e31e1863"}
Jul 18 00:40:30.918380 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.918316    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlxpd" event={"ID":"f24c78df-9a55-455e-958d-63de113d1809","Type":"ContainerStarted","Data":"a2742600f26ff09dc5c940eac7e0285d959f4bdb11eb96831f52446a90f89783"}
Jul 18 00:40:30.970748 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.970715    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gt8rf" event={"ID":"6d400b60-6ea5-4781-a3b8-f29316e869ec","Type":"ContainerStarted","Data":"405328e3aac22cbdd30c7860c74ac118ebe43f4430a6606c3850116f8dbdbd57"}
Jul 18 00:40:30.978073 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.978044    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7trqs" event={"ID":"7be8df99-0b89-4839-8d1b-4c0b4c1d8da3","Type":"ContainerStarted","Data":"9cd8c0428451f64ddfb433a35b24f2eee645fd9b3ff580d621d9b50de5ae9482"}
Jul 18 00:40:30.996746 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:30.996660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ct4gp" event={"ID":"af22323f-0098-447d-8322-b367e7b1867a","Type":"ContainerStarted","Data":"cf490fa7d04f791aa6d6c4a561d3cb311ab851aff89d78ea4d711b9e70565419"}
Jul 18 00:40:31.009936 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:31.009772    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4" event={"ID":"7cc5c5ff-de6f-46da-a2fd-02db6554cd90","Type":"ContainerStarted","Data":"83e05e91ad1870288766318b6621bfc2ea28b861b78acc1252c71716e4a3c8c1"}
Jul 18 00:40:31.019747 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:31.019651    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ccnh4" event={"ID":"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1","Type":"ContainerStarted","Data":"f7b6f1855ed7767bf5cbd6663c31d89beef78cd1bae1b38e7836e84650b9e51f"}
Jul 18 00:40:31.027719 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:31.027647    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dchvn" event={"ID":"abb79bd5-9512-4cc8-a6c4-669d891ded8c","Type":"ContainerStarted","Data":"5c1a7bfd8e64e4e7eaf470219439cdedfc2c483d0934a2f02a4b0325ecd952a4"}
Jul 18 00:40:31.826995 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:31.826321    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:31.826995 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:31.826491    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:32.045877 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:32.045837    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal" event={"ID":"a4aba9e93320aeafca49a676d8341479","Type":"ContainerStarted","Data":"f1195f88aee8dbc531d17571017147749d79e8968c6f0aa7adea9c7b179162e1"}
Jul 18 00:40:32.063542 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:32.063476    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-221.ec2.internal" podStartSLOduration=5.063457627 podStartE2EDuration="5.063457627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:32.061820463 +0000 UTC m=+5.773931748" watchObservedRunningTime="2026-07-18 00:40:32.063457627 +0000 UTC m=+5.775568914"
Jul 18 00:40:32.337382 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:32.337348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:32.337569 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:32.337459    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:32.337569 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.337521    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:32.337683 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.337569    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:32.337683 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.337599    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs podName:9e41728b-827b-4dba-a64a-41984218f873 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:36.33757975 +0000 UTC m=+10.049691016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs") pod "network-metrics-daemon-cjstx" (UID: "9e41728b-827b-4dba-a64a-41984218f873") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:32.337683 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.337622    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret podName:e95a1c22-8d46-4a2a-992c-b256526539c5 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:36.3376069 +0000 UTC m=+10.049718166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret") pod "global-pull-secret-syncer-5g8kc" (UID: "e95a1c22-8d46-4a2a-992c-b256526539c5") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:32.438016 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:32.437960    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:32.438272 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.438129    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:32.438272 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.438150    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:32.438272 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.438163    2569 projected.go:196] Error preparing data for projected volume kube-api-access-jjfqb for pod openshift-network-diagnostics/network-check-target-vqhxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:32.438272 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.438240    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb podName:3c403e2c-4fe0-49ff-96c8-ee92ef2db0de nodeName:}" failed. No retries permitted until 2026-07-18 00:40:36.438222339 +0000 UTC m=+10.150333601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjfqb" (UniqueName: "kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb") pod "network-check-target-vqhxj" (UID: "3c403e2c-4fe0-49ff-96c8-ee92ef2db0de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:32.829334 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:32.828629    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:32.829334 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.828749    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:32.829334 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:32.829123    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:32.829334 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:32.829238    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:33.826501 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:33.825989    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:33.826501 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:33.826145    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:34.830613 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:34.830301    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:34.830613 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:34.830435    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:34.830613 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:34.830437    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:34.830613 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:34.830536    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:35.826059 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:35.826019    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:35.826239 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:35.826173    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:36.371555 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:36.371009    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:36.371555 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:36.371120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:36.371555 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.371132    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:36.371555 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.371215    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs podName:9e41728b-827b-4dba-a64a-41984218f873 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:44.371180293 +0000 UTC m=+18.083291579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs") pod "network-metrics-daemon-cjstx" (UID: "9e41728b-827b-4dba-a64a-41984218f873") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:36.371555 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.371218    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:36.371555 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.371251    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret podName:e95a1c22-8d46-4a2a-992c-b256526539c5 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:44.371242086 +0000 UTC m=+18.083353362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret") pod "global-pull-secret-syncer-5g8kc" (UID: "e95a1c22-8d46-4a2a-992c-b256526539c5") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:36.472763 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:36.472487    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:36.472763 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.472642    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:36.472763 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.472660    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:36.472763 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.472672    2569 projected.go:196] Error preparing data for projected volume kube-api-access-jjfqb for pod openshift-network-diagnostics/network-check-target-vqhxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:36.472763 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.472729    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb podName:3c403e2c-4fe0-49ff-96c8-ee92ef2db0de nodeName:}" failed. No retries permitted until 2026-07-18 00:40:44.472710765 +0000 UTC m=+18.184822044 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjfqb" (UniqueName: "kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb") pod "network-check-target-vqhxj" (UID: "3c403e2c-4fe0-49ff-96c8-ee92ef2db0de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:36.829797 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:36.829720    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:36.829964 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.829841    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:36.830346 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:36.830206    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:36.830346 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:36.830300    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:37.826484 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:37.826162    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:37.826484 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:37.826332    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:38.825950 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:38.825812    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:38.825950 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:38.825954    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:38.826433 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:38.826280    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:38.826433 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:38.826395    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:39.826255 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:39.826221    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:39.826426 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:39.826361    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:40.825845 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:40.825785    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:40.825845 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:40.825830    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:40.826365 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:40.825932    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:40.826365 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:40.826064    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:41.826021 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:41.825987    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:41.826490 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:41.826127    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:42.826488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:42.826453    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:42.826955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:42.826458    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:42.826955 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:42.826635    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:42.826955 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:42.826771    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:43.826413 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:43.826378    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:43.826635 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:43.826513    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:44.436818 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:44.436769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:44.436818 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:44.436823    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:44.437071 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.436932    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:44.437071 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.437003    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs podName:9e41728b-827b-4dba-a64a-41984218f873 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:00.436982912 +0000 UTC m=+34.149094178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs") pod "network-metrics-daemon-cjstx" (UID: "9e41728b-827b-4dba-a64a-41984218f873") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:44.437071 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.436932    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:44.437230 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.437099    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret podName:e95a1c22-8d46-4a2a-992c-b256526539c5 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:00.437078261 +0000 UTC m=+34.149189544 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret") pod "global-pull-secret-syncer-5g8kc" (UID: "e95a1c22-8d46-4a2a-992c-b256526539c5") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:44.537895 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:44.537858    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:44.538060 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.538016    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:44.538060 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.538034    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:44.538060 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.538046    2569 projected.go:196] Error preparing data for projected volume kube-api-access-jjfqb for pod openshift-network-diagnostics/network-check-target-vqhxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:44.538212 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.538108    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb podName:3c403e2c-4fe0-49ff-96c8-ee92ef2db0de nodeName:}" failed. No retries permitted until 2026-07-18 00:41:00.538091201 +0000 UTC m=+34.250202470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjfqb" (UniqueName: "kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb") pod "network-check-target-vqhxj" (UID: "3c403e2c-4fe0-49ff-96c8-ee92ef2db0de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:44.826331 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:44.826247    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:44.826331 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:44.826282    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:44.826535 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.826391    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:44.826580 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:44.826526    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:45.825880 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:45.825844    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:45.826370 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:45.825991    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:46.826844 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:46.826804    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:46.827287 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:46.826910    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:46.827287 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:46.826959    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:46.827287 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:46.826985    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:47.825839 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:47.825799    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:47.826020 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:47.825950    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:48.827033 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:48.826441    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:48.827033 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:48.826625    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:48.827033 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:48.826851    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:48.827033 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:48.826761    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:49.083991 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.083960    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dchvn" event={"ID":"abb79bd5-9512-4cc8-a6c4-669d891ded8c","Type":"ContainerStarted","Data":"13a494314e4d56cd9a677c3d4ed9726817f546d2ec2e3ab66315e676b191d9e8"}
Jul 18 00:40:49.085628 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.085600    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ctc7z" event={"ID":"b7fc2965-56bb-4832-bc43-3abfdee96dea","Type":"ContainerStarted","Data":"29c39a6b89c55b95a50c5bdd371862432acd33e628b66f09119cf0f4c8d3be72"}
Jul 18 00:40:49.087242 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.087218    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerStarted","Data":"2242ff6dab429ab9b1223ca13eb8293d5b27288426a6504b7db22a24ceb57b74"}
Jul 18 00:40:49.089370 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.089255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlxpd" event={"ID":"f24c78df-9a55-455e-958d-63de113d1809","Type":"ContainerStarted","Data":"66aa7a8fffcfde64e80fb8d7d57a6ce058b72c7198cf85ed19919dc80d50b26a"}
Jul 18 00:40:49.094382 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.094281    2569 generic.go:356] "Generic (PLEG): container finished" podID="6d400b60-6ea5-4781-a3b8-f29316e869ec" containerID="22ff4278687023038b65e066767284fe32dbc1baab416cab88012f87c86bb930" exitCode=0
Jul 18 00:40:49.094382 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.094362    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gt8rf" event={"ID":"6d400b60-6ea5-4781-a3b8-f29316e869ec","Type":"ContainerDied","Data":"22ff4278687023038b65e066767284fe32dbc1baab416cab88012f87c86bb930"}
Jul 18 00:40:49.096059 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.096037    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7trqs" event={"ID":"7be8df99-0b89-4839-8d1b-4c0b4c1d8da3","Type":"ContainerStarted","Data":"9a0bcd0bc7c70c44418fafaa794a741533bd0f3d3ed6393b30c3e07593c2a738"}
Jul 18 00:40:49.097462 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.097417    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dchvn" podStartSLOduration=4.304257335 podStartE2EDuration="23.097401902s" totalImagesPullingTime="18.793144567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:49.097395587 +0000 UTC m=+22.809506874" watchObservedRunningTime="2026-07-18 00:40:49.097401902 +0000 UTC m=+22.809513187"
Jul 18 00:40:49.097573 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.097543    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ct4gp" event={"ID":"af22323f-0098-447d-8322-b367e7b1867a","Type":"ContainerStarted","Data":"fee681e7d56962c5c1d7ddc56519a0e71a5d551f3f5586831e5ddfd4942e633a"}
Jul 18 00:40:49.099255 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.099237    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4" event={"ID":"7cc5c5ff-de6f-46da-a2fd-02db6554cd90","Type":"ContainerStarted","Data":"fae70077fe4812681329559b2f9de609f0f029c56d019a5bc95324be9e2bb28d"}
Jul 18 00:40:49.149361 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.149323    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7trqs" podStartSLOduration=12.692137971 podStartE2EDuration="23.149309298s" totalImagesPullingTime="10.457171327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:49.148680044 +0000 UTC m=+22.860791329" watchObservedRunningTime="2026-07-18 00:40:49.149309298 +0000 UTC m=+22.861420583"
Jul 18 00:40:49.149489 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.149469    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jlxpd" podStartSLOduration=4.337733816 podStartE2EDuration="23.14946469s" totalImagesPullingTime="18.811730874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:49.135167695 +0000 UTC m=+22.847278973" watchObservedRunningTime="2026-07-18 00:40:49.14946469 +0000 UTC m=+22.861575978"
Jul 18 00:40:49.163574 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.163539    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ctc7z" podStartSLOduration=4.363877697 podStartE2EDuration="23.163523991s" totalImagesPullingTime="18.799646294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:49.163068609 +0000 UTC m=+22.875179896" watchObservedRunningTime="2026-07-18 00:40:49.163523991 +0000 UTC m=+22.875635275"
Jul 18 00:40:49.179780 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.179640    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ct4gp" podStartSLOduration=4.387070612 podStartE2EDuration="23.17962559s" totalImagesPullingTime="18.792554978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:49.179374382 +0000 UTC m=+22.891485666" watchObservedRunningTime="2026-07-18 00:40:49.17962559 +0000 UTC m=+22.891736875"
Jul 18 00:40:49.826574 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:49.826545    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:49.826736 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:49.826656    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:50.103738 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.103700    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ccnh4" event={"ID":"e4fc22b8-6a49-42a6-9959-d5b4dbbe0eb1","Type":"ContainerStarted","Data":"25e8d08253dbcb7e49457125804e301e0886f2b39b468ef4b7d8c36a8590e11e"}
Jul 18 00:40:50.108021 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.107992    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:40:50.109376 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.109138    2569 generic.go:356] "Generic (PLEG): container finished" podID="10f69fbb-a959-4134-8bac-774133c880eb" containerID="cf20388fd75ff21036b53932ef87ab4dfd398e6c2bd296344bf2cba60dd13f11" exitCode=1
Jul 18 00:40:50.109376 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.109223    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerStarted","Data":"bb270e677eb4ff97dd4397bc36e192188898b5e244a436c833dd51d6eb3d404c"}
Jul 18 00:40:50.109376 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.109302    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerStarted","Data":"e7064954ea82c5bbd9fb0af61d13712b589374579114497d7c8fa8fdb56b528e"}
Jul 18 00:40:50.109376 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.109352    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerStarted","Data":"6c542ed90b78382f9344b235f1c9b5d794275c17168bdb27001cecdb1f7f8ffa"}
Jul 18 00:40:50.109730 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.109400    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerStarted","Data":"d3b2ca12c76483d01b441f423898334f44d788c5baa0a73c7d8f32497c71f97a"}
Jul 18 00:40:50.109730 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.109447    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerDied","Data":"cf20388fd75ff21036b53932ef87ab4dfd398e6c2bd296344bf2cba60dd13f11"}
Jul 18 00:40:50.122964 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.122910    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ccnh4" podStartSLOduration=5.333036577 podStartE2EDuration="24.122891141s" totalImagesPullingTime="18.789854564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:50.122539505 +0000 UTC m=+23.834650792" watchObservedRunningTime="2026-07-18 00:40:50.122891141 +0000 UTC m=+23.835002426"
Jul 18 00:40:50.190554 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.190523    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 00:40:50.678144 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.677822    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T00:40:50.190548833Z","UUID":"ef93b002-08c8-4ca2-af9f-5e3abb1d83fd","Handler":null,"Name":"","Endpoint":""}
Jul 18 00:40:50.679861 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.679840    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 00:40:50.679980 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.679886    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 00:40:50.825848 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.825820    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:50.826182 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:50.825820    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:50.826182 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:50.825949    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:50.826182 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:50.826062    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:51.114077 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:51.114002    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4" event={"ID":"7cc5c5ff-de6f-46da-a2fd-02db6554cd90","Type":"ContainerStarted","Data":"87e3e0fe8eb1fa803c40215ee9fd7c8c1d6859d1346ffae2ccedc84b776c4eb5"}
Jul 18 00:40:51.756472 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:51.756440    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:51.757264 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:51.757243    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:51.825782 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:51.825749    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:51.825973 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:51.825889    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:52.118954 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:52.118877    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4" event={"ID":"7cc5c5ff-de6f-46da-a2fd-02db6554cd90","Type":"ContainerStarted","Data":"b9ef694ad1b1461142457d058f268b5666f5f9b5448429a0ef1d6a386c1af86c"}
Jul 18 00:40:52.119517 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:52.119088    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:52.119726 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:52.119699    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7trqs"
Jul 18 00:40:52.139531 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:52.139472    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcmx4" podStartSLOduration=5.178935367 podStartE2EDuration="26.139457281s" totalImagesPullingTime="20.960521914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:52.139351482 +0000 UTC m=+25.851462768" watchObservedRunningTime="2026-07-18 00:40:52.139457281 +0000 UTC m=+25.851568579"
Jul 18 00:40:52.826020 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:52.825989    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:52.826225 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:52.826139    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:52.826225 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:52.826181    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:52.826359 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:52.826306    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:53.826580 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:53.826508    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:53.827178 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:53.826614    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:54.125370 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:54.125305    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:40:54.125741 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:54.125713    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerStarted","Data":"aa0f6dbc08020ccf7717228c33c57f31ac8a5839464bcc6b831c3d367f1b3909"}
Jul 18 00:40:54.127286 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:54.127262    2569 generic.go:356] "Generic (PLEG): container finished" podID="6d400b60-6ea5-4781-a3b8-f29316e869ec" containerID="de22e2cd35ec5183627ba65c94375ca9225a9c257cb4049a58c62b3a73bdef46" exitCode=0
Jul 18 00:40:54.127378 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:54.127355    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gt8rf" event={"ID":"6d400b60-6ea5-4781-a3b8-f29316e869ec","Type":"ContainerDied","Data":"de22e2cd35ec5183627ba65c94375ca9225a9c257cb4049a58c62b3a73bdef46"}
Jul 18 00:40:54.825960 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:54.825928    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:54.826210 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:54.826059    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:54.826210 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:54.826108    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:54.826323 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:54.826235    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:55.131051 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:55.130979    2569 generic.go:356] "Generic (PLEG): container finished" podID="6d400b60-6ea5-4781-a3b8-f29316e869ec" containerID="e50e56566ee2b2372b9ad7c5300b5110d9112e9f07ea920ef49d83e1dc1c5b13" exitCode=0
Jul 18 00:40:55.131051 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:55.131024    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gt8rf" event={"ID":"6d400b60-6ea5-4781-a3b8-f29316e869ec","Type":"ContainerDied","Data":"e50e56566ee2b2372b9ad7c5300b5110d9112e9f07ea920ef49d83e1dc1c5b13"}
Jul 18 00:40:55.825905 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:55.825692    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:55.826046 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:55.825944    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:56.136214 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:56.136175    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:40:56.136621 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:56.136595    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerStarted","Data":"88373b2d6823bca0806807fae27349aa0f3eb9316c9952e64114ee9cff2247e1"}
Jul 18 00:40:56.136868 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:56.136833    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:56.136980 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:56.136921    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:56.137057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:56.137040    2569 scope.go:117] "RemoveContainer" containerID="cf20388fd75ff21036b53932ef87ab4dfd398e6c2bd296344bf2cba60dd13f11"
Jul 18 00:40:56.152385 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:56.152354    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:56.828643 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:56.828482    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:56.828879 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:56.828541    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:56.828879 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:56.828698    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:56.828879 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:56.828796    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:56.947263 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:56.947186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:40:57.028022 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.027978    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:40:57.141613 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.141543    2569 generic.go:356] "Generic (PLEG): container finished" podID="6d400b60-6ea5-4781-a3b8-f29316e869ec" containerID="9f4c3cc75ad60037574323e20bff26d3eae710e2ae5cff33573e9980ee602978" exitCode=0
Jul 18 00:40:57.141983 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.141622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gt8rf" event={"ID":"6d400b60-6ea5-4781-a3b8-f29316e869ec","Type":"ContainerDied","Data":"9f4c3cc75ad60037574323e20bff26d3eae710e2ae5cff33573e9980ee602978"}
Jul 18 00:40:57.145649 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.145633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:40:57.146070 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.146048    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" event={"ID":"10f69fbb-a959-4134-8bac-774133c880eb","Type":"ContainerStarted","Data":"0fc50c5b8d5c63a2094c656f33224d75edb62078c38db9ceca2ee1ae33dbc2fa"}
Jul 18 00:40:57.146287 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.146262    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:57.161319 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.161296    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:40:57.188134 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.188085    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv" podStartSLOduration=12.195622903 podStartE2EDuration="31.188070303s" totalImagesPullingTime="18.9924474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:57.186852834 +0000 UTC m=+30.898964119" watchObservedRunningTime="2026-07-18 00:40:57.188070303 +0000 UTC m=+30.900181566"
Jul 18 00:40:57.275929 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.275899    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:40:57.377642 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.377596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:40:57.727149 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.727121    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5g8kc"]
Jul 18 00:40:57.727338 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.727282    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:57.727420 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:57.727391    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:40:57.730348 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.730311    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqhxj"]
Jul 18 00:40:57.730473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.730431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:57.730545 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:57.730521    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:57.731013 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.730987    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cjstx"]
Jul 18 00:40:57.731123 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:57.731103    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:57.731219 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:57.731182    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:58.274974 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:58.274912    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:40:58.333390 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:58.333320    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:40:58.826023 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:58.825994    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:40:58.826172 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:58.826139    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:40:59.210656 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:59.210566    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:40:59.364494 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:59.364448    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:40:59.464288 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:59.464186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:40:59.826100 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:59.826011    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:40:59.826280 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:40:59.826009    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:40:59.826280 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:59.826146    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqhxj" podUID="3c403e2c-4fe0-49ff-96c8-ee92ef2db0de"
Jul 18 00:40:59.826280 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:40:59.826213    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5g8kc" podUID="e95a1c22-8d46-4a2a-992c-b256526539c5"
Jul 18 00:41:00.454133 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:00.454091    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:41:00.454133 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:00.454143    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:41:00.454782 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:00.454269    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:41:00.454782 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:00.454342    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs podName:9e41728b-827b-4dba-a64a-41984218f873 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:32.454316089 +0000 UTC m=+66.166427356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs") pod "network-metrics-daemon-cjstx" (UID: "9e41728b-827b-4dba-a64a-41984218f873") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:41:00.454782 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:00.454269    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:41:00.454782 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:00.454398    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret podName:e95a1c22-8d46-4a2a-992c-b256526539c5 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:32.454385888 +0000 UTC m=+66.166497168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret") pod "global-pull-secret-syncer-5g8kc" (UID: "e95a1c22-8d46-4a2a-992c-b256526539c5") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:41:00.555328 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:00.555293    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:41:00.555518 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:00.555454    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:41:00.555518 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:00.555472    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:41:00.555518 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:00.555481    2569 projected.go:196] Error preparing data for projected volume kube-api-access-jjfqb for pod openshift-network-diagnostics/network-check-target-vqhxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:41:00.555679 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:00.555539    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb podName:3c403e2c-4fe0-49ff-96c8-ee92ef2db0de nodeName:}" failed. No retries permitted until 2026-07-18 00:41:32.555520498 +0000 UTC m=+66.267631767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjfqb" (UniqueName: "kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb") pod "network-check-target-vqhxj" (UID: "3c403e2c-4fe0-49ff-96c8-ee92ef2db0de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:41:00.829979 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:00.829906    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:41:00.830120 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:00.830031    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:41:01.485964 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.485877    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:01.586371 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.586333    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:01.588788 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.588771    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-221.ec2.internal" event="NodeReady"
Jul 18 00:41:01.588900 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.588889    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 00:41:01.634984 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.634960    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mn6cd"]
Jul 18 00:41:01.648420 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.648376    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-scwzp"]
Jul 18 00:41:01.648527 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.648502    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.650840 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.650822    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 00:41:01.650964 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.650926    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45fg4\""
Jul 18 00:41:01.651272 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.651255    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 00:41:01.666490 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.666472    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mn6cd"]
Jul 18 00:41:01.666562 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.666507    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-scwzp"]
Jul 18 00:41:01.666642 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.666624    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-scwzp"
Jul 18 00:41:01.668681 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.668661    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 00:41:01.668775 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.668713    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 00:41:01.668962 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.668947    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 00:41:01.669063 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.669042    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f7jgd\""
Jul 18 00:41:01.748854 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.748588    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:01.764739 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.764717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.764843 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.764763    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5735c71-606c-4433-a5cb-9b4525cb785e-tmp-dir\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.764843 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.764795    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4tfl\" (UniqueName: \"kubernetes.io/projected/b5735c71-606c-4433-a5cb-9b4525cb785e-kube-api-access-x4tfl\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.764906 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.764858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee41e07e-3fd4-42f2-a833-d003f921be2c-cert\") pod \"ingress-canary-scwzp\" (UID: \"ee41e07e-3fd4-42f2-a833-d003f921be2c\") " pod="openshift-ingress-canary/ingress-canary-scwzp"
Jul 18 00:41:01.764906 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.764901    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf45d\" (UniqueName: \"kubernetes.io/projected/ee41e07e-3fd4-42f2-a833-d003f921be2c-kube-api-access-jf45d\") pod \"ingress-canary-scwzp\" (UID: \"ee41e07e-3fd4-42f2-a833-d003f921be2c\") " pod="openshift-ingress-canary/ingress-canary-scwzp"
Jul 18 00:41:01.764975 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.764923    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5735c71-606c-4433-a5cb-9b4525cb785e-config-volume\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.826514 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.826487    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:41:01.826663 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.826644    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:41:01.829725 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.829628    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zwmmq\""
Jul 18 00:41:01.829867 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.829792    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 00:41:01.829932 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.829870    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 00:41:01.829993 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.829974    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 00:41:01.866088 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.866065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf45d\" (UniqueName: \"kubernetes.io/projected/ee41e07e-3fd4-42f2-a833-d003f921be2c-kube-api-access-jf45d\") pod \"ingress-canary-scwzp\" (UID: \"ee41e07e-3fd4-42f2-a833-d003f921be2c\") " pod="openshift-ingress-canary/ingress-canary-scwzp"
Jul 18 00:41:01.866222 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.866095    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5735c71-606c-4433-a5cb-9b4525cb785e-config-volume\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.866222 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.866114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.866222 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.866144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5735c71-606c-4433-a5cb-9b4525cb785e-tmp-dir\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.866222 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.866217    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4tfl\" (UniqueName: \"kubernetes.io/projected/b5735c71-606c-4433-a5cb-9b4525cb785e-kube-api-access-x4tfl\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.866437 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:01.866246    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:01.866437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.866265    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee41e07e-3fd4-42f2-a833-d003f921be2c-cert\") pod \"ingress-canary-scwzp\" (UID: \"ee41e07e-3fd4-42f2-a833-d003f921be2c\") " pod="openshift-ingress-canary/ingress-canary-scwzp"
Jul 18 00:41:01.866437 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:01.866304    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls podName:b5735c71-606c-4433-a5cb-9b4525cb785e nodeName:}" failed. No retries permitted until 2026-07-18 00:41:02.366289814 +0000 UTC m=+36.078401076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls") pod "dns-default-mn6cd" (UID: "b5735c71-606c-4433-a5cb-9b4525cb785e") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:01.866567 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.866542    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5735c71-606c-4433-a5cb-9b4525cb785e-tmp-dir\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.866756 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.866740    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5735c71-606c-4433-a5cb-9b4525cb785e-config-volume\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.870163 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.870143    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee41e07e-3fd4-42f2-a833-d003f921be2c-cert\") pod \"ingress-canary-scwzp\" (UID: \"ee41e07e-3fd4-42f2-a833-d003f921be2c\") " pod="openshift-ingress-canary/ingress-canary-scwzp"
Jul 18 00:41:01.874782 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.874758    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4tfl\" (UniqueName: \"kubernetes.io/projected/b5735c71-606c-4433-a5cb-9b4525cb785e-kube-api-access-x4tfl\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:01.874972 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.874958    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf45d\" (UniqueName: \"kubernetes.io/projected/ee41e07e-3fd4-42f2-a833-d003f921be2c-kube-api-access-jf45d\") pod \"ingress-canary-scwzp\" (UID: \"ee41e07e-3fd4-42f2-a833-d003f921be2c\") " pod="openshift-ingress-canary/ingress-canary-scwzp"
Jul 18 00:41:01.975130 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:01.975102    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-scwzp"
Jul 18 00:41:02.161853 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:02.161821    2569 generic.go:356] "Generic (PLEG): container finished" podID="6d400b60-6ea5-4781-a3b8-f29316e869ec" containerID="96f79cd33afdb260fcbe41b3705830f996f224b52d29bf45b23ae536d620d2b1" exitCode=0
Jul 18 00:41:02.161987 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:02.161905    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gt8rf" event={"ID":"6d400b60-6ea5-4781-a3b8-f29316e869ec","Type":"ContainerDied","Data":"96f79cd33afdb260fcbe41b3705830f996f224b52d29bf45b23ae536d620d2b1"}
Jul 18 00:41:02.175784 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:02.175764    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-scwzp"]
Jul 18 00:41:02.179212 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:41:02.179172    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee41e07e_3fd4_42f2_a833_d003f921be2c.slice/crio-80eb52253052318e2cb2eac946ca6a69cbb3a77fdeb5961cf19741d6ca2ddf63 WatchSource:0}: Error finding container 80eb52253052318e2cb2eac946ca6a69cbb3a77fdeb5961cf19741d6ca2ddf63: Status 404 returned error can't find the container with id 80eb52253052318e2cb2eac946ca6a69cbb3a77fdeb5961cf19741d6ca2ddf63
Jul 18 00:41:02.370540 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:02.370502    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:02.370728 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:02.370671    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:02.370789 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:02.370750    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls podName:b5735c71-606c-4433-a5cb-9b4525cb785e nodeName:}" failed. No retries permitted until 2026-07-18 00:41:03.370730977 +0000 UTC m=+37.082842244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls") pod "dns-default-mn6cd" (UID: "b5735c71-606c-4433-a5cb-9b4525cb785e") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:02.825800 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:02.825763    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:41:02.828341 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:02.828321    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 00:41:02.828509 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:02.828318    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65442\""
Jul 18 00:41:03.168318 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:03.168231    2569 generic.go:356] "Generic (PLEG): container finished" podID="6d400b60-6ea5-4781-a3b8-f29316e869ec" containerID="afe61d0ccdda614d2773edf4a84cba3a481415d073da194b4f2425c99d36450c" exitCode=0
Jul 18 00:41:03.168477 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:03.168308    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gt8rf" event={"ID":"6d400b60-6ea5-4781-a3b8-f29316e869ec","Type":"ContainerDied","Data":"afe61d0ccdda614d2773edf4a84cba3a481415d073da194b4f2425c99d36450c"}
Jul 18 00:41:03.169673 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:03.169637    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-scwzp" event={"ID":"ee41e07e-3fd4-42f2-a833-d003f921be2c","Type":"ContainerStarted","Data":"80eb52253052318e2cb2eac946ca6a69cbb3a77fdeb5961cf19741d6ca2ddf63"}
Jul 18 00:41:03.379056 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:03.378846    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:03.379056 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:03.379028    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:03.379332 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:03.379138    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls podName:b5735c71-606c-4433-a5cb-9b4525cb785e nodeName:}" failed. No retries permitted until 2026-07-18 00:41:05.379117384 +0000 UTC m=+39.091228650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls") pod "dns-default-mn6cd" (UID: "b5735c71-606c-4433-a5cb-9b4525cb785e") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:04.174906 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:04.174884    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gt8rf" event={"ID":"6d400b60-6ea5-4781-a3b8-f29316e869ec","Type":"ContainerStarted","Data":"2bad6853d6686162a9e20965ae422646980fa321e5daa1cd5c647f3cf0b50ad6"}
Jul 18 00:41:04.196589 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:04.196544    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gt8rf" podStartSLOduration=8.960241084 podStartE2EDuration="38.196528767s" totalImagesPullingTime="29.236287683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:04.195316256 +0000 UTC m=+37.907427542" watchObservedRunningTime="2026-07-18 00:41:04.196528767 +0000 UTC m=+37.908640073"
Jul 18 00:41:04.319923 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:04.319888    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:04.377173 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:04.377138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:05.179007 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:05.178970    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-scwzp" event={"ID":"ee41e07e-3fd4-42f2-a833-d003f921be2c","Type":"ContainerStarted","Data":"44b9513c7c75b3ac9c238aeb95a29296f7fe029b1bbe1968e0fb56e6729b98aa"}
Jul 18 00:41:05.193184 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:05.193139    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-scwzp" podStartSLOduration=2.235368238 podStartE2EDuration="4.193123157s" totalImagesPullingTime="1.957754919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:05.192618059 +0000 UTC m=+38.904729344" watchObservedRunningTime="2026-07-18 00:41:05.193123157 +0000 UTC m=+38.905234420"
Jul 18 00:41:05.392289 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:05.392245    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:05.392464 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:05.392384    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:05.392464 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:05.392448    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls podName:b5735c71-606c-4433-a5cb-9b4525cb785e nodeName:}" failed. No retries permitted until 2026-07-18 00:41:09.392429663 +0000 UTC m=+43.104540925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls") pod "dns-default-mn6cd" (UID: "b5735c71-606c-4433-a5cb-9b4525cb785e") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:05.885419 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:05.885385    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:05.985472 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:05.985438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:09.418046 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:09.418008    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:09.418454 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:09.418132    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:09.418454 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:09.418183    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls podName:b5735c71-606c-4433-a5cb-9b4525cb785e nodeName:}" failed. No retries permitted until 2026-07-18 00:41:17.418170072 +0000 UTC m=+51.130281348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls") pod "dns-default-mn6cd" (UID: "b5735c71-606c-4433-a5cb-9b4525cb785e") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:09.762489 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:09.762412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:14.325357 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:14.325322    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:14.383274 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:14.383236    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:14.786649 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:14.786614    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:14.841092 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:14.841056    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:17.475459 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:17.475417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:17.475833 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:17.475570    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:17.475833 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:17.475635    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls podName:b5735c71-606c-4433-a5cb-9b4525cb785e nodeName:}" failed. No retries permitted until 2026-07-18 00:41:33.475618015 +0000 UTC m=+67.187729278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls") pod "dns-default-mn6cd" (UID: "b5735c71-606c-4433-a5cb-9b4525cb785e") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:23.439173 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:23.439133    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:23.486028 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:23.485986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:29.161337 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:29.161307    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgtfv"
Jul 18 00:41:29.311612 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:29.311577    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:29.363395 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:29.363369    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:31.189326 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.189294    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:31.193614 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.193587    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"]
Jul 18 00:41:31.226858 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.226833    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"]
Jul 18 00:41:31.226981 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.226918    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"
Jul 18 00:41:31.229400 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.229381    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 18 00:41:31.230489 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.230471    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 18 00:41:31.230572 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.230496    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 18 00:41:31.230658 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.230637    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-69wfg\""
Jul 18 00:41:31.230775 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.230682    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 18 00:41:31.286300 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.286266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:31.342229 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.342175    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:31.369353 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.369327    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrmws\" (UniqueName: \"kubernetes.io/projected/f5a2b0c4-f269-4572-a9a8-cdc863440606-kube-api-access-lrmws\") pod \"managed-serviceaccount-addon-agent-6cd889b658-flgts\" (UID: \"f5a2b0c4-f269-4572-a9a8-cdc863440606\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"
Jul 18 00:41:31.369465 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.369370    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5a2b0c4-f269-4572-a9a8-cdc863440606-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cd889b658-flgts\" (UID: \"f5a2b0c4-f269-4572-a9a8-cdc863440606\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"
Jul 18 00:41:31.470326 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.470244    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrmws\" (UniqueName: \"kubernetes.io/projected/f5a2b0c4-f269-4572-a9a8-cdc863440606-kube-api-access-lrmws\") pod \"managed-serviceaccount-addon-agent-6cd889b658-flgts\" (UID: \"f5a2b0c4-f269-4572-a9a8-cdc863440606\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"
Jul 18 00:41:31.470326 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.470294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5a2b0c4-f269-4572-a9a8-cdc863440606-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cd889b658-flgts\" (UID: \"f5a2b0c4-f269-4572-a9a8-cdc863440606\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"
Jul 18 00:41:31.474110 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.474075    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5a2b0c4-f269-4572-a9a8-cdc863440606-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cd889b658-flgts\" (UID: \"f5a2b0c4-f269-4572-a9a8-cdc863440606\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"
Jul 18 00:41:31.477587 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.477565    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrmws\" (UniqueName: \"kubernetes.io/projected/f5a2b0c4-f269-4572-a9a8-cdc863440606-kube-api-access-lrmws\") pod \"managed-serviceaccount-addon-agent-6cd889b658-flgts\" (UID: \"f5a2b0c4-f269-4572-a9a8-cdc863440606\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"
Jul 18 00:41:31.548034 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.547999    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"
Jul 18 00:41:31.685391 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:31.685362    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts"]
Jul 18 00:41:31.688896 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:41:31.688866    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5a2b0c4_f269_4572_a9a8_cdc863440606.slice/crio-a17e86769a7f0048196a73b1dd13daafff064ffad1cabee176eba2299c6b9a64 WatchSource:0}: Error finding container a17e86769a7f0048196a73b1dd13daafff064ffad1cabee176eba2299c6b9a64: Status 404 returned error can't find the container with id a17e86769a7f0048196a73b1dd13daafff064ffad1cabee176eba2299c6b9a64
Jul 18 00:41:32.243658 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.243612    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts" event={"ID":"f5a2b0c4-f269-4572-a9a8-cdc863440606","Type":"ContainerStarted","Data":"a17e86769a7f0048196a73b1dd13daafff064ffad1cabee176eba2299c6b9a64"}
Jul 18 00:41:32.477804 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.477766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:41:32.477986 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.477815    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:41:32.480780 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.480752    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 00:41:32.480780 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.480776    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 00:41:32.488724 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:32.488651    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 18 00:41:32.488849 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:32.488729    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs podName:9e41728b-827b-4dba-a64a-41984218f873 nodeName:}" failed. No retries permitted until 2026-07-18 00:42:36.488706292 +0000 UTC m=+130.200817561 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs") pod "network-metrics-daemon-cjstx" (UID: "9e41728b-827b-4dba-a64a-41984218f873") : secret "metrics-daemon-secret" not found
Jul 18 00:41:32.492046 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.492016    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95a1c22-8d46-4a2a-992c-b256526539c5-original-pull-secret\") pod \"global-pull-secret-syncer-5g8kc\" (UID: \"e95a1c22-8d46-4a2a-992c-b256526539c5\") " pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:41:32.579278 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.579168    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:41:32.581967 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.581940    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 00:41:32.591931 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.591902    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 00:41:32.603745 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.603692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjfqb\" (UniqueName: \"kubernetes.io/projected/3c403e2c-4fe0-49ff-96c8-ee92ef2db0de-kube-api-access-jjfqb\") pod \"network-check-target-vqhxj\" (UID: \"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de\") " pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:41:32.741156 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.741124    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zwmmq\""
Jul 18 00:41:32.743070 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.743047    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5g8kc"
Jul 18 00:41:32.749842 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.749822    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:41:32.887516 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.887442    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5g8kc"]
Jul 18 00:41:32.899114 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:32.899084    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqhxj"]
Jul 18 00:41:33.485637 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:33.485601    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:41:33.486099 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:33.485751    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:33.486099 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:41:33.485829    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls podName:b5735c71-606c-4433-a5cb-9b4525cb785e nodeName:}" failed. No retries permitted until 2026-07-18 00:42:05.485808032 +0000 UTC m=+99.197919315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls") pod "dns-default-mn6cd" (UID: "b5735c71-606c-4433-a5cb-9b4525cb785e") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:33.862606 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:41:33.862561    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95a1c22_8d46_4a2a_992c_b256526539c5.slice/crio-1bb85ac4fa5f3a2a10da93e62844df6cba04678358f6713f0a062a9f4eb0e020 WatchSource:0}: Error finding container 1bb85ac4fa5f3a2a10da93e62844df6cba04678358f6713f0a062a9f4eb0e020: Status 404 returned error can't find the container with id 1bb85ac4fa5f3a2a10da93e62844df6cba04678358f6713f0a062a9f4eb0e020
Jul 18 00:41:33.863323 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:41:33.863187    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c403e2c_4fe0_49ff_96c8_ee92ef2db0de.slice/crio-e9cdebb0651547bd1176b094d444d02238016f1a0ddaa253fc16160a5e719dbb WatchSource:0}: Error finding container e9cdebb0651547bd1176b094d444d02238016f1a0ddaa253fc16160a5e719dbb: Status 404 returned error can't find the container with id e9cdebb0651547bd1176b094d444d02238016f1a0ddaa253fc16160a5e719dbb
Jul 18 00:41:34.249986 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:34.249898    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqhxj" event={"ID":"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de","Type":"ContainerStarted","Data":"e9cdebb0651547bd1176b094d444d02238016f1a0ddaa253fc16160a5e719dbb"}
Jul 18 00:41:34.251589 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:34.251557    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts" event={"ID":"f5a2b0c4-f269-4572-a9a8-cdc863440606","Type":"ContainerStarted","Data":"fdf3b7e4a6fc1818302419001f0f00ea071c3d5f3ffdd61a83fe644a95cc906d"}
Jul 18 00:41:34.252959 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:34.252935    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5g8kc" event={"ID":"e95a1c22-8d46-4a2a-992c-b256526539c5","Type":"ContainerStarted","Data":"1bb85ac4fa5f3a2a10da93e62844df6cba04678358f6713f0a062a9f4eb0e020"}
Jul 18 00:41:34.265853 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:34.265798    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts" podStartSLOduration=1.050334031 podStartE2EDuration="3.265778951s" totalImagesPullingTime="2.21544492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:34.265163769 +0000 UTC m=+67.977275055" watchObservedRunningTime="2026-07-18 00:41:34.265778951 +0000 UTC m=+67.977890237"
Jul 18 00:41:35.299438 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:35.299375    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:35.355368 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:35.355273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:41:39.266166 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:39.266099    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5g8kc" event={"ID":"e95a1c22-8d46-4a2a-992c-b256526539c5","Type":"ContainerStarted","Data":"aa185dc05a6437e745a413ba6a536014495265b7949c97db9cdcfc14286624d0"}
Jul 18 00:41:39.267474 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:39.267446    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqhxj" event={"ID":"3c403e2c-4fe0-49ff-96c8-ee92ef2db0de","Type":"ContainerStarted","Data":"7210f841db7adcc878b3c001339bf77b722bad6d63cc37cac2d8d46905bb9469"}
Jul 18 00:41:39.267590 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:39.267512    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:41:39.279946 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:41:39.279902    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5g8kc" podStartSLOduration=68.853044808 podStartE2EDuration="1m13.279889454s" totalImagesPullingTime="4.426844646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:39.279158696 +0000 UTC m=+72.991269980" watchObservedRunningTime="2026-07-18 00:41:39.279889454 +0000 UTC m=+72.992000739"
Jul 18 00:42:01.730002 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:42:01.729874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:42:01.784711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:42:01.784677    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:42:05.580398 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:42:05.580356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:42:05.580782 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:42:05.580464    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:42:05.580782 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:42:05.580525    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls podName:b5735c71-606c-4433-a5cb-9b4525cb785e nodeName:}" failed. No retries permitted until 2026-07-18 00:43:09.580511076 +0000 UTC m=+163.292622338 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls") pod "dns-default-mn6cd" (UID: "b5735c71-606c-4433-a5cb-9b4525cb785e") : secret "dns-default-metrics-tls" not found
Jul 18 00:42:10.271486 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:42:10.271460    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vqhxj"
Jul 18 00:42:10.285261 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:42:10.285189    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vqhxj" podStartSLOduration=99.863093469 podStartE2EDuration="1m44.285172953s" totalImagesPullingTime="4.422079484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:39.292052333 +0000 UTC m=+73.004163619" watchObservedRunningTime="2026-07-18 00:42:10.285172953 +0000 UTC m=+103.997284237"
Jul 18 00:42:36.581074 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:42:36.581034    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:42:36.581520 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:42:36.581145    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 18 00:42:36.581520 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:42:36.581226    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs podName:9e41728b-827b-4dba-a64a-41984218f873 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:38.581211552 +0000 UTC m=+252.293322829 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs") pod "network-metrics-daemon-cjstx" (UID: "9e41728b-827b-4dba-a64a-41984218f873") : secret "metrics-daemon-secret" not found
Jul 18 00:43:04.658559 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:43:04.658517    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mn6cd" podUID="b5735c71-606c-4433-a5cb-9b4525cb785e"
Jul 18 00:43:05.478280 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:43:05.478254    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:43:05.836301 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:43:05.836225    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cjstx" podUID="9e41728b-827b-4dba-a64a-41984218f873"
Jul 18 00:43:09.605908 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:43:09.605840    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:43:09.606339 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:43:09.605995    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:43:09.606339 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:43:09.606078    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls podName:b5735c71-606c-4433-a5cb-9b4525cb785e nodeName:}" failed. No retries permitted until 2026-07-18 00:45:11.606060709 +0000 UTC m=+285.318171971 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls") pod "dns-default-mn6cd" (UID: "b5735c71-606c-4433-a5cb-9b4525cb785e") : secret "dns-default-metrics-tls" not found
Jul 18 00:43:18.825864 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:43:18.825826    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:43:34.548863 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:43:34.548826    2569 generic.go:356] "Generic (PLEG): container finished" podID="f5a2b0c4-f269-4572-a9a8-cdc863440606" containerID="fdf3b7e4a6fc1818302419001f0f00ea071c3d5f3ffdd61a83fe644a95cc906d" exitCode=255
Jul 18 00:43:34.549253 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:43:34.548889    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts" event={"ID":"f5a2b0c4-f269-4572-a9a8-cdc863440606","Type":"ContainerDied","Data":"fdf3b7e4a6fc1818302419001f0f00ea071c3d5f3ffdd61a83fe644a95cc906d"}
Jul 18 00:43:34.554325 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:43:34.554310    2569 scope.go:117] "RemoveContainer" containerID="fdf3b7e4a6fc1818302419001f0f00ea071c3d5f3ffdd61a83fe644a95cc906d"
Jul 18 00:43:35.553998 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:43:35.553965    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd889b658-flgts" event={"ID":"f5a2b0c4-f269-4572-a9a8-cdc863440606","Type":"ContainerStarted","Data":"a820c605a90dff812f6952cbdb702ce1315af18039d1bf21e31b4aed6da23329"}
Jul 18 00:44:17.674998 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.674965    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7ffd784b5c-tngwm"]
Jul 18 00:44:17.677734 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.677717    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.680080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.680062    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 18 00:44:17.680812 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.680797    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 18 00:44:17.681093 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.681055    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 18 00:44:17.682055 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.682041    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lrgc9\""
Jul 18 00:44:17.690739 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.690720    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 18 00:44:17.695904 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.695878    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ffd784b5c-tngwm"]
Jul 18 00:44:17.768887 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.768853    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"]
Jul 18 00:44:17.771972 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.771955    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"]
Jul 18 00:44:17.772102 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.772087    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:17.774760 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.774739    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5zj6k\""
Jul 18 00:44:17.774760 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.774755    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"]
Jul 18 00:44:17.774964 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.774771    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 18 00:44:17.774964 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.774883    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:17.775083 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.775001    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 18 00:44:17.775392 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.775377    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 18 00:44:17.777041 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.777025    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 00:44:17.777486 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.777450    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 00:44:17.777486 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.777474    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qlzxk\""
Jul 18 00:44:17.777651 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.777514    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75cf4cd9bb-ggh9t"]
Jul 18 00:44:17.777651 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.777608    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:17.778094 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.778075    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 18 00:44:17.778888 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.778869    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 18 00:44:17.779660 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.779611    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l69g7\""
Jul 18 00:44:17.779974 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.779952    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 18 00:44:17.779974 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.779954    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 18 00:44:17.780122 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.780077    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 18 00:44:17.780376 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.780359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:17.780443 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.780415    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 18 00:44:17.782468 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.782450    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 00:44:17.782577 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.782527    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"]
Jul 18 00:44:17.782577 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.782564    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 00:44:17.782712 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.782694    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 18 00:44:17.783216 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.782828    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7mcp5\""
Jul 18 00:44:17.783216 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.782859    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 18 00:44:17.783216 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.783109    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 18 00:44:17.783216 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.783148    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 18 00:44:17.783663 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.783646    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"]
Jul 18 00:44:17.786159 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.786119    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"]
Jul 18 00:44:17.789644 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.789624    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75cf4cd9bb-ggh9t"]
Jul 18 00:44:17.860078 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.860048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-installation-pull-secrets\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.860284 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.860085    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.860284 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.860120    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-registry-certificates\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.860284 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.860150    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-bound-sa-token\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.860284 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.860172    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkfv7\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-kube-api-access-lkfv7\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.860284 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.860229    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf603add-5618-4b9d-bd65-51d4a483d174-ca-trust-extracted\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.860284 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.860261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-trusted-ca\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.860284 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.860278    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-image-registry-private-configuration\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.925712 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.925635    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:17.961549 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:17.961700 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961560    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:17.961700 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb256\" (UniqueName: \"kubernetes.io/projected/17e89550-7ad4-4238-8256-ce6714057522-kube-api-access-tb256\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:17.961700 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-installation-pull-secrets\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.961864 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961705    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8hk\" (UniqueName: \"kubernetes.io/projected/d69ca821-3563-43fb-95c7-619da8186293-kube-api-access-9j8hk\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:17.961864 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961738    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.961864 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961763    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-bound-sa-token\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.961864 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961821    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf603add-5618-4b9d-bd65-51d4a483d174-ca-trust-extracted\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.961864 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:17.961832    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:44:17.961864 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:17.961851    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ffd784b5c-tngwm: secret "image-registry-tls" not found
Jul 18 00:44:17.962171 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:17.961905    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls podName:bf603add-5618-4b9d-bd65-51d4a483d174 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:18.461888095 +0000 UTC m=+232.173999377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls") pod "image-registry-7ffd784b5c-tngwm" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174") : secret "image-registry-tls" not found
Jul 18 00:44:17.962171 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b776b90d-c30a-4e86-8e28-451f2ce302d8-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-dpctk\" (UID: \"b776b90d-c30a-4e86-8e28-451f2ce302d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:17.962171 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961943    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-stats-auth\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:17.962171 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.961975    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-trusted-ca\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.962171 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962004    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-image-registry-private-configuration\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.962171 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962032    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcx7t\" (UniqueName: \"kubernetes.io/projected/5d617678-df43-4dc2-a526-9daa60532f90-kube-api-access-gcx7t\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:17.962171 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzwgm\" (UniqueName: \"kubernetes.io/projected/b776b90d-c30a-4e86-8e28-451f2ce302d8-kube-api-access-zzwgm\") pod \"kube-storage-version-migrator-operator-7658d9b749-dpctk\" (UID: \"b776b90d-c30a-4e86-8e28-451f2ce302d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:17.962171 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962075    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:17.962171 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/17e89550-7ad4-4238-8256-ce6714057522-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:17.962635 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-default-certificate\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:17.962635 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962212    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf603add-5618-4b9d-bd65-51d4a483d174-ca-trust-extracted\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.962635 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-registry-certificates\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.962635 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkfv7\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-kube-api-access-lkfv7\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.962635 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:17.962635 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962364    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b776b90d-c30a-4e86-8e28-451f2ce302d8-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-dpctk\" (UID: \"b776b90d-c30a-4e86-8e28-451f2ce302d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:17.962831 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.962751    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-registry-certificates\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.963136 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.963112    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-trusted-ca\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.964143 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.964114    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-installation-pull-secrets\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.964403 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.964388    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-image-registry-private-configuration\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.971936 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.971909    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-bound-sa-token\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:17.972058 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:17.971993    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkfv7\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-kube-api-access-lkfv7\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:18.063431 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063399    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-default-certificate\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.063557 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063440    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.063557 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063463    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b776b90d-c30a-4e86-8e28-451f2ce302d8-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-dpctk\" (UID: \"b776b90d-c30a-4e86-8e28-451f2ce302d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:18.063557 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063490    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:18.063557 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063520    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.063557 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb256\" (UniqueName: \"kubernetes.io/projected/17e89550-7ad4-4238-8256-ce6714057522-kube-api-access-tb256\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:18.063797 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.063567    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 00:44:18.063797 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8hk\" (UniqueName: \"kubernetes.io/projected/d69ca821-3563-43fb-95c7-619da8186293-kube-api-access-9j8hk\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.063797 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.063621    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:18.063797 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.063640    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:18.563620677 +0000 UTC m=+232.275731961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : secret "router-metrics-certs-default" not found
Jul 18 00:44:18.063797 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.063675    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:18.563657151 +0000 UTC m=+232.275768438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : configmap references non-existent config key: service-ca.crt
Jul 18 00:44:18.063797 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.063714    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls podName:17e89550-7ad4-4238-8256-ce6714057522 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:18.563702751 +0000 UTC m=+232.275814014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xphp9" (UID: "17e89550-7ad4-4238-8256-ce6714057522") : secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:18.063797 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063757    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b776b90d-c30a-4e86-8e28-451f2ce302d8-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-dpctk\" (UID: \"b776b90d-c30a-4e86-8e28-451f2ce302d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:18.063797 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063787    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-stats-auth\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.064167 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcx7t\" (UniqueName: \"kubernetes.io/projected/5d617678-df43-4dc2-a526-9daa60532f90-kube-api-access-gcx7t\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:18.064167 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzwgm\" (UniqueName: \"kubernetes.io/projected/b776b90d-c30a-4e86-8e28-451f2ce302d8-kube-api-access-zzwgm\") pod \"kube-storage-version-migrator-operator-7658d9b749-dpctk\" (UID: \"b776b90d-c30a-4e86-8e28-451f2ce302d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:18.064167 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063882    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:18.064167 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.063929    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/17e89550-7ad4-4238-8256-ce6714057522-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:18.064167 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.063960    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 00:44:18.064167 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.064000    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls podName:5d617678-df43-4dc2-a526-9daa60532f90 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:18.563986838 +0000 UTC m=+232.276098100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4tcn" (UID: "5d617678-df43-4dc2-a526-9daa60532f90") : secret "samples-operator-tls" not found
Jul 18 00:44:18.064167 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.064144    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b776b90d-c30a-4e86-8e28-451f2ce302d8-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-dpctk\" (UID: \"b776b90d-c30a-4e86-8e28-451f2ce302d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:18.064708 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.064686    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/17e89550-7ad4-4238-8256-ce6714057522-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:18.066040 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.066018    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-stats-auth\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.066430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.066350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b776b90d-c30a-4e86-8e28-451f2ce302d8-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-dpctk\" (UID: \"b776b90d-c30a-4e86-8e28-451f2ce302d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:18.066575 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.066556    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-default-certificate\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.072426 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.072402    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8hk\" (UniqueName: \"kubernetes.io/projected/d69ca821-3563-43fb-95c7-619da8186293-kube-api-access-9j8hk\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.072867 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.072845    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzwgm\" (UniqueName: \"kubernetes.io/projected/b776b90d-c30a-4e86-8e28-451f2ce302d8-kube-api-access-zzwgm\") pod \"kube-storage-version-migrator-operator-7658d9b749-dpctk\" (UID: \"b776b90d-c30a-4e86-8e28-451f2ce302d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:18.073087 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.073067    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcx7t\" (UniqueName: \"kubernetes.io/projected/5d617678-df43-4dc2-a526-9daa60532f90-kube-api-access-gcx7t\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:18.073154 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.073143    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb256\" (UniqueName: \"kubernetes.io/projected/17e89550-7ad4-4238-8256-ce6714057522-kube-api-access-tb256\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:18.097883 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.097849    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"
Jul 18 00:44:18.216214 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.216123    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk"]
Jul 18 00:44:18.220377 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:44:18.220344    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb776b90d_c30a_4e86_8e28_451f2ce302d8.slice/crio-eae159f1e9f58602666f2b44f4563934681cd48c9e694004eb332b199caada7e WatchSource:0}: Error finding container eae159f1e9f58602666f2b44f4563934681cd48c9e694004eb332b199caada7e: Status 404 returned error can't find the container with id eae159f1e9f58602666f2b44f4563934681cd48c9e694004eb332b199caada7e
Jul 18 00:44:18.467744 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.467657    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:18.467886 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.467812    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:44:18.467886 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.467831    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ffd784b5c-tngwm: secret "image-registry-tls" not found
Jul 18 00:44:18.467952 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.467903    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls podName:bf603add-5618-4b9d-bd65-51d4a483d174 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:19.467888202 +0000 UTC m=+233.179999465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls") pod "image-registry-7ffd784b5c-tngwm" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174") : secret "image-registry-tls" not found
Jul 18 00:44:18.568460 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.568428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.568541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.568508    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:18.568579 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.568544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:18.568579 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.568570    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:18.568651 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.568595    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:19.568573759 +0000 UTC m=+233.280685044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : configmap references non-existent config key: service-ca.crt
Jul 18 00:44:18.568651 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.568643    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:18.568727 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.568648    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 00:44:18.568727 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.568655    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 00:44:18.568727 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.568684    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls podName:17e89550-7ad4-4238-8256-ce6714057522 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:19.568670365 +0000 UTC m=+233.280781628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xphp9" (UID: "17e89550-7ad4-4238-8256-ce6714057522") : secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:18.568727 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.568700    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:19.56868975 +0000 UTC m=+233.280801038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : secret "router-metrics-certs-default" not found
Jul 18 00:44:18.568727 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:18.568713    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls podName:5d617678-df43-4dc2-a526-9daa60532f90 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:19.568706992 +0000 UTC m=+233.280818255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4tcn" (UID: "5d617678-df43-4dc2-a526-9daa60532f90") : secret "samples-operator-tls" not found
Jul 18 00:44:18.671856 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:18.671825    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk" event={"ID":"b776b90d-c30a-4e86-8e28-451f2ce302d8","Type":"ContainerStarted","Data":"eae159f1e9f58602666f2b44f4563934681cd48c9e694004eb332b199caada7e"}
Jul 18 00:44:19.057541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:19.057491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:19.475305 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:19.475266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:19.475497 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.475424    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:44:19.475497 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.475444    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ffd784b5c-tngwm: secret "image-registry-tls" not found
Jul 18 00:44:19.475613 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.475511    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls podName:bf603add-5618-4b9d-bd65-51d4a483d174 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:21.475488805 +0000 UTC m=+235.187600072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls") pod "image-registry-7ffd784b5c-tngwm" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174") : secret "image-registry-tls" not found
Jul 18 00:44:19.576189 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:19.576145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:19.576385 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:19.576237    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:19.576385 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:19.576276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:19.576385 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:19.576306    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:19.576385 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.576351    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 00:44:19.576604 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.576406    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:19.576604 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.576421    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls podName:5d617678-df43-4dc2-a526-9daa60532f90 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:21.576402317 +0000 UTC m=+235.288513593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4tcn" (UID: "5d617678-df43-4dc2-a526-9daa60532f90") : secret "samples-operator-tls" not found
Jul 18 00:44:19.576604 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.576462    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls podName:17e89550-7ad4-4238-8256-ce6714057522 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:21.576446928 +0000 UTC m=+235.288558196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xphp9" (UID: "17e89550-7ad4-4238-8256-ce6714057522") : secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:19.576604 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.576404    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 00:44:19.576604 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.576485    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:21.576471021 +0000 UTC m=+235.288582285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : configmap references non-existent config key: service-ca.crt
Jul 18 00:44:19.576604 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:19.576518    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:21.576506756 +0000 UTC m=+235.288618029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : secret "router-metrics-certs-default" not found
Jul 18 00:44:19.894959 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:19.894924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:19.974574 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:19.974527    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:20.680036 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:20.680000    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk" event={"ID":"b776b90d-c30a-4e86-8e28-451f2ce302d8","Type":"ContainerStarted","Data":"134d7f47b331e5627096cafb3bbf687672d701ca5a549b7133a24a173f42343a"}
Jul 18 00:44:20.695082 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:20.695035    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk" podStartSLOduration=1.4109257099999999 podStartE2EDuration="3.695021453s" totalImagesPullingTime="2.284095743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:20.694100278 +0000 UTC m=+234.406211565" watchObservedRunningTime="2026-07-18 00:44:20.695021453 +0000 UTC m=+234.407132738"
Jul 18 00:44:21.490302 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:21.490264    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:21.490502 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.490381    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:44:21.490502 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.490394    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ffd784b5c-tngwm: secret "image-registry-tls" not found
Jul 18 00:44:21.490502 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.490443    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls podName:bf603add-5618-4b9d-bd65-51d4a483d174 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:25.490429028 +0000 UTC m=+239.202540291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls") pod "image-registry-7ffd784b5c-tngwm" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174") : secret "image-registry-tls" not found
Jul 18 00:44:21.591125 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:21.591088    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:21.591318 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:21.591136    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:21.591318 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:21.591162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:21.591318 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:21.591183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:21.591318 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.591264    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 00:44:21.591318 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.591264    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 00:44:21.591528 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.591315    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:25.59130113 +0000 UTC m=+239.303412393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : configmap references non-existent config key: service-ca.crt
Jul 18 00:44:21.591528 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.591340    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:21.591528 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.591352    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls podName:5d617678-df43-4dc2-a526-9daa60532f90 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:25.591337877 +0000 UTC m=+239.303449139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4tcn" (UID: "5d617678-df43-4dc2-a526-9daa60532f90") : secret "samples-operator-tls" not found
Jul 18 00:44:21.591528 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.591369    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:25.591359822 +0000 UTC m=+239.303471090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : secret "router-metrics-certs-default" not found
Jul 18 00:44:21.591528 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:21.591396    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls podName:17e89550-7ad4-4238-8256-ce6714057522 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:25.591379532 +0000 UTC m=+239.303490798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xphp9" (UID: "17e89550-7ad4-4238-8256-ce6714057522") : secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:21.995148 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:21.995112    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:22.089755 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.089725    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:22.190048 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.190017    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:22.731004 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.730969    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v4hrg"]
Jul 18 00:44:22.734125 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.734109    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.736460 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.736422    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 00:44:22.736460 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.736443    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 00:44:22.736640 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.736431    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 00:44:22.736640 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.736490    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 00:44:22.737296 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.737278    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-56l9r\""
Jul 18 00:44:22.743258 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.743223    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v4hrg"]
Jul 18 00:44:22.764927 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.764894    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:22.800117 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.800080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0192485-c891-436a-8f5a-49d3c5a992a0-data-volume\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.800117 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.800120    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0192485-c891-436a-8f5a-49d3c5a992a0-crio-socket\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.800347 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.800253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.800347 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.800323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.800432 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.800360    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr4rp\" (UniqueName: \"kubernetes.io/projected/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-api-access-vr4rp\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.820688 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.820655    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:22.870500 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.870470    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:22.900962 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.900941    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.901038 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.901001    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.901075 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.901022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4rp\" (UniqueName: \"kubernetes.io/projected/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-api-access-vr4rp\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.901106 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:22.901075    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:44:22.901137 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:22.901099    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:22.901171 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:22.901140    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:23.401118207 +0000 UTC m=+237.113229494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : configmap "kube-rbac-proxy" not found
Jul 18 00:44:22.901171 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:22.901158    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:23.401151188 +0000 UTC m=+237.113262451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:22.901258 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.901211    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0192485-c891-436a-8f5a-49d3c5a992a0-data-volume\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.901258 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.901243    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0192485-c891-436a-8f5a-49d3c5a992a0-crio-socket\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.901353 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.901340    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0192485-c891-436a-8f5a-49d3c5a992a0-crio-socket\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.901515 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.901499    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0192485-c891-436a-8f5a-49d3c5a992a0-data-volume\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:22.910269 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:22.910248    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr4rp\" (UniqueName: \"kubernetes.io/projected/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-api-access-vr4rp\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:23.294293 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:23.294259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:23.356432 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:23.356381    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:23.406085 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:23.406059    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:23.406236 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:23.406122    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:23.406236 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:23.406173    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:44:23.406316 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:23.406250    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:24.40623543 +0000 UTC m=+238.118346693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : configmap "kube-rbac-proxy" not found
Jul 18 00:44:23.406316 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:23.406285    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:23.406394 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:23.406337    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:24.40632398 +0000 UTC m=+238.118435249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:23.571452 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:23.571372    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:23.668707 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:23.668671    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:23.927454 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:23.927414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:24.025636 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:24.025589    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:24.413949 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:24.413917    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:24.414388 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:24.414014    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:44:24.414388 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:24.414050    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:24.414388 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:24.414078    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:26.414059171 +0000 UTC m=+240.126170464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : configmap "kube-rbac-proxy" not found
Jul 18 00:44:24.414388 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:24.414128    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:24.414388 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:24.414170    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:26.414159923 +0000 UTC m=+240.126271187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:25.184465 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:25.184416    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:25.237916 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:25.237891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:25.523711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:25.523602    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:25.524098 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.523764    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:44:25.524098 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.523784    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ffd784b5c-tngwm: secret "image-registry-tls" not found
Jul 18 00:44:25.524098 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.523837    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls podName:bf603add-5618-4b9d-bd65-51d4a483d174 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:33.523822728 +0000 UTC m=+247.235933991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls") pod "image-registry-7ffd784b5c-tngwm" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174") : secret "image-registry-tls" not found
Jul 18 00:44:25.525615 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:25.525597    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ct4gp_af22323f-0098-447d-8322-b367e7b1867a/dns-node-resolver/0.log"
Jul 18 00:44:25.624470 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:25.624436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:25.624470 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:25.624479    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:25.624709 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:25.624499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:25.624709 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:25.624606    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:25.624709 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.624609    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:25.624709 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.624610    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 00:44:25.624709 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.624660    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 00:44:25.624880 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.624699    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:33.62468231 +0000 UTC m=+247.336793574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : configmap references non-existent config key: service-ca.crt
Jul 18 00:44:25.624880 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.624731    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls podName:17e89550-7ad4-4238-8256-ce6714057522 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:33.624723937 +0000 UTC m=+247.336835201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xphp9" (UID: "17e89550-7ad4-4238-8256-ce6714057522") : secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:25.624880 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.624742    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs podName:d69ca821-3563-43fb-95c7-619da8186293 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:33.624735554 +0000 UTC m=+247.336846817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs") pod "router-default-75cf4cd9bb-ggh9t" (UID: "d69ca821-3563-43fb-95c7-619da8186293") : secret "router-metrics-certs-default" not found
Jul 18 00:44:25.624880 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:25.624752    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls podName:5d617678-df43-4dc2-a526-9daa60532f90 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:33.624747753 +0000 UTC m=+247.336859015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r4tcn" (UID: "5d617678-df43-4dc2-a526-9daa60532f90") : secret "samples-operator-tls" not found
Jul 18 00:44:26.018296 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:26.018241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:26.431757 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:26.431733    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:26.431925 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:26.431857    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:26.431925 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:26.431894    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:26.432023 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:26.431956    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:44:26.432023 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:26.431962    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:30.431945222 +0000 UTC m=+244.144056500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:26.432108 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:26.432024    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:30.432009596 +0000 UTC m=+244.144120860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : configmap "kube-rbac-proxy" not found
Jul 18 00:44:26.530664 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:26.530637    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dchvn_abb79bd5-9512-4cc8-a6c4-669d891ded8c/node-ca/0.log"
Jul 18 00:44:27.214334 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:27.214296    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:27.314873 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:27.314842    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:27.322045 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:27.322007    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scwzp_ee41e07e-3fd4-42f2-a833-d003f921be2c/serve-healthcheck-canary/0.log"
Jul 18 00:44:27.489222 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:27.489123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:27.602829 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:27.602798    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:27.697781 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:27.697736    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:27.919799 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:27.919765    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:28.124625 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:28.124596    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-dpctk_b776b90d-c30a-4e86-8e28-451f2ce302d8/kube-storage-version-migrator-operator/0.log"
Jul 18 00:44:28.344515 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:28.344485    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:28.718657 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:28.718544    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:29.322103 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:29.322076    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:29.516508 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:29.516475    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:29.915768 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:29.915723    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:30.123659 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:30.123629    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:30.316431 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:30.316342    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:30.466062 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:30.466022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:30.466236 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:30.466093    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:30.466236 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:30.466144    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:44:30.466236 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:30.466231    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:30.466236 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:30.466237    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:38.466214524 +0000 UTC m=+252.178325803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : configmap "kube-rbac-proxy" not found
Jul 18 00:44:30.466387 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:30.466278    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls podName:e0192485-c891-436a-8f5a-49d3c5a992a0 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:38.466267028 +0000 UTC m=+252.178378291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v4hrg" (UID: "e0192485-c891-436a-8f5a-49d3c5a992a0") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:44:31.110576 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:31.110540    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:31.211033 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:31.211001    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:31.514956 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:31.514859    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:31.721737 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:31.721697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:31.924605 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:31.924568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:32.123500 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:32.123434    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:32.317356 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:32.317272    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:32.703469 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:32.703439    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:33.317855 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.317815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:33.591905 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.591801    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:33.594161 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.594137    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") pod \"image-registry-7ffd784b5c-tngwm\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") " pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:33.692132 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.692083    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:33.692132 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.692136    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:33.692360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.692234    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:33.692360 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:33.692251    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:33.692360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.692283    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:33.692360 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:44:33.692315    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls podName:17e89550-7ad4-4238-8256-ce6714057522 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:49.692297906 +0000 UTC m=+263.404409169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xphp9" (UID: "17e89550-7ad4-4238-8256-ce6714057522") : secret "cluster-monitoring-operator-tls" not found
Jul 18 00:44:33.692886 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.692862    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69ca821-3563-43fb-95c7-619da8186293-service-ca-bundle\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:33.694641 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.694616    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d617678-df43-4dc2-a526-9daa60532f90-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r4tcn\" (UID: \"5d617678-df43-4dc2-a526-9daa60532f90\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:33.694641 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.694631    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d69ca821-3563-43fb-95c7-619da8186293-metrics-certs\") pod \"router-default-75cf4cd9bb-ggh9t\" (UID: \"d69ca821-3563-43fb-95c7-619da8186293\") " pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:33.704181 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.704165    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7mcp5\""
Jul 18 00:44:33.712945 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.712929    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:33.719210 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.719172    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:33.772626 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.772559    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:33.835935 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.835896    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75cf4cd9bb-ggh9t"]
Jul 18 00:44:33.838739 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:44:33.838714    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69ca821_3563_43fb_95c7_619da8186293.slice/crio-e7ad838debc336ddf281b643123ff9f339d652d7d889993645c41176aec28ba8 WatchSource:0}: Error finding container e7ad838debc336ddf281b643123ff9f339d652d7d889993645c41176aec28ba8: Status 404 returned error can't find the container with id e7ad838debc336ddf281b643123ff9f339d652d7d889993645c41176aec28ba8
Jul 18 00:44:33.888908 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.888889    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lrgc9\""
Jul 18 00:44:33.897004 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.896983    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:33.916428 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.916343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:33.986948 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.986919    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5zj6k\""
Jul 18 00:44:33.995245 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:33.995218    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"
Jul 18 00:44:34.024523 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.024491    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ffd784b5c-tngwm"]
Jul 18 00:44:34.028874 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:44:34.028844    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf603add_5618_4b9d_bd65_51d4a483d174.slice/crio-ccff83f03ea87724036149725ced0af71d06654cbfcdda366cfdf5d6bdb68952 WatchSource:0}: Error finding container ccff83f03ea87724036149725ced0af71d06654cbfcdda366cfdf5d6bdb68952: Status 404 returned error can't find the container with id ccff83f03ea87724036149725ced0af71d06654cbfcdda366cfdf5d6bdb68952
Jul 18 00:44:34.129279 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.129250    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn"]
Jul 18 00:44:34.143762 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.143735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:34.517432 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.517344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:34.721440 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.721350    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm" event={"ID":"bf603add-5618-4b9d-bd65-51d4a483d174","Type":"ContainerStarted","Data":"c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752"}
Jul 18 00:44:34.721440 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.721413    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:44:34.721440 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.721434    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm" event={"ID":"bf603add-5618-4b9d-bd65-51d4a483d174","Type":"ContainerStarted","Data":"ccff83f03ea87724036149725ced0af71d06654cbfcdda366cfdf5d6bdb68952"}
Jul 18 00:44:34.722975 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.722952    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t" event={"ID":"d69ca821-3563-43fb-95c7-619da8186293","Type":"ContainerStarted","Data":"e9f05dcbddf0b62bcb44cc726790d158af9678ae44e128d8c7f991c166d0d899"}
Jul 18 00:44:34.723176 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.723154    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t" event={"ID":"d69ca821-3563-43fb-95c7-619da8186293","Type":"ContainerStarted","Data":"e7ad838debc336ddf281b643123ff9f339d652d7d889993645c41176aec28ba8"}
Jul 18 00:44:34.724167 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.724143    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn" event={"ID":"5d617678-df43-4dc2-a526-9daa60532f90","Type":"ContainerStarted","Data":"dca239741a93cc5ec76db1e77fa484b83f5f84721f187e5f78348a7786f9bba5"}
Jul 18 00:44:34.739991 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.739939    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm" podStartSLOduration=17.739922982 podStartE2EDuration="17.739922982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:34.738073912 +0000 UTC m=+248.450185199" watchObservedRunningTime="2026-07-18 00:44:34.739922982 +0000 UTC m=+248.452034266"
Jul 18 00:44:34.755623 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:34.755578    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t" podStartSLOduration=17.755563375 podStartE2EDuration="17.755563375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:34.753805713 +0000 UTC m=+248.465916994" watchObservedRunningTime="2026-07-18 00:44:34.755563375 +0000 UTC m=+248.467674659"
Jul 18 00:44:35.115027 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:35.114991    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:35.216528 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:35.216497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:35.518321 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:35.518233    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:35.713218 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:35.713169    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:35.715759 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:35.715735    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:35.726999 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:35.726977    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:35.728021 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:35.728001    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75cf4cd9bb-ggh9t"
Jul 18 00:44:35.915381 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:35.915342    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:36.117690 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:36.117659    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:36.521815 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:36.521708    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:36.730623 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:36.730591    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn" event={"ID":"5d617678-df43-4dc2-a526-9daa60532f90","Type":"ContainerStarted","Data":"f026a37924bc1151a2b858fbacf517f9bfbfa16aee4c129005c3621b5f0523b1"}
Jul 18 00:44:36.730827 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:36.730644    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn" event={"ID":"5d617678-df43-4dc2-a526-9daa60532f90","Type":"ContainerStarted","Data":"e89376306ce04db56db7a1d73f46db34b0ca04883fba755aa9aac47dc60c7256"}
Jul 18 00:44:36.744523 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:36.744476    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r4tcn" podStartSLOduration=18.183434828 podStartE2EDuration="19.744462548s" totalImagesPullingTime="1.56102772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:36.743506688 +0000 UTC m=+250.455617973" watchObservedRunningTime="2026-07-18 00:44:36.744462548 +0000 UTC m=+250.456573832"
Jul 18 00:44:37.120831 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:37.120790    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:37.516793 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:37.516703    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:37.721777 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:37.721721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:37.916423 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:37.916388    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:38.531661 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.531631    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:38.531821 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.531690    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:38.532187 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.532167    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0192485-c891-436a-8f5a-49d3c5a992a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:38.533956 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.533937    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0192485-c891-436a-8f5a-49d3c5a992a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4hrg\" (UID: \"e0192485-c891-436a-8f5a-49d3c5a992a0\") " pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:38.632614 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.632580    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:44:38.634811 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.634791    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e41728b-827b-4dba-a64a-41984218f873-metrics-certs\") pod \"network-metrics-daemon-cjstx\" (UID: \"9e41728b-827b-4dba-a64a-41984218f873\") " pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:44:38.645698 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.645674    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-56l9r\""
Jul 18 00:44:38.654436 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.654421    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v4hrg"
Jul 18 00:44:38.776446 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.776425    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v4hrg"]
Jul 18 00:44:38.779069 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:44:38.779043    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0192485_c891_436a_8f5a_49d3c5a992a0.slice/crio-8a1a85d8e991cc913d4b6796b1d16891a8487cc3ef2012aa55b1441f21eeb1b0 WatchSource:0}: Error finding container 8a1a85d8e991cc913d4b6796b1d16891a8487cc3ef2012aa55b1441f21eeb1b0: Status 404 returned error can't find the container with id 8a1a85d8e991cc913d4b6796b1d16891a8487cc3ef2012aa55b1441f21eeb1b0
Jul 18 00:44:38.928384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.928354    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65442\""
Jul 18 00:44:38.937233 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:38.937212    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjstx"
Jul 18 00:44:39.055670 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:39.055594    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cjstx"]
Jul 18 00:44:39.058948 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:44:39.058922    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e41728b_827b_4dba_a64a_41984218f873.slice/crio-16f60bac36a5cbf3252bfa42b08fadacae7589e6be3dc912d1863dcc2693a6fb WatchSource:0}: Error finding container 16f60bac36a5cbf3252bfa42b08fadacae7589e6be3dc912d1863dcc2693a6fb: Status 404 returned error can't find the container with id 16f60bac36a5cbf3252bfa42b08fadacae7589e6be3dc912d1863dcc2693a6fb
Jul 18 00:44:39.742583 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:39.742547    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v4hrg" event={"ID":"e0192485-c891-436a-8f5a-49d3c5a992a0","Type":"ContainerStarted","Data":"8a1a85d8e991cc913d4b6796b1d16891a8487cc3ef2012aa55b1441f21eeb1b0"}
Jul 18 00:44:39.743915 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:39.743879    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cjstx" event={"ID":"9e41728b-827b-4dba-a64a-41984218f873","Type":"ContainerStarted","Data":"16f60bac36a5cbf3252bfa42b08fadacae7589e6be3dc912d1863dcc2693a6fb"}
Jul 18 00:44:40.749820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:40.749783    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cjstx" event={"ID":"9e41728b-827b-4dba-a64a-41984218f873","Type":"ContainerStarted","Data":"de8bea19459aeefebb0516b88aa0b96498674a9fc94d9a203a7d427f6ad3f5d5"}
Jul 18 00:44:40.750314 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:40.749870    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cjstx" event={"ID":"9e41728b-827b-4dba-a64a-41984218f873","Type":"ContainerStarted","Data":"720ed31089fd74c2c61b30a7a7e2ed50deac9b937a92a48d13587294f9b6f8a4"}
Jul 18 00:44:40.765744 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:40.765690    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cjstx" podStartSLOduration=253.744747766 podStartE2EDuration="4m14.765667782s" totalImagesPullingTime="1.020920016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:40.764449606 +0000 UTC m=+254.476560893" watchObservedRunningTime="2026-07-18 00:44:40.765667782 +0000 UTC m=+254.477779068"
Jul 18 00:44:43.765322 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:43.765297    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v4hrg" event={"ID":"e0192485-c891-436a-8f5a-49d3c5a992a0","Type":"ContainerStarted","Data":"3c8be621051c880194935647dc5cae2d6c8663179393f72b6f60c75f4322cd88"}
Jul 18 00:44:44.367375 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:44.367327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:44.451136 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:44.451086    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:44.874081 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:44.874044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:44.973651 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:44.973621    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:45.380325 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.380285    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:45.525073 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.525042    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ffd784b5c-tngwm"]
Jul 18 00:44:45.546317 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.546288    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76d6787b48-pnklw"]
Jul 18 00:44:45.556946 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.556920    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.566465 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.566442    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76d6787b48-pnklw"]
Jul 18 00:44:45.578861 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.578818    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:45.673361 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.673278    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:45.691554 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.691509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/032155c6-e219-4674-b4d8-6fa7dace4c84-ca-trust-extracted\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.691725 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.691561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/032155c6-e219-4674-b4d8-6fa7dace4c84-image-registry-private-configuration\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.691725 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.691662    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/032155c6-e219-4674-b4d8-6fa7dace4c84-bound-sa-token\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.691725 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.691720    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmd2d\" (UniqueName: \"kubernetes.io/projected/032155c6-e219-4674-b4d8-6fa7dace4c84-kube-api-access-xmd2d\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.691899 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.691757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/032155c6-e219-4674-b4d8-6fa7dace4c84-registry-certificates\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.691899 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.691785    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/032155c6-e219-4674-b4d8-6fa7dace4c84-trusted-ca\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.691899 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.691817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/032155c6-e219-4674-b4d8-6fa7dace4c84-registry-tls\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.691899 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.691843    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/032155c6-e219-4674-b4d8-6fa7dace4c84-installation-pull-secrets\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.773099 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.773061    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:45.792684 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.792651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/032155c6-e219-4674-b4d8-6fa7dace4c84-bound-sa-token\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.792841 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.792706    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmd2d\" (UniqueName: \"kubernetes.io/projected/032155c6-e219-4674-b4d8-6fa7dace4c84-kube-api-access-xmd2d\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.792841 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.792733    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/032155c6-e219-4674-b4d8-6fa7dace4c84-registry-certificates\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.792841 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.792756    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/032155c6-e219-4674-b4d8-6fa7dace4c84-trusted-ca\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.792841 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.792781    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/032155c6-e219-4674-b4d8-6fa7dace4c84-registry-tls\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.793074 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.792928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/032155c6-e219-4674-b4d8-6fa7dace4c84-installation-pull-secrets\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.793384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.793217    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/032155c6-e219-4674-b4d8-6fa7dace4c84-ca-trust-extracted\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.793384 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.793292    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/032155c6-e219-4674-b4d8-6fa7dace4c84-image-registry-private-configuration\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.793599 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.793553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/032155c6-e219-4674-b4d8-6fa7dace4c84-ca-trust-extracted\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.793773 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.793741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/032155c6-e219-4674-b4d8-6fa7dace4c84-registry-certificates\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.793883 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.793861    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/032155c6-e219-4674-b4d8-6fa7dace4c84-trusted-ca\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.795766 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.795744    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/032155c6-e219-4674-b4d8-6fa7dace4c84-installation-pull-secrets\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.795929 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.795910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/032155c6-e219-4674-b4d8-6fa7dace4c84-registry-tls\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.796007 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.795956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/032155c6-e219-4674-b4d8-6fa7dace4c84-image-registry-private-configuration\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.802719 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.802679    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/032155c6-e219-4674-b4d8-6fa7dace4c84-bound-sa-token\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.802983 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.802956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmd2d\" (UniqueName: \"kubernetes.io/projected/032155c6-e219-4674-b4d8-6fa7dace4c84-kube-api-access-xmd2d\") pod \"image-registry-76d6787b48-pnklw\" (UID: \"032155c6-e219-4674-b4d8-6fa7dace4c84\") " pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.868184 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.868146    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:45.871497 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.871453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:45.971620 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:45.971523    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:46.570241 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:46.570177    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:46.765083 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:46.765047    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:46.901763 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:46.901727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:47.153635 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:47.153608    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76d6787b48-pnklw"]
Jul 18 00:44:47.156799 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:44:47.156775    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032155c6_e219_4674_b4d8_6fa7dace4c84.slice/crio-83f9eeab37ca4415d0244f31871d16b70c86a7862aa89fc2fd5c51c6422d8a13 WatchSource:0}: Error finding container 83f9eeab37ca4415d0244f31871d16b70c86a7862aa89fc2fd5c51c6422d8a13: Status 404 returned error can't find the container with id 83f9eeab37ca4415d0244f31871d16b70c86a7862aa89fc2fd5c51c6422d8a13
Jul 18 00:44:47.184013 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:47.183981    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:47.284400 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:47.284360    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:47.782626 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:47.782588    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v4hrg" event={"ID":"e0192485-c891-436a-8f5a-49d3c5a992a0","Type":"ContainerStarted","Data":"b7f5871b95807d1e2d592c09e541c7c087ffc889025579dd1a1b6f35b7aa2f3c"}
Jul 18 00:44:47.784115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:47.784088    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" event={"ID":"032155c6-e219-4674-b4d8-6fa7dace4c84","Type":"ContainerStarted","Data":"067b8af1d07373ce12c4888a0a6610f927f8ff523a47c24f8ac69895c4390897"}
Jul 18 00:44:47.784241 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:47.784134    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" event={"ID":"032155c6-e219-4674-b4d8-6fa7dace4c84","Type":"ContainerStarted","Data":"83f9eeab37ca4415d0244f31871d16b70c86a7862aa89fc2fd5c51c6422d8a13"}
Jul 18 00:44:47.784309 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:47.784241    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:44:47.802835 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:47.802783    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" podStartSLOduration=2.802764752 podStartE2EDuration="2.802764752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:47.800897983 +0000 UTC m=+261.513009271" watchObservedRunningTime="2026-07-18 00:44:47.802764752 +0000 UTC m=+261.514876037"
Jul 18 00:44:48.933727 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:48.933643    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:49.031054 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:49.031005    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:49.729852 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:49.729817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:49.732510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:49.732484    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17e89550-7ad4-4238-8256-ce6714057522-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xphp9\" (UID: \"17e89550-7ad4-4238-8256-ce6714057522\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:49.893271 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:49.893234    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qlzxk\""
Jul 18 00:44:49.900999 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:49.900973    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"
Jul 18 00:44:50.799801 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:50.799781    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9"]
Jul 18 00:44:50.800875 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:50.800845    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v4hrg" event={"ID":"e0192485-c891-436a-8f5a-49d3c5a992a0","Type":"ContainerStarted","Data":"8a8470e06fa06f1da8a45baa3c92f68cc8eab3d5573ed554e209069beef82203"}
Jul 18 00:44:50.801550 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:44:50.801525    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e89550_7ad4_4238_8256_ce6714057522.slice/crio-287f940ff81e614e9c60cdd7dfa4eeba2b58dffa34d536dabb146d264931ebf8 WatchSource:0}: Error finding container 287f940ff81e614e9c60cdd7dfa4eeba2b58dffa34d536dabb146d264931ebf8: Status 404 returned error can't find the container with id 287f940ff81e614e9c60cdd7dfa4eeba2b58dffa34d536dabb146d264931ebf8
Jul 18 00:44:50.816461 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:50.816411    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v4hrg" podStartSLOduration=17.004062421 podStartE2EDuration="28.816394937s" totalImagesPullingTime="11.812332516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:44:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:50.815636703 +0000 UTC m=+264.527747990" watchObservedRunningTime="2026-07-18 00:44:50.816394937 +0000 UTC m=+264.528506222"
Jul 18 00:44:51.805552 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:51.805517    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9" event={"ID":"17e89550-7ad4-4238-8256-ce6714057522","Type":"ContainerStarted","Data":"287f940ff81e614e9c60cdd7dfa4eeba2b58dffa34d536dabb146d264931ebf8"}
Jul 18 00:44:52.810292 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:52.810258    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9" event={"ID":"17e89550-7ad4-4238-8256-ce6714057522","Type":"ContainerStarted","Data":"a1016d3eb15baad7333c62c7dc4a028b85c940609f4f73dfb3118620cc1d85c8"}
Jul 18 00:44:52.824040 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:52.823355    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xphp9" podStartSLOduration=33.881880508 podStartE2EDuration="35.823333749s" totalImagesPullingTime="1.941453241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:52.822945475 +0000 UTC m=+266.535056760" watchObservedRunningTime="2026-07-18 00:44:52.823333749 +0000 UTC m=+266.535445035"
Jul 18 00:44:53.052010 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:53.051930    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:53.152138 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:53.152102    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:53.237066 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:53.237020    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:53.717535 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:53.717505    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:55.194649 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:55.194610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:55.532011 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:55.531920    2569 patch_prober.go:28] interesting pod/image-registry-7ffd784b5c-tngwm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 00:44:55.532011 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:55.531978    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm" podUID="bf603add-5618-4b9d-bd65-51d4a483d174" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 00:44:57.228138 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:57.228105    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:57.290264 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:57.290216    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:57.625576 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:57.625547    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:57.984611 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:57.984521    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:44:58.035025 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:44:58.034992    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:01.989656 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:01.989623    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:02.045210 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:02.045160    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:05.098211 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:05.098171    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:05.201633 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:05.201600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:05.529782 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:05.529698    2569 patch_prober.go:28] interesting pod/image-registry-7ffd784b5c-tngwm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 00:45:05.529782 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:05.529765    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm" podUID="bf603add-5618-4b9d-bd65-51d4a483d174" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 00:45:05.872909 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:05.872879    2569 patch_prober.go:28] interesting pod/image-registry-76d6787b48-pnklw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 00:45:05.873071 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:05.872927    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" podUID="032155c6-e219-4674-b4d8-6fa7dace4c84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 00:45:07.451382 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:07.451343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:08.479389 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:45:08.479331    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mn6cd" podUID="b5735c71-606c-4433-a5cb-9b4525cb785e"
Jul 18 00:45:08.791718 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:08.791634    2569 patch_prober.go:28] interesting pod/image-registry-76d6787b48-pnklw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 00:45:08.791718 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:08.791679    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" podUID="032155c6-e219-4674-b4d8-6fa7dace4c84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 00:45:08.859542 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:08.859510    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:45:09.356089 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.356056    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:09.570268 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.570216    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:09.631046 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.630968    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8jbmt"]
Jul 18 00:45:09.635607 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.635586    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.638067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.638044    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 00:45:09.638219 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.638119    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 00:45:09.638219 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.638164    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 00:45:09.638219 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.638172    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q86qg\""
Jul 18 00:45:09.638801 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.638787    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 00:45:09.663783 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.663756    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:09.718971 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.718935    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:09.790180 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.790150    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-tls\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.790180 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.790180    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-wtmp\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.790383 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.790216    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-textfile\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.790383 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.790241    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d469a0d-5bc0-49dd-aae2-d858b2459136-sys\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.790383 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.790299    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95h87\" (UniqueName: \"kubernetes.io/projected/3d469a0d-5bc0-49dd-aae2-d858b2459136-kube-api-access-95h87\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.790383 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.790330    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-accelerators-collector-config\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.790383 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.790382    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d469a0d-5bc0-49dd-aae2-d858b2459136-metrics-client-ca\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.790535 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.790426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.790535 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.790447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d469a0d-5bc0-49dd-aae2-d858b2459136-root\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.817005 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.816965    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:09.891395 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d469a0d-5bc0-49dd-aae2-d858b2459136-metrics-client-ca\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891395 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891357    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891584 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891473    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d469a0d-5bc0-49dd-aae2-d858b2459136-root\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891584 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-tls\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891584 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-wtmp\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891731 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891584    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-textfile\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891731 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891589    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d469a0d-5bc0-49dd-aae2-d858b2459136-root\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891731 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891610    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d469a0d-5bc0-49dd-aae2-d858b2459136-sys\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891731 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891642    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95h87\" (UniqueName: \"kubernetes.io/projected/3d469a0d-5bc0-49dd-aae2-d858b2459136-kube-api-access-95h87\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891731 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891670    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-accelerators-collector-config\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891731 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:45:09.891694    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 18 00:45:09.891992 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891737    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-wtmp\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.891992 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:45:09.891783    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-tls podName:3d469a0d-5bc0-49dd-aae2-d858b2459136 nodeName:}" failed. No retries permitted until 2026-07-18 00:45:10.391759727 +0000 UTC m=+284.103870995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-tls") pod "node-exporter-8jbmt" (UID: "3d469a0d-5bc0-49dd-aae2-d858b2459136") : secret "node-exporter-tls" not found
Jul 18 00:45:09.891992 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.891965    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-textfile\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.892107 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.892005    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d469a0d-5bc0-49dd-aae2-d858b2459136-metrics-client-ca\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.892107 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.892098    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d469a0d-5bc0-49dd-aae2-d858b2459136-sys\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.892515 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.892486    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-accelerators-collector-config\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.894408 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.894380    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.901141 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.901121    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95h87\" (UniqueName: \"kubernetes.io/projected/3d469a0d-5bc0-49dd-aae2-d858b2459136-kube-api-access-95h87\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:09.916847 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:09.916822    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:10.017292 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.017264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:10.116440 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.116412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:10.226231 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.226132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:10.319552 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.319518    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:10.396665 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.396634    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-tls\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:10.398870 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.398852    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d469a0d-5bc0-49dd-aae2-d858b2459136-node-exporter-tls\") pod \"node-exporter-8jbmt\" (UID: \"3d469a0d-5bc0-49dd-aae2-d858b2459136\") " pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:10.545074 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.544996    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8jbmt"
Jul 18 00:45:10.549622 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.549592    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm" podUID="bf603add-5618-4b9d-bd65-51d4a483d174" containerName="registry" containerID="cri-o://c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752" gracePeriod=30
Jul 18 00:45:10.560759 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:45:10.560725    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d469a0d_5bc0_49dd_aae2_d858b2459136.slice/crio-6f6d0427e6b90c2cfe5416074a75a54fc9bb6e0ced57f73f9f26ce86608d1280 WatchSource:0}: Error finding container 6f6d0427e6b90c2cfe5416074a75a54fc9bb6e0ced57f73f9f26ce86608d1280: Status 404 returned error can't find the container with id 6f6d0427e6b90c2cfe5416074a75a54fc9bb6e0ced57f73f9f26ce86608d1280
Jul 18 00:45:10.586557 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.586526    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:10.666952 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.666924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:10.790878 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.790856    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:45:10.867550 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.867518    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jbmt" event={"ID":"3d469a0d-5bc0-49dd-aae2-d858b2459136","Type":"ContainerStarted","Data":"6f6d0427e6b90c2cfe5416074a75a54fc9bb6e0ced57f73f9f26ce86608d1280"}
Jul 18 00:45:10.868738 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.868713    2569 generic.go:356] "Generic (PLEG): container finished" podID="bf603add-5618-4b9d-bd65-51d4a483d174" containerID="c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752" exitCode=0
Jul 18 00:45:10.868838 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.868748    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm" event={"ID":"bf603add-5618-4b9d-bd65-51d4a483d174","Type":"ContainerDied","Data":"c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752"}
Jul 18 00:45:10.868838 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.868759    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm"
Jul 18 00:45:10.868838 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.868777    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ffd784b5c-tngwm" event={"ID":"bf603add-5618-4b9d-bd65-51d4a483d174","Type":"ContainerDied","Data":"ccff83f03ea87724036149725ced0af71d06654cbfcdda366cfdf5d6bdb68952"}
Jul 18 00:45:10.868838 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.868797    2569 scope.go:117] "RemoveContainer" containerID="c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752"
Jul 18 00:45:10.876375 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.876353    2569 scope.go:117] "RemoveContainer" containerID="c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752"
Jul 18 00:45:10.876665 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:45:10.876645    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752\": container with ID starting with c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752 not found: ID does not exist" containerID="c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752"
Jul 18 00:45:10.876717 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.876674    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752"} err="failed to get container status \"c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752\": rpc error: code = NotFound desc = could not find container \"c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752\": container with ID starting with c6b818c35f473867e7fb1a19898621167b2219a398d8ba114072bfcff7cb6752 not found: ID does not exist"
Jul 18 00:45:10.901910 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.901885    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-image-registry-private-configuration\") pod \"bf603add-5618-4b9d-bd65-51d4a483d174\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") "
Jul 18 00:45:10.902027 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.901918    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-bound-sa-token\") pod \"bf603add-5618-4b9d-bd65-51d4a483d174\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") "
Jul 18 00:45:10.902027 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.901941    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-installation-pull-secrets\") pod \"bf603add-5618-4b9d-bd65-51d4a483d174\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") "
Jul 18 00:45:10.902027 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.901970    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf603add-5618-4b9d-bd65-51d4a483d174-ca-trust-extracted\") pod \"bf603add-5618-4b9d-bd65-51d4a483d174\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") "
Jul 18 00:45:10.902027 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.902000    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkfv7\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-kube-api-access-lkfv7\") pod \"bf603add-5618-4b9d-bd65-51d4a483d174\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") "
Jul 18 00:45:10.902027 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.902022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") pod \"bf603add-5618-4b9d-bd65-51d4a483d174\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") "
Jul 18 00:45:10.902324 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.902069    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-registry-certificates\") pod \"bf603add-5618-4b9d-bd65-51d4a483d174\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") "
Jul 18 00:45:10.902324 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.902092    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-trusted-ca\") pod \"bf603add-5618-4b9d-bd65-51d4a483d174\" (UID: \"bf603add-5618-4b9d-bd65-51d4a483d174\") "
Jul 18 00:45:10.902594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.902559    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bf603add-5618-4b9d-bd65-51d4a483d174" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:45:10.902927 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.902887    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bf603add-5618-4b9d-bd65-51d4a483d174" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:45:10.904684 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.904656    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-kube-api-access-lkfv7" (OuterVolumeSpecName: "kube-api-access-lkfv7") pod "bf603add-5618-4b9d-bd65-51d4a483d174" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174"). InnerVolumeSpecName "kube-api-access-lkfv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:45:10.904801 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.904680    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bf603add-5618-4b9d-bd65-51d4a483d174" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:45:10.905091 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.905073    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bf603add-5618-4b9d-bd65-51d4a483d174" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:45:10.905988 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.905968    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bf603add-5618-4b9d-bd65-51d4a483d174" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:45:10.906107 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.906082    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bf603add-5618-4b9d-bd65-51d4a483d174" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:45:10.913300 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:10.913178    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf603add-5618-4b9d-bd65-51d4a483d174-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bf603add-5618-4b9d-bd65-51d4a483d174" (UID: "bf603add-5618-4b9d-bd65-51d4a483d174"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 00:45:11.003158 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.003123    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-image-registry-private-configuration\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:45:11.003158 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.003150    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-bound-sa-token\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:45:11.003158 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.003160    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf603add-5618-4b9d-bd65-51d4a483d174-installation-pull-secrets\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:45:11.003387 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.003169    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf603add-5618-4b9d-bd65-51d4a483d174-ca-trust-extracted\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:45:11.003387 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.003178    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkfv7\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-kube-api-access-lkfv7\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:45:11.003387 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.003187    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf603add-5618-4b9d-bd65-51d4a483d174-registry-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:45:11.003387 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.003214    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-registry-certificates\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:45:11.003387 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.003222    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf603add-5618-4b9d-bd65-51d4a483d174-trusted-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:45:11.169059 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.168966    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:11.193015 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.192981    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ffd784b5c-tngwm"]
Jul 18 00:45:11.197910 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.197881    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7ffd784b5c-tngwm"]
Jul 18 00:45:11.267270 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.267239    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:11.597609 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.597588    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"]
Jul 18 00:45:11.597880 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.597824    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf603add-5618-4b9d-bd65-51d4a483d174" containerName="registry"
Jul 18 00:45:11.597880 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.597834    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf603add-5618-4b9d-bd65-51d4a483d174" containerName="registry"
Jul 18 00:45:11.597880 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.597875    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf603add-5618-4b9d-bd65-51d4a483d174" containerName="registry"
Jul 18 00:45:11.602083 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.602067    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.604869 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.604847    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dv73t0pg1ofmq\""
Jul 18 00:45:11.604990 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.604851    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rf256\""
Jul 18 00:45:11.604990 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.604902    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 18 00:45:11.604990 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.604903    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 18 00:45:11.605279 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.605263    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 18 00:45:11.605358 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.605263    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 18 00:45:11.605401 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.605272    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 18 00:45:11.608167 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.608148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-tls\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.608294 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.608213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5bca30c-e637-4d44-ac2d-f77dd9621582-metrics-client-ca\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.608294 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.608272    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86nhw\" (UniqueName: \"kubernetes.io/projected/c5bca30c-e637-4d44-ac2d-f77dd9621582-kube-api-access-86nhw\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.608403 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.608316    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:45:11.608403 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.608349    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.608509 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.608407    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.608509 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.608440    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-grpc-tls\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.608509 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.608478    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.608650 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.608509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.611247 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.611226    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5735c71-606c-4433-a5cb-9b4525cb785e-metrics-tls\") pod \"dns-default-mn6cd\" (UID: \"b5735c71-606c-4433-a5cb-9b4525cb785e\") " pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:45:11.612035 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.612012    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"]
Jul 18 00:45:11.708981 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.708953    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5bca30c-e637-4d44-ac2d-f77dd9621582-metrics-client-ca\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.709157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.708991    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nhw\" (UniqueName: \"kubernetes.io/projected/c5bca30c-e637-4d44-ac2d-f77dd9621582-kube-api-access-86nhw\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.709157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.709012    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.709157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.709051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.709157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.709071    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-grpc-tls\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.709157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.709093    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.709157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.709129    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.709157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.709156    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-tls\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.709854 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.709769    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5bca30c-e637-4d44-ac2d-f77dd9621582-metrics-client-ca\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.712043 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.711997    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.712173 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.712080    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.712310 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.712292    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-tls\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.712369 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.712342    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.712406 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.712342    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.712449 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.712431    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5bca30c-e637-4d44-ac2d-f77dd9621582-secret-grpc-tls\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.716254 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.716229    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86nhw\" (UniqueName: \"kubernetes.io/projected/c5bca30c-e637-4d44-ac2d-f77dd9621582-kube-api-access-86nhw\") pod \"thanos-querier-65d9d66f8b-gf94g\" (UID: \"c5bca30c-e637-4d44-ac2d-f77dd9621582\") " pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:11.862406 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.862375    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45fg4\""
Jul 18 00:45:11.870985 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.870942    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:45:11.874161 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.874140    2569 generic.go:356] "Generic (PLEG): container finished" podID="3d469a0d-5bc0-49dd-aae2-d858b2459136" containerID="a31311806a9445cee75445edc0de360c3e7ff8e0773c149e5c714b413af16103" exitCode=0
Jul 18 00:45:11.874291 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.874186    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jbmt" event={"ID":"3d469a0d-5bc0-49dd-aae2-d858b2459136","Type":"ContainerDied","Data":"a31311806a9445cee75445edc0de360c3e7ff8e0773c149e5c714b413af16103"}
Jul 18 00:45:11.921176 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:11.921119    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:12.012946 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.011705    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mn6cd"]
Jul 18 00:45:12.014867 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:45:12.014395    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5735c71_606c_4433_a5cb_9b4525cb785e.slice/crio-34763e7be2f61e0b6fb25fc29a38f221e33198e72fa7ef137848d21a532b1ac3 WatchSource:0}: Error finding container 34763e7be2f61e0b6fb25fc29a38f221e33198e72fa7ef137848d21a532b1ac3: Status 404 returned error can't find the container with id 34763e7be2f61e0b6fb25fc29a38f221e33198e72fa7ef137848d21a532b1ac3
Jul 18 00:45:12.072816 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.072793    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"]
Jul 18 00:45:12.075179 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:45:12.075144    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5bca30c_e637_4d44_ac2d_f77dd9621582.slice/crio-a7de05045177ad0d4519aae0e686364f7f9b9f2cd9fb0f82027a5ef7a18b22bc WatchSource:0}: Error finding container a7de05045177ad0d4519aae0e686364f7f9b9f2cd9fb0f82027a5ef7a18b22bc: Status 404 returned error can't find the container with id a7de05045177ad0d4519aae0e686364f7f9b9f2cd9fb0f82027a5ef7a18b22bc
Jul 18 00:45:12.263960 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.263867    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:12.365016 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.364977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:12.533848 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.533757    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:12.632689 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.632615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:12.816631 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.816541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:12.832749 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.832472    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf603add-5618-4b9d-bd65-51d4a483d174" path="/var/lib/kubelet/pods/bf603add-5618-4b9d-bd65-51d4a483d174/volumes"
Jul 18 00:45:12.880457 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.880357    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g" event={"ID":"c5bca30c-e637-4d44-ac2d-f77dd9621582","Type":"ContainerStarted","Data":"a7de05045177ad0d4519aae0e686364f7f9b9f2cd9fb0f82027a5ef7a18b22bc"}
Jul 18 00:45:12.881911 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.881871    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mn6cd" event={"ID":"b5735c71-606c-4433-a5cb-9b4525cb785e","Type":"ContainerStarted","Data":"34763e7be2f61e0b6fb25fc29a38f221e33198e72fa7ef137848d21a532b1ac3"}
Jul 18 00:45:12.884651 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.884626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jbmt" event={"ID":"3d469a0d-5bc0-49dd-aae2-d858b2459136","Type":"ContainerStarted","Data":"a273cac7624d5e18d23eece38eb570583b5dc0547880291a1a391a3d01008d38"}
Jul 18 00:45:12.884771 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.884674    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jbmt" event={"ID":"3d469a0d-5bc0-49dd-aae2-d858b2459136","Type":"ContainerStarted","Data":"3b3d890eb3de8befe56d078db4684094d5b2d0bf1934a9af04ac277c5ecf5f0c"}
Jul 18 00:45:12.903164 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.903072    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8jbmt" podStartSLOduration=2.924644095 podStartE2EDuration="3.903052102s" totalImagesPullingTime="914.775405ms" totalInitContainerRuntime="63.632602ms" isStatefulPod=true podCreationTimestamp="2026-07-18 00:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:12.901941849 +0000 UTC m=+286.614053341" watchObservedRunningTime="2026-07-18 00:45:12.903052102 +0000 UTC m=+286.615163388"
Jul 18 00:45:12.906452 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:12.906417    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:13.908122 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.908086    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66f78ffdd5-wnr67"]
Jul 18 00:45:13.911610 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.911590    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:13.914684 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.914638    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 18 00:45:13.914684 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.914669    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 18 00:45:13.914873 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.914765    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 00:45:13.915745 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.915725    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bj5td\""
Jul 18 00:45:13.915745 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.915744    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 18 00:45:13.915895 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.915819    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-afoko8hsv0d4k\""
Jul 18 00:45:13.920962 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.920928    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f78ffdd5-wnr67"]
Jul 18 00:45:13.924295 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.924207    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8a99a7cd-2fd7-40ce-8013-6f537412032d-metrics-server-audit-profiles\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:13.924295 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.924252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a99a7cd-2fd7-40ce-8013-6f537412032d-client-ca-bundle\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:13.924461 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.924333    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8a99a7cd-2fd7-40ce-8013-6f537412032d-audit-log\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:13.924461 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.924401    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lprdm\" (UniqueName: \"kubernetes.io/projected/8a99a7cd-2fd7-40ce-8013-6f537412032d-kube-api-access-lprdm\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:13.924461 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.924438    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8a99a7cd-2fd7-40ce-8013-6f537412032d-secret-metrics-server-client-certs\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:13.924622 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.924490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8a99a7cd-2fd7-40ce-8013-6f537412032d-secret-metrics-server-tls\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:13.924622 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:13.924590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a99a7cd-2fd7-40ce-8013-6f537412032d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.025352 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.025314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8a99a7cd-2fd7-40ce-8013-6f537412032d-secret-metrics-server-client-certs\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.025543 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.025435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8a99a7cd-2fd7-40ce-8013-6f537412032d-secret-metrics-server-tls\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.025543 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.025485    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a99a7cd-2fd7-40ce-8013-6f537412032d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.025543 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.025522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8a99a7cd-2fd7-40ce-8013-6f537412032d-metrics-server-audit-profiles\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.025709 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.025549    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a99a7cd-2fd7-40ce-8013-6f537412032d-client-ca-bundle\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.025709 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.025576    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8a99a7cd-2fd7-40ce-8013-6f537412032d-audit-log\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.025709 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.025612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lprdm\" (UniqueName: \"kubernetes.io/projected/8a99a7cd-2fd7-40ce-8013-6f537412032d-kube-api-access-lprdm\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.026287 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.026247    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8a99a7cd-2fd7-40ce-8013-6f537412032d-audit-log\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.026857 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.026809    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8a99a7cd-2fd7-40ce-8013-6f537412032d-metrics-server-audit-profiles\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.026958 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.026943    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a99a7cd-2fd7-40ce-8013-6f537412032d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.028464 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.028442    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8a99a7cd-2fd7-40ce-8013-6f537412032d-secret-metrics-server-client-certs\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.028780 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.028760    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a99a7cd-2fd7-40ce-8013-6f537412032d-client-ca-bundle\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.028959 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.028943    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8a99a7cd-2fd7-40ce-8013-6f537412032d-secret-metrics-server-tls\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.032983 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.032947    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lprdm\" (UniqueName: \"kubernetes.io/projected/8a99a7cd-2fd7-40ce-8013-6f537412032d-kube-api-access-lprdm\") pod \"metrics-server-66f78ffdd5-wnr67\" (UID: \"8a99a7cd-2fd7-40ce-8013-6f537412032d\") " pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.223115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.223044    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:14.397966 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.396543    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"]
Jul 18 00:45:14.400018 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.397825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:14.403727 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.403709    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:14.406470 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.406406    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 18 00:45:14.407149 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.407114    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gs9zc\""
Jul 18 00:45:14.407797 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.407777    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"]
Jul 18 00:45:14.424882 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.424853    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f78ffdd5-wnr67"]
Jul 18 00:45:14.426437 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:45:14.426411    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a99a7cd_2fd7_40ce_8013_6f537412032d.slice/crio-48bde868da42f44904535488e13220b53692b6a5db2576a29deaa6ffdfc25a8d WatchSource:0}: Error finding container 48bde868da42f44904535488e13220b53692b6a5db2576a29deaa6ffdfc25a8d: Status 404 returned error can't find the container with id 48bde868da42f44904535488e13220b53692b6a5db2576a29deaa6ffdfc25a8d
Jul 18 00:45:14.428504 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.428482    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgqmr\" (UniqueName: \"kubernetes.io/projected/331451d1-2832-4f76-b12d-91886eee8593-kube-api-access-mgqmr\") pod \"monitoring-plugin-7b7b7bc8bf-dqq5r\" (UID: \"331451d1-2832-4f76-b12d-91886eee8593\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:14.428583 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.428529    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/331451d1-2832-4f76-b12d-91886eee8593-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dqq5r\" (UID: \"331451d1-2832-4f76-b12d-91886eee8593\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:14.474385 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.474269    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:14.529032 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.528998    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgqmr\" (UniqueName: \"kubernetes.io/projected/331451d1-2832-4f76-b12d-91886eee8593-kube-api-access-mgqmr\") pod \"monitoring-plugin-7b7b7bc8bf-dqq5r\" (UID: \"331451d1-2832-4f76-b12d-91886eee8593\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:14.529173 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.529056    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/331451d1-2832-4f76-b12d-91886eee8593-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dqq5r\" (UID: \"331451d1-2832-4f76-b12d-91886eee8593\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:14.529270 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:45:14.529234    2569 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 18 00:45:14.529476 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:45:14.529307    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331451d1-2832-4f76-b12d-91886eee8593-monitoring-plugin-cert podName:331451d1-2832-4f76-b12d-91886eee8593 nodeName:}" failed. No retries permitted until 2026-07-18 00:45:15.029285435 +0000 UTC m=+288.741396701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/331451d1-2832-4f76-b12d-91886eee8593-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-dqq5r" (UID: "331451d1-2832-4f76-b12d-91886eee8593") : secret "monitoring-plugin-cert" not found
Jul 18 00:45:14.538343 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.538322    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgqmr\" (UniqueName: \"kubernetes.io/projected/331451d1-2832-4f76-b12d-91886eee8593-kube-api-access-mgqmr\") pod \"monitoring-plugin-7b7b7bc8bf-dqq5r\" (UID: \"331451d1-2832-4f76-b12d-91886eee8593\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:14.608657 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.608619    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:14.790219 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.790135    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"]
Jul 18 00:45:14.793290 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.793273    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.795819 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.795742    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 18 00:45:14.795957 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.795834    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rhmfw\""
Jul 18 00:45:14.795957 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.795789    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 18 00:45:14.796079 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.795951    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 18 00:45:14.796233 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.796213    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 18 00:45:14.796303 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.796225    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 18 00:45:14.801506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.801479    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 18 00:45:14.805051 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.805029    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"]
Jul 18 00:45:14.831647 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.831620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-secret-telemeter-client\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.831647 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.831656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.831869 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.831690    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-federate-client-tls\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.831869 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.831716    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sdxq\" (UniqueName: \"kubernetes.io/projected/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-kube-api-access-5sdxq\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.831869 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.831766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-telemeter-client-tls\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.832007 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.831873    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-serving-certs-ca-bundle\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.832007 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.831905    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-metrics-client-ca\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.832007 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.831931    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.895766 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.895700    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67" event={"ID":"8a99a7cd-2fd7-40ce-8013-6f537412032d","Type":"ContainerStarted","Data":"48bde868da42f44904535488e13220b53692b6a5db2576a29deaa6ffdfc25a8d"}
Jul 18 00:45:14.898253 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.898217    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g" event={"ID":"c5bca30c-e637-4d44-ac2d-f77dd9621582","Type":"ContainerStarted","Data":"a6d83f37dfbaae9ad158bcd7d984c3bc892af8dce94fb7b80a3b8db861912de3"}
Jul 18 00:45:14.898415 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.898306    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g" event={"ID":"c5bca30c-e637-4d44-ac2d-f77dd9621582","Type":"ContainerStarted","Data":"88b6b3e6437218cc53f07029fb9dd2d72b57b957bcb144f4043c3056c9bb78d6"}
Jul 18 00:45:14.898415 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.898344    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g" event={"ID":"c5bca30c-e637-4d44-ac2d-f77dd9621582","Type":"ContainerStarted","Data":"1dddfd5dfd637351dc080ae5804f3e4415325f543b922ee15306e7f037688f4e"}
Jul 18 00:45:14.900145 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.900114    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mn6cd" event={"ID":"b5735c71-606c-4433-a5cb-9b4525cb785e","Type":"ContainerStarted","Data":"ed14a332f3daedff0fb9eeaf131f82760ba86b7fff64f51bb23641dceda6e797"}
Jul 18 00:45:14.900300 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.900169    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mn6cd" event={"ID":"b5735c71-606c-4433-a5cb-9b4525cb785e","Type":"ContainerStarted","Data":"4b7ac94abb2ae42f98a793815620ef6809bce40f318c21ffa0383f0c0349e07f"}
Jul 18 00:45:14.900364 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.900329    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:45:14.916634 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.916527    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mn6cd" podStartSLOduration=251.660819639 podStartE2EDuration="4m13.916509611s" totalImagesPullingTime="2.255689972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:14.915110082 +0000 UTC m=+288.627221359" watchObservedRunningTime="2026-07-18 00:45:14.916509611 +0000 UTC m=+288.628620895"
Jul 18 00:45:14.932570 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.932536    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-serving-certs-ca-bundle\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.932724 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.932588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-metrics-client-ca\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.932724 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.932617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.932724 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.932674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-secret-telemeter-client\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.932724 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.932699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.932938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.932735    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-federate-client-tls\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.932938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.932759    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sdxq\" (UniqueName: \"kubernetes.io/projected/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-kube-api-access-5sdxq\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.932938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.932813    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-telemeter-client-tls\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.933943 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.933856    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-serving-certs-ca-bundle\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.935545 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.934816    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.935545 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.935018    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-metrics-client-ca\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.938030 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.937959    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-federate-client-tls\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.938030 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.937990    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.938690 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.938651    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-telemeter-client-tls\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.939374 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.939347    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-secret-telemeter-client\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:14.942846 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:14.942805    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sdxq\" (UniqueName: \"kubernetes.io/projected/b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af-kube-api-access-5sdxq\") pod \"telemeter-client-5dbb8c979b-jh4c5\" (UID: \"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af\") " pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:15.034513 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.034428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/331451d1-2832-4f76-b12d-91886eee8593-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dqq5r\" (UID: \"331451d1-2832-4f76-b12d-91886eee8593\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:15.037832 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.037803    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/331451d1-2832-4f76-b12d-91886eee8593-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dqq5r\" (UID: \"331451d1-2832-4f76-b12d-91886eee8593\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:15.105832 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.105795    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"
Jul 18 00:45:15.326612 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.326558    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:15.342335 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.342292    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5"]
Jul 18 00:45:15.620020 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:45:15.619985    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63bf9fc_ab9e_4fd4_94b8_ccc9895fb2af.slice/crio-c7c97b80d61bcccd866d5e4ce5308f72379f2cc6472bf9edf8fce0b4e19e5933 WatchSource:0}: Error finding container c7c97b80d61bcccd866d5e4ce5308f72379f2cc6472bf9edf8fce0b4e19e5933: Status 404 returned error can't find the container with id c7c97b80d61bcccd866d5e4ce5308f72379f2cc6472bf9edf8fce0b4e19e5933
Jul 18 00:45:15.759553 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.759523    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"]
Jul 18 00:45:15.768049 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:45:15.768007    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331451d1_2832_4f76_b12d_91886eee8593.slice/crio-16cf2404cfd823cf1e997d6b9521ccf17651e7d13384bdd1a36854cec545327f WatchSource:0}: Error finding container 16cf2404cfd823cf1e997d6b9521ccf17651e7d13384bdd1a36854cec545327f: Status 404 returned error can't find the container with id 16cf2404cfd823cf1e997d6b9521ccf17651e7d13384bdd1a36854cec545327f
Jul 18 00:45:15.791878 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.791856    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:45:15.796528 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.796475    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:15.796669 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.796648    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.799446 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.799079    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 00:45:15.799446 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.799133    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 00:45:15.799446 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.799229    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 00:45:15.799446 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.799365    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 00:45:15.799796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.799602    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 00:45:15.799796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.799622    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m59w8\""
Jul 18 00:45:15.799796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.799674    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 00:45:15.799796 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.799626    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 00:45:15.800000 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.799867    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 00:45:15.800123 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.800052    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2hl6ufr1e73d5\""
Jul 18 00:45:15.800678 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.800661    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 00:45:15.800878 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.800672    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 00:45:15.800985 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.800857    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 00:45:15.800985 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.800738    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 00:45:15.801094 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.801045    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 00:45:15.803157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.803140    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 00:45:15.811477 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.811409    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:45:15.842374 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842334    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842505 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842505 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842624 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842483    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842624 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842548    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842734 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842734 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842687    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842734 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-config\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842874 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842874 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842799    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842874 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842823    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.842874 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842861    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-web-config\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.843043 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842896    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.843043 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.842941    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-config-out\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.843043 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.843008    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.843043 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.843034    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.843188 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.843085    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.843188 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.843105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.843188 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.843146    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgnlm\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-kube-api-access-pgnlm\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.843188 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.843172    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.873808 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.873730    2569 patch_prober.go:28] interesting pod/image-registry-76d6787b48-pnklw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 00:45:15.873808 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.873782    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" podUID="032155c6-e219-4674-b4d8-6fa7dace4c84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 00:45:15.905640 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.905601    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67" event={"ID":"8a99a7cd-2fd7-40ce-8013-6f537412032d","Type":"ContainerStarted","Data":"a8b470380f6eead72347632c96da3a6682d2af33f24be928d203961d85954454"}
Jul 18 00:45:15.906968 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.906933    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5" event={"ID":"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af","Type":"ContainerStarted","Data":"c7c97b80d61bcccd866d5e4ce5308f72379f2cc6472bf9edf8fce0b4e19e5933"}
Jul 18 00:45:15.910223 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.910177    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g" event={"ID":"c5bca30c-e637-4d44-ac2d-f77dd9621582","Type":"ContainerStarted","Data":"ee032b66485d598506ba3a3619788b858e92e220ea05c237cedd3354696c29ae"}
Jul 18 00:45:15.910351 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.910272    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g" event={"ID":"c5bca30c-e637-4d44-ac2d-f77dd9621582","Type":"ContainerStarted","Data":"ca95e553d924987dea7befeef1d4d8ca75c540ff7f15b113c44d8b98463cb925"}
Jul 18 00:45:15.910351 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.910315    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g" event={"ID":"c5bca30c-e637-4d44-ac2d-f77dd9621582","Type":"ContainerStarted","Data":"0d84b2d7bacc93c7f8b26a18b7db03edef6194665fe73e77060cf5a02cea5d9e"}
Jul 18 00:45:15.910494 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.910364    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:15.911388 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.911369    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r" event={"ID":"331451d1-2832-4f76-b12d-91886eee8593","Type":"ContainerStarted","Data":"16cf2404cfd823cf1e997d6b9521ccf17651e7d13384bdd1a36854cec545327f"}
Jul 18 00:45:15.921404 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.921358    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67" podStartSLOduration=1.680234113 podStartE2EDuration="2.921339987s" totalImagesPullingTime="1.241105874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:15.920430323 +0000 UTC m=+289.632541603" watchObservedRunningTime="2026-07-18 00:45:15.921339987 +0000 UTC m=+289.633451273"
Jul 18 00:45:15.941998 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.941958    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g" podStartSLOduration=1.617725947 podStartE2EDuration="4.941945419s" totalImagesPullingTime="3.324219472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:15.940983319 +0000 UTC m=+289.653094628" watchObservedRunningTime="2026-07-18 00:45:15.941945419 +0000 UTC m=+289.654056704"
Jul 18 00:45:15.944170 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.944146    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.944294 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.944208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.944431 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.944389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgnlm\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-kube-api-access-pgnlm\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.944506    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.944558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.944624    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.944672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.944699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:45:15.944742    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-trusted-ca-bundle podName:37fec155-27b0-4877-a32d-1b5bb2928150 nodeName:}" failed. No retries permitted until 2026-07-18 00:45:16.444722151 +0000 UTC m=+290.156833426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150") : configmap references non-existent config key: ca-bundle.crt
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.944966    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945152    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945188    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945284    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945387    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-config\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.945825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945571    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.946777 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-web-config\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.946777 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.945609    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.946777 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.946106    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.946777 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.946156    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-config-out\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.946777 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.946268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.946777 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.946293    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.947257 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.947231    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.947982 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.947952    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.948071 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.948054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.949068 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.949040    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.949158 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.949129    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.950333 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.950304    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.950433 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.950311    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-config\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.950433 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.950355    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.950669 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.950649    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-web-config\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.950822 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.950658    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.950878 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.950836    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-config-out\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.951378 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.951359    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.951761 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.951734    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.952132 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.952112    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:15.953898 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:15.953881    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgnlm\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-kube-api-access-pgnlm\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:16.452379 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:16.452133    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:16.453296 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:16.453210    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:16.711869 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:16.711786    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:16.885370 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:16.885239    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:45:16.888476 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:45:16.888158    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37fec155_27b0_4877_a32d_1b5bb2928150.slice/crio-3ce9b18ce5c6a13ff7d18d77e0070d4c424cfcc3ae78360234c8712a03bd5faf WatchSource:0}: Error finding container 3ce9b18ce5c6a13ff7d18d77e0070d4c424cfcc3ae78360234c8712a03bd5faf: Status 404 returned error can't find the container with id 3ce9b18ce5c6a13ff7d18d77e0070d4c424cfcc3ae78360234c8712a03bd5faf
Jul 18 00:45:16.918738 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:16.918699    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerStarted","Data":"3ce9b18ce5c6a13ff7d18d77e0070d4c424cfcc3ae78360234c8712a03bd5faf"}
Jul 18 00:45:18.792071 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:18.792031    2569 patch_prober.go:28] interesting pod/image-registry-76d6787b48-pnklw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 00:45:18.792458 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:18.792081    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" podUID="032155c6-e219-4674-b4d8-6fa7dace4c84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 00:45:18.927527 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:18.927483    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5" event={"ID":"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af","Type":"ContainerStarted","Data":"7e85cdc576c13a8e3ff696d9717d1eac5ec2a5140587df8c8727363ddd13d01b"}
Jul 18 00:45:18.928877 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:18.928847    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r" event={"ID":"331451d1-2832-4f76-b12d-91886eee8593","Type":"ContainerStarted","Data":"dbdcd1fe94e4c217b8d56e5b728d63bc6405b8aeb5339da55602ffa06d657958"}
Jul 18 00:45:18.929136 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:18.929116    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:18.934363 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:18.934335    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r"
Jul 18 00:45:18.945348 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:18.945297    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dqq5r" podStartSLOduration=2.493877628 podStartE2EDuration="4.945279763s" totalImagesPullingTime="2.451402135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:18.944926817 +0000 UTC m=+292.657038101" watchObservedRunningTime="2026-07-18 00:45:18.945279763 +0000 UTC m=+292.657391050"
Jul 18 00:45:19.934521 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:19.934483    2569 generic.go:356] "Generic (PLEG): container finished" podID="37fec155-27b0-4877-a32d-1b5bb2928150" containerID="a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd" exitCode=0
Jul 18 00:45:19.934972 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:19.934569    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerDied","Data":"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"}
Jul 18 00:45:19.936705 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:19.936688    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5" event={"ID":"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af","Type":"ContainerStarted","Data":"3ed6c0f813173579ac0e5dc16f1d9d07dfd07fcd1ac16b2874087e3d0be48d5d"}
Jul 18 00:45:19.936775 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:19.936733    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5" event={"ID":"b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af","Type":"ContainerStarted","Data":"7a0009bc7613288f0650e6efa0d2c1b581371d709eb5514511a13cb63678df04"}
Jul 18 00:45:20.010063 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:20.010012    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5dbb8c979b-jh4c5" podStartSLOduration=2.6225387959999997 podStartE2EDuration="6.009998518s" totalImagesPullingTime="3.387459722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:20.00954686 +0000 UTC m=+293.721658144" watchObservedRunningTime="2026-07-18 00:45:20.009998518 +0000 UTC m=+293.722109802"
Jul 18 00:45:21.925454 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:21.925419    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-65d9d66f8b-gf94g"
Jul 18 00:45:22.003255 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:22.003115    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:23.957060 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:23.957023    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerStarted","Data":"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"}
Jul 18 00:45:23.957565 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:23.957130    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerStarted","Data":"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"}
Jul 18 00:45:23.957565 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:23.957180    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerStarted","Data":"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"}
Jul 18 00:45:23.957565 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:23.957243    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerStarted","Data":"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"}
Jul 18 00:45:23.957565 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:23.957287    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerStarted","Data":"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"}
Jul 18 00:45:23.957565 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:23.957327    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerStarted","Data":"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"}
Jul 18 00:45:23.984990 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:23.984921    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.416469061 podStartE2EDuration="8.984899731s" totalImagesPullingTime="5.549353578s" totalInitContainerRuntime="19.077092ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:23.982629029 +0000 UTC m=+297.694740346" watchObservedRunningTime="2026-07-18 00:45:23.984899731 +0000 UTC m=+297.697011020"
Jul 18 00:45:24.913337 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:24.913306    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mn6cd"
Jul 18 00:45:25.874271 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:25.874220    2569 patch_prober.go:28] interesting pod/image-registry-76d6787b48-pnklw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 00:45:25.874616 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:25.874305    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" podUID="032155c6-e219-4674-b4d8-6fa7dace4c84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 00:45:25.874616 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:25.874345    2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:45:25.874790 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:25.874771    2569 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"067b8af1d07373ce12c4888a0a6610f927f8ff523a47c24f8ac69895c4390897"} pod="openshift-image-registry/image-registry-76d6787b48-pnklw" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 18 00:45:25.878390 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:25.878362    2569 patch_prober.go:28] interesting pod/image-registry-76d6787b48-pnklw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 00:45:25.878493 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:25.878400    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" podUID="032155c6-e219-4674-b4d8-6fa7dace4c84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 00:45:26.461942 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:26.461910    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:26.627302 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:26.627275    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:45:26.628129 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:26.628104    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:45:26.630284 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:26.630269    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 00:45:26.712699 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:26.712641    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:27.517636 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:27.517603    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:27.573628 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:27.573599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:29.206621 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:29.206580    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:29.259036 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:29.259002    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:31.192076 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:31.192042    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:31.292682 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:31.292640    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:31.343011 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:31.342979    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:31.619385 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:31.619351    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:31.720401 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:31.720368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:33.092437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:33.092405    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:33.142357 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:33.142322    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:34.223392 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:34.223340    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:34.223877 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:34.223421    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:35.879427 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:35.879394    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:45:35.989866 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:35.989830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:36.090380 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:36.090342    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:36.858001 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:36.857963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:38.357064 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:38.357030    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75cf4cd9bb-ggh9t_d69ca821-3563-43fb-95c7-619da8186293/router/0.log"
Jul 18 00:45:38.377942 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:38.377914    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scwzp_ee41e07e-3fd4-42f2-a833-d003f921be2c/serve-healthcheck-canary/0.log"
Jul 18 00:45:39.109987 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:39.109949    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:39.279632 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:39.279594    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:44.368404 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:44.368359    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:44.469211 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:44.469168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:47.044208 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:47.044167    2569 generic.go:356] "Generic (PLEG): container finished" podID="b776b90d-c30a-4e86-8e28-451f2ce302d8" containerID="134d7f47b331e5627096cafb3bbf687672d701ca5a549b7133a24a173f42343a" exitCode=0
Jul 18 00:45:47.044614 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:47.044242    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk" event={"ID":"b776b90d-c30a-4e86-8e28-451f2ce302d8","Type":"ContainerDied","Data":"134d7f47b331e5627096cafb3bbf687672d701ca5a549b7133a24a173f42343a"}
Jul 18 00:45:47.044614 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:47.044574    2569 scope.go:117] "RemoveContainer" containerID="134d7f47b331e5627096cafb3bbf687672d701ca5a549b7133a24a173f42343a"
Jul 18 00:45:48.049513 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:48.049482    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-dpctk" event={"ID":"b776b90d-c30a-4e86-8e28-451f2ce302d8","Type":"ContainerStarted","Data":"4effbd22c0ac88acc0ff98ba39398792648313531f8420ed38de6b27727b193f"}
Jul 18 00:45:48.179704 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:48.179672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:48.280697 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:48.280665    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:49.207300 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:49.207265    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:49.259601 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:49.259555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:50.894516 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:50.894475    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" podUID="032155c6-e219-4674-b4d8-6fa7dace4c84" containerName="registry" containerID="cri-o://067b8af1d07373ce12c4888a0a6610f927f8ff523a47c24f8ac69895c4390897" gracePeriod=30
Jul 18 00:45:52.074531 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:52.074409    2569 generic.go:356] "Generic (PLEG): container finished" podID="032155c6-e219-4674-b4d8-6fa7dace4c84" containerID="067b8af1d07373ce12c4888a0a6610f927f8ff523a47c24f8ac69895c4390897" exitCode=0
Jul 18 00:45:52.074531 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:52.074463    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" event={"ID":"032155c6-e219-4674-b4d8-6fa7dace4c84","Type":"ContainerDied","Data":"067b8af1d07373ce12c4888a0a6610f927f8ff523a47c24f8ac69895c4390897"}
Jul 18 00:45:53.080105 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:53.080072    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d6787b48-pnklw" event={"ID":"032155c6-e219-4674-b4d8-6fa7dace4c84","Type":"ContainerStarted","Data":"69b8bccb97747b3749f5f1437b99a506f44b88547b0d07824c26014b7d811707"}
Jul 18 00:45:53.080500 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:53.080221    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:45:53.248585 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:53.248550    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:53.300595 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:53.300564    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:45:54.228786 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:54.228754    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:45:54.235172 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:45:54.235149    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66f78ffdd5-wnr67"
Jul 18 00:46:05.761108 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:05.761064    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:05.860713 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:05.860678    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:05.910789 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:05.910751    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:14.087971 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:14.087942    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76d6787b48-pnklw"
Jul 18 00:46:14.359977 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:14.359938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:14.412949 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:14.412910    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:16.712722 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:16.712683    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:16.728575 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:16.728543    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:17.185259 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:17.185230    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:25.665547 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:25.665460    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:25.727848 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:25.727798    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:30.453347 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:30.453301    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:30.504401 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:30.504368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:30.856736 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:30.856700    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:30.910919 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:30.910880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:34.157496 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.157462    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:46:34.157885 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.157732    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="prometheus" containerID="cri-o://ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3" gracePeriod=600
Jul 18 00:46:34.157885 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.157788    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy-web" containerID="cri-o://3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8" gracePeriod=600
Jul 18 00:46:34.157885 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.157807    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3" gracePeriod=600
Jul 18 00:46:34.157885 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.157827    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="config-reloader" containerID="cri-o://b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4" gracePeriod=600
Jul 18 00:46:34.157885 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.157790    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="thanos-sidecar" containerID="cri-o://1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e" gracePeriod=600
Jul 18 00:46:34.157885 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.157766    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy" containerID="cri-o://942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee" gracePeriod=600
Jul 18 00:46:34.391095 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.391062    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:34.540226 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540101    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-trusted-ca-bundle\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540226 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540161    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-config-out\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540226 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540186    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-metrics-client-ca\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540243    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-thanos-prometheus-http-client-file\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540294    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgnlm\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-kube-api-access-pgnlm\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540321    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-db\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540353    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540382    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-grpc-tls\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540406    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-web-config\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540436    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540461    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-2\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540490    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-config\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540517    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-kube-rbac-proxy\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540551    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-metrics-client-certs\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540598    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-serving-certs-ca-bundle\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540611    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540624    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-kubelet-serving-ca-bundle\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540672    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540689    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-1\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540719    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-0\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540747    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-tls-assets\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.540938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540784    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-tls\") pod \"37fec155-27b0-4877-a32d-1b5bb2928150\" (UID: \"37fec155-27b0-4877-a32d-1b5bb2928150\") "
Jul 18 00:46:34.541515 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.540947    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:46:34.541515 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.541098    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.541515 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.541116    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.541515 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.541130    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-metrics-client-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.541515 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.541408    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:46:34.541782 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.541760    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 00:46:34.543148 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.543116    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:46:34.543319 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.543168    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:46:34.543319 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.543218    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-kube-api-access-pgnlm" (OuterVolumeSpecName: "kube-api-access-pgnlm") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "kube-api-access-pgnlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:46:34.543319 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.543230    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:46:34.543472 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.543407    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-config-out" (OuterVolumeSpecName: "config-out") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 00:46:34.543861 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.543724    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:46:34.544477 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.544256    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:46:34.544477 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.544325    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:46:34.544786 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.544755    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:46:34.545475 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.545449    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:46:34.545475 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.545460    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:46:34.545625 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.545478    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-config" (OuterVolumeSpecName: "config") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:46:34.545625 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.545606    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:46:34.545984 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.545969    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:46:34.554506 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.554482    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-web-config" (OuterVolumeSpecName: "web-config") pod "37fec155-27b0-4877-a32d-1b5bb2928150" (UID: "37fec155-27b0-4877-a32d-1b5bb2928150"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:46:34.642351 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642307    2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642351 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642345    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgnlm\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-kube-api-access-pgnlm\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642351 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642356    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-db\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642351 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642366    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642375    2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-grpc-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642384    2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-web-config\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642391    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642399    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642408    2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-config\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642416    2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-kube-rbac-proxy\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642424    2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-metrics-client-certs\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642434    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642442    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642450    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37fec155-27b0-4877-a32d-1b5bb2928150-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642458    2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37fec155-27b0-4877-a32d-1b5bb2928150-tls-assets\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642466    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37fec155-27b0-4877-a32d-1b5bb2928150-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:34.642586 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:34.642473    2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37fec155-27b0-4877-a32d-1b5bb2928150-config-out\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:46:35.248234 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248177    2569 generic.go:356] "Generic (PLEG): container finished" podID="37fec155-27b0-4877-a32d-1b5bb2928150" containerID="e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3" exitCode=0
Jul 18 00:46:35.248234 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248231    2569 generic.go:356] "Generic (PLEG): container finished" podID="37fec155-27b0-4877-a32d-1b5bb2928150" containerID="942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee" exitCode=0
Jul 18 00:46:35.248234 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248227    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerDied","Data":"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"}
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248276    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248242    2569 generic.go:356] "Generic (PLEG): container finished" podID="37fec155-27b0-4877-a32d-1b5bb2928150" containerID="3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8" exitCode=0
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248323    2569 generic.go:356] "Generic (PLEG): container finished" podID="37fec155-27b0-4877-a32d-1b5bb2928150" containerID="1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e" exitCode=0
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248328    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerDied","Data":"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"}
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248333    2569 generic.go:356] "Generic (PLEG): container finished" podID="37fec155-27b0-4877-a32d-1b5bb2928150" containerID="b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4" exitCode=0
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248339    2569 generic.go:356] "Generic (PLEG): container finished" podID="37fec155-27b0-4877-a32d-1b5bb2928150" containerID="ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3" exitCode=0
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248360    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerDied","Data":"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"}
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248390    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerDied","Data":"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"}
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248397    2569 scope.go:117] "RemoveContainer" containerID="e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248415    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerDied","Data":"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"}
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248443    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerDied","Data":"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"}
Jul 18 00:46:35.248702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.248469    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37fec155-27b0-4877-a32d-1b5bb2928150","Type":"ContainerDied","Data":"3ce9b18ce5c6a13ff7d18d77e0070d4c424cfcc3ae78360234c8712a03bd5faf"}
Jul 18 00:46:35.256366 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.256347    2569 scope.go:117] "RemoveContainer" containerID="942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"
Jul 18 00:46:35.265253 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.265214    2569 scope.go:117] "RemoveContainer" containerID="3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"
Jul 18 00:46:35.271127 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.271103    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:46:35.273662 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.273639    2569 scope.go:117] "RemoveContainer" containerID="1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"
Jul 18 00:46:35.274938 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.274921    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:46:35.280866 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.280847    2569 scope.go:117] "RemoveContainer" containerID="b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"
Jul 18 00:46:35.287596 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.287578    2569 scope.go:117] "RemoveContainer" containerID="ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"
Jul 18 00:46:35.294481 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.294465    2569 scope.go:117] "RemoveContainer" containerID="a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"
Jul 18 00:46:35.299166 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299142    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:46:35.299466 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299450    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="prometheus"
Jul 18 00:46:35.299466 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299465    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="prometheus"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299476    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="thanos-sidecar"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299482    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="thanos-sidecar"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299489    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299495    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299508    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="config-reloader"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299514    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="config-reloader"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299523    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy-web"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299528    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy-web"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299535    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="init-config-reloader"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299540    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="init-config-reloader"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299548    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy-thanos"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299554    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy-thanos"
Jul 18 00:46:35.299594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299594    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy-web"
Jul 18 00:46:35.300360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299605    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy-thanos"
Jul 18 00:46:35.300360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299611    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="config-reloader"
Jul 18 00:46:35.300360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299616    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="kube-rbac-proxy"
Jul 18 00:46:35.300360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299622    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="prometheus"
Jul 18 00:46:35.300360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.299627    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" containerName="thanos-sidecar"
Jul 18 00:46:35.301880 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.301865    2569 scope.go:117] "RemoveContainer" containerID="e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"
Jul 18 00:46:35.302120 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:46:35.302104    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": container with ID starting with e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3 not found: ID does not exist" containerID="e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"
Jul 18 00:46:35.302166 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.302128    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"} err="failed to get container status \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": rpc error: code = NotFound desc = could not find container \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": container with ID starting with e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3 not found: ID does not exist"
Jul 18 00:46:35.302166 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.302143    2569 scope.go:117] "RemoveContainer" containerID="942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"
Jul 18 00:46:35.302401 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:46:35.302383    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": container with ID starting with 942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee not found: ID does not exist" containerID="942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"
Jul 18 00:46:35.302469 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.302409    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"} err="failed to get container status \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": rpc error: code = NotFound desc = could not find container \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": container with ID starting with 942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee not found: ID does not exist"
Jul 18 00:46:35.302469 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.302430    2569 scope.go:117] "RemoveContainer" containerID="3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"
Jul 18 00:46:35.302678 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:46:35.302661    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": container with ID starting with 3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8 not found: ID does not exist" containerID="3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"
Jul 18 00:46:35.302711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.302683    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"} err="failed to get container status \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": rpc error: code = NotFound desc = could not find container \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": container with ID starting with 3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8 not found: ID does not exist"
Jul 18 00:46:35.302711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.302699    2569 scope.go:117] "RemoveContainer" containerID="1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"
Jul 18 00:46:35.302914 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:46:35.302894    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": container with ID starting with 1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e not found: ID does not exist" containerID="1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"
Jul 18 00:46:35.302955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.302918    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"} err="failed to get container status \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": rpc error: code = NotFound desc = could not find container \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": container with ID starting with 1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e not found: ID does not exist"
Jul 18 00:46:35.302955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.302932    2569 scope.go:117] "RemoveContainer" containerID="b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"
Jul 18 00:46:35.303152 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:46:35.303136    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": container with ID starting with b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4 not found: ID does not exist" containerID="b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"
Jul 18 00:46:35.303290 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.303155    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"} err="failed to get container status \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": rpc error: code = NotFound desc = could not find container \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": container with ID starting with b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4 not found: ID does not exist"
Jul 18 00:46:35.303290 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.303168    2569 scope.go:117] "RemoveContainer" containerID="ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"
Jul 18 00:46:35.303429 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:46:35.303413    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": container with ID starting with ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3 not found: ID does not exist" containerID="ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"
Jul 18 00:46:35.303481 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.303433    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"} err="failed to get container status \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": rpc error: code = NotFound desc = could not find container \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": container with ID starting with ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3 not found: ID does not exist"
Jul 18 00:46:35.303481 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.303446    2569 scope.go:117] "RemoveContainer" containerID="a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"
Jul 18 00:46:35.303657 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:46:35.303642    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": container with ID starting with a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd not found: ID does not exist" containerID="a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"
Jul 18 00:46:35.303694 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.303660    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"} err="failed to get container status \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": rpc error: code = NotFound desc = could not find container \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": container with ID starting with a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd not found: ID does not exist"
Jul 18 00:46:35.303694 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.303672    2569 scope.go:117] "RemoveContainer" containerID="e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"
Jul 18 00:46:35.303919 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.303902    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"} err="failed to get container status \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": rpc error: code = NotFound desc = could not find container \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": container with ID starting with e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3 not found: ID does not exist"
Jul 18 00:46:35.303961 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.303920    2569 scope.go:117] "RemoveContainer" containerID="942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"
Jul 18 00:46:35.304142 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.304119    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"} err="failed to get container status \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": rpc error: code = NotFound desc = could not find container \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": container with ID starting with 942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee not found: ID does not exist"
Jul 18 00:46:35.304142 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.304141    2569 scope.go:117] "RemoveContainer" containerID="3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"
Jul 18 00:46:35.304403 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.304381    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"} err="failed to get container status \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": rpc error: code = NotFound desc = could not find container \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": container with ID starting with 3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8 not found: ID does not exist"
Jul 18 00:46:35.304403 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.304402    2569 scope.go:117] "RemoveContainer" containerID="1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"
Jul 18 00:46:35.304611 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.304597    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"} err="failed to get container status \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": rpc error: code = NotFound desc = could not find container \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": container with ID starting with 1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e not found: ID does not exist"
Jul 18 00:46:35.304611 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.304612    2569 scope.go:117] "RemoveContainer" containerID="b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"
Jul 18 00:46:35.304822 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.304802    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"} err="failed to get container status \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": rpc error: code = NotFound desc = could not find container \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": container with ID starting with b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4 not found: ID does not exist"
Jul 18 00:46:35.304943 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.304824    2569 scope.go:117] "RemoveContainer" containerID="ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"
Jul 18 00:46:35.304943 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.304881    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.305112 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.305081    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"} err="failed to get container status \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": rpc error: code = NotFound desc = could not find container \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": container with ID starting with ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3 not found: ID does not exist"
Jul 18 00:46:35.305177 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.305115    2569 scope.go:117] "RemoveContainer" containerID="a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"
Jul 18 00:46:35.305505 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.305483    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"} err="failed to get container status \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": rpc error: code = NotFound desc = could not find container \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": container with ID starting with a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd not found: ID does not exist"
Jul 18 00:46:35.305580 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.305505    2569 scope.go:117] "RemoveContainer" containerID="e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"
Jul 18 00:46:35.305767 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.305742    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"} err="failed to get container status \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": rpc error: code = NotFound desc = could not find container \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": container with ID starting with e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3 not found: ID does not exist"
Jul 18 00:46:35.305846 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.305771    2569 scope.go:117] "RemoveContainer" containerID="942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"
Jul 18 00:46:35.306001 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.305981    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"} err="failed to get container status \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": rpc error: code = NotFound desc = could not find container \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": container with ID starting with 942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee not found: ID does not exist"
Jul 18 00:46:35.306058 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.306003    2569 scope.go:117] "RemoveContainer" containerID="3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"
Jul 18 00:46:35.306244 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.306221    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"} err="failed to get container status \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": rpc error: code = NotFound desc = could not find container \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": container with ID starting with 3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8 not found: ID does not exist"
Jul 18 00:46:35.306244 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.306243    2569 scope.go:117] "RemoveContainer" containerID="1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"
Jul 18 00:46:35.306467 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.306451    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"} err="failed to get container status \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": rpc error: code = NotFound desc = could not find container \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": container with ID starting with 1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e not found: ID does not exist"
Jul 18 00:46:35.306522 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.306467    2569 scope.go:117] "RemoveContainer" containerID="b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"
Jul 18 00:46:35.306664 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.306649    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"} err="failed to get container status \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": rpc error: code = NotFound desc = could not find container \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": container with ID starting with b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4 not found: ID does not exist"
Jul 18 00:46:35.306702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.306664    2569 scope.go:117] "RemoveContainer" containerID="ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"
Jul 18 00:46:35.306840 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.306825    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"} err="failed to get container status \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": rpc error: code = NotFound desc = could not find container \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": container with ID starting with ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3 not found: ID does not exist"
Jul 18 00:46:35.306889 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.306840    2569 scope.go:117] "RemoveContainer" containerID="a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"
Jul 18 00:46:35.307073 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307045    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"} err="failed to get container status \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": rpc error: code = NotFound desc = could not find container \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": container with ID starting with a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd not found: ID does not exist"
Jul 18 00:46:35.307114 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307078    2569 scope.go:117] "RemoveContainer" containerID="e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"
Jul 18 00:46:35.307334 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307313    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 00:46:35.307334 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307333    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 00:46:35.307472 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307389    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"} err="failed to get container status \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": rpc error: code = NotFound desc = could not find container \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": container with ID starting with e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3 not found: ID does not exist"
Jul 18 00:46:35.307472 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307414    2569 scope.go:117] "RemoveContainer" containerID="942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"
Jul 18 00:46:35.307472 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307432    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 00:46:35.307472 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307461    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 00:46:35.307666 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307600    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 00:46:35.307666 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307636    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m59w8\""
Jul 18 00:46:35.307772 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307683    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2hl6ufr1e73d5\""
Jul 18 00:46:35.307772 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307703    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 00:46:35.307772 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307744    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 00:46:35.307917 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307778    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"} err="failed to get container status \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": rpc error: code = NotFound desc = could not find container \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": container with ID starting with 942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee not found: ID does not exist"
Jul 18 00:46:35.307917 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.307799    2569 scope.go:117] "RemoveContainer" containerID="3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"
Jul 18 00:46:35.308057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308008    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 00:46:35.308111 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308073    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 00:46:35.308157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308120    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"} err="failed to get container status \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": rpc error: code = NotFound desc = could not find container \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": container with ID starting with 3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8 not found: ID does not exist"
Jul 18 00:46:35.308294 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308156    2569 scope.go:117] "RemoveContainer" containerID="1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"
Jul 18 00:46:35.308294 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308181    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 00:46:35.308294 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308252    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 00:46:35.308451 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308254    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 00:46:35.308451 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308413    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"} err="failed to get container status \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": rpc error: code = NotFound desc = could not find container \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": container with ID starting with 1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e not found: ID does not exist"
Jul 18 00:46:35.308451 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308434    2569 scope.go:117] "RemoveContainer" containerID="b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"
Jul 18 00:46:35.308892 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308862    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"} err="failed to get container status \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": rpc error: code = NotFound desc = could not find container \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": container with ID starting with b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4 not found: ID does not exist"
Jul 18 00:46:35.308977 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.308894    2569 scope.go:117] "RemoveContainer" containerID="ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"
Jul 18 00:46:35.309187 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.309170    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"} err="failed to get container status \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": rpc error: code = NotFound desc = could not find container \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": container with ID starting with ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3 not found: ID does not exist"
Jul 18 00:46:35.309261 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.309229    2569 scope.go:117] "RemoveContainer" containerID="a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"
Jul 18 00:46:35.309479 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.309456    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"} err="failed to get container status \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": rpc error: code = NotFound desc = could not find container \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": container with ID starting with a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd not found: ID does not exist"
Jul 18 00:46:35.309479 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.309479    2569 scope.go:117] "RemoveContainer" containerID="e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"
Jul 18 00:46:35.309735 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.309715    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"} err="failed to get container status \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": rpc error: code = NotFound desc = could not find container \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": container with ID starting with e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3 not found: ID does not exist"
Jul 18 00:46:35.309815 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.309737    2569 scope.go:117] "RemoveContainer" containerID="942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"
Jul 18 00:46:35.310066 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.310043    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"} err="failed to get container status \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": rpc error: code = NotFound desc = could not find container \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": container with ID starting with 942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee not found: ID does not exist"
Jul 18 00:46:35.310066 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.310068    2569 scope.go:117] "RemoveContainer" containerID="3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"
Jul 18 00:46:35.310380 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.310356    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"} err="failed to get container status \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": rpc error: code = NotFound desc = could not find container \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": container with ID starting with 3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8 not found: ID does not exist"
Jul 18 00:46:35.310467 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.310380    2569 scope.go:117] "RemoveContainer" containerID="1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"
Jul 18 00:46:35.310665 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.310641    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"} err="failed to get container status \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": rpc error: code = NotFound desc = could not find container \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": container with ID starting with 1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e not found: ID does not exist"
Jul 18 00:46:35.310716 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.310666    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 00:46:35.310747 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.310669    2569 scope.go:117] "RemoveContainer" containerID="b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"
Jul 18 00:46:35.310960 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.310944    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"} err="failed to get container status \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": rpc error: code = NotFound desc = could not find container \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": container with ID starting with b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4 not found: ID does not exist"
Jul 18 00:46:35.311022 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.310962    2569 scope.go:117] "RemoveContainer" containerID="ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"
Jul 18 00:46:35.311168 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.311151    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"} err="failed to get container status \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": rpc error: code = NotFound desc = could not find container \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": container with ID starting with ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3 not found: ID does not exist"
Jul 18 00:46:35.311229 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.311171    2569 scope.go:117] "RemoveContainer" containerID="a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"
Jul 18 00:46:35.311443 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.311410    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"} err="failed to get container status \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": rpc error: code = NotFound desc = could not find container \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": container with ID starting with a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd not found: ID does not exist"
Jul 18 00:46:35.311443 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.311439    2569 scope.go:117] "RemoveContainer" containerID="e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"
Jul 18 00:46:35.311682 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.311659    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3"} err="failed to get container status \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": rpc error: code = NotFound desc = could not find container \"e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3\": container with ID starting with e88fac658170fac839467c47cfc8c7b714d1c5411a0ec4895568115a9dfc52c3 not found: ID does not exist"
Jul 18 00:46:35.311774 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.311682    2569 scope.go:117] "RemoveContainer" containerID="942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"
Jul 18 00:46:35.311962 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.311939    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee"} err="failed to get container status \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": rpc error: code = NotFound desc = could not find container \"942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee\": container with ID starting with 942194873c818e2c5f65ccff035553a5aa63c1050789a2851c267c0d710214ee not found: ID does not exist"
Jul 18 00:46:35.312045 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.311963    2569 scope.go:117] "RemoveContainer" containerID="3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"
Jul 18 00:46:35.312283 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.312259    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8"} err="failed to get container status \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": rpc error: code = NotFound desc = could not find container \"3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8\": container with ID starting with 3aa9d5f9391f380d1bfb3618a02386495632f1f67de773443a00c93665d3bfe8 not found: ID does not exist"
Jul 18 00:46:35.312371 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.312285    2569 scope.go:117] "RemoveContainer" containerID="1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"
Jul 18 00:46:35.312594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.312571    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e"} err="failed to get container status \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": rpc error: code = NotFound desc = could not find container \"1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e\": container with ID starting with 1f890607e83a3070949b3f1935bb52f99d5a519374f67b950710294f6956093e not found: ID does not exist"
Jul 18 00:46:35.312667 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.312595    2569 scope.go:117] "RemoveContainer" containerID="b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"
Jul 18 00:46:35.312850 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.312823    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4"} err="failed to get container status \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": rpc error: code = NotFound desc = could not find container \"b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4\": container with ID starting with b6da012f07d6fadc8bf6825cfbc1d1f65a574ce350ec97e81e81fd5a020fcce4 not found: ID does not exist"
Jul 18 00:46:35.312917 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.312848    2569 scope.go:117] "RemoveContainer" containerID="ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"
Jul 18 00:46:35.313202 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.313099    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3"} err="failed to get container status \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": rpc error: code = NotFound desc = could not find container \"ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3\": container with ID starting with ac38952cdf29940b62f6442a8f1b266c72baa7c06515c8bf8752e5900bbab4e3 not found: ID does not exist"
Jul 18 00:46:35.313202 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.313121    2569 scope.go:117] "RemoveContainer" containerID="a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"
Jul 18 00:46:35.313503 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.313472    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd"} err="failed to get container status \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": rpc error: code = NotFound desc = could not find container \"a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd\": container with ID starting with a8aa615d2df1cee895b0b69881a669cebb21718e6d775a961bf4db7a78014fcd not found: ID does not exist"
Jul 18 00:46:35.313618 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.313602    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 00:46:35.317379 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.317358    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:46:35.447443 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447443 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447382    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447443 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447726 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447485    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-config\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447726 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447535    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447726 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447558    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447726 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447588    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/242f4bcc-90d0-4da6-af50-dbe1118177a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447726 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447621    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447726 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447647    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447726 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447715    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/242f4bcc-90d0-4da6-af50-dbe1118177a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447929 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447929 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447785    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447929 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447818    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447929 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447846    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447929 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447878    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.447929 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447905    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.448125 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.448125 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447953    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.448125 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447978    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.448125 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.447995    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dbg4\" (UniqueName: \"kubernetes.io/projected/242f4bcc-90d0-4da6-af50-dbe1118177a2-kube-api-access-6dbg4\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549416 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/242f4bcc-90d0-4da6-af50-dbe1118177a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549416 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549419    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549629 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549629 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549463    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/242f4bcc-90d0-4da6-af50-dbe1118177a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549629 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549629 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549497    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549629 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549629 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549549    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549629 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549609    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549747    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549773    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dbg4\" (UniqueName: \"kubernetes.io/projected/242f4bcc-90d0-4da6-af50-dbe1118177a2-kube-api-access-6dbg4\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549846    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549872    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549905    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-config\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.549955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549941    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.550530 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.549965    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.550530 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.550390    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.551915 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.551023    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.551915 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.551351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.551915 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.551608    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.551915 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.551698    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.552211 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.552136    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.552211 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.552180    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.553946 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.553922    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/242f4bcc-90d0-4da6-af50-dbe1118177a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.554045 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.553982    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.554640 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.554352    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.554640 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.554415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.554640 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.554513    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.554847 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.554761    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/242f4bcc-90d0-4da6-af50-dbe1118177a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.554910 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.554840    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.555256 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.555236    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.555484 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.555468    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-config\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.555620 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.555600    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.555957 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.555942    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/242f4bcc-90d0-4da6-af50-dbe1118177a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.556390 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.556374    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/242f4bcc-90d0-4da6-af50-dbe1118177a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.560234 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.560216    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dbg4\" (UniqueName: \"kubernetes.io/projected/242f4bcc-90d0-4da6-af50-dbe1118177a2-kube-api-access-6dbg4\") pod \"prometheus-k8s-0\" (UID: \"242f4bcc-90d0-4da6-af50-dbe1118177a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.616311 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.616273    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:35.751698 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:35.751672    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:46:35.754435 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:46:35.754406    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242f4bcc_90d0_4da6_af50_dbe1118177a2.slice/crio-4c96b0d6a790f8e067c3057d3d0120ccf7c665eced7f3dd7436cc3da795a0633 WatchSource:0}: Error finding container 4c96b0d6a790f8e067c3057d3d0120ccf7c665eced7f3dd7436cc3da795a0633: Status 404 returned error can't find the container with id 4c96b0d6a790f8e067c3057d3d0120ccf7c665eced7f3dd7436cc3da795a0633
Jul 18 00:46:36.254001 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:36.253968    2569 generic.go:356] "Generic (PLEG): container finished" podID="242f4bcc-90d0-4da6-af50-dbe1118177a2" containerID="f874ad9c18caca86cf76656bf83321c8f37596209e9e6e849cae3fd806fc28ac" exitCode=0
Jul 18 00:46:36.254445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:36.254055    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"242f4bcc-90d0-4da6-af50-dbe1118177a2","Type":"ContainerDied","Data":"f874ad9c18caca86cf76656bf83321c8f37596209e9e6e849cae3fd806fc28ac"}
Jul 18 00:46:36.254445 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:36.254129    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"242f4bcc-90d0-4da6-af50-dbe1118177a2","Type":"ContainerStarted","Data":"4c96b0d6a790f8e067c3057d3d0120ccf7c665eced7f3dd7436cc3da795a0633"}
Jul 18 00:46:36.831462 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:36.831389    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37fec155-27b0-4877-a32d-1b5bb2928150" path="/var/lib/kubelet/pods/37fec155-27b0-4877-a32d-1b5bb2928150/volumes"
Jul 18 00:46:37.262392 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:37.262354    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"242f4bcc-90d0-4da6-af50-dbe1118177a2","Type":"ContainerStarted","Data":"3743a67673ed7490c9437ec9b67b56718759d765a716aae9ef2dbeeb8dc32690"}
Jul 18 00:46:37.262825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:37.262416    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"242f4bcc-90d0-4da6-af50-dbe1118177a2","Type":"ContainerStarted","Data":"3a237aaffa104628eeff0219612f1102da14d1f109f7445d5d4818ebcea2300e"}
Jul 18 00:46:37.262825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:37.262442    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"242f4bcc-90d0-4da6-af50-dbe1118177a2","Type":"ContainerStarted","Data":"384340c8ff0ac135824a20e8bbc52d91e38cfcf673994119c62e39d9e85f2290"}
Jul 18 00:46:37.262825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:37.262466    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"242f4bcc-90d0-4da6-af50-dbe1118177a2","Type":"ContainerStarted","Data":"b7ddabcc0441d209bc250b0c403a049747254779c9b3147ff192f75f2f21cc51"}
Jul 18 00:46:37.262825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:37.262490    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"242f4bcc-90d0-4da6-af50-dbe1118177a2","Type":"ContainerStarted","Data":"13300978619f1953bc7d01b638e26c08e4432c4e92a0334d8f40f4c99bb3f713"}
Jul 18 00:46:37.262825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:37.262515    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"242f4bcc-90d0-4da6-af50-dbe1118177a2","Type":"ContainerStarted","Data":"1c62dc5aa7014330ca7854e3e5d6531f898aeb2d3a42e3bf51cfc7e3b8fd4511"}
Jul 18 00:46:37.291532 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:37.291477    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.277196087 podStartE2EDuration="2.29145843s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.262343ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:46:37.289251705 +0000 UTC m=+371.001362995" watchObservedRunningTime="2026-07-18 00:46:37.29145843 +0000 UTC m=+371.003569717"
Jul 18 00:46:37.599294 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:37.599256    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:37.654360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:37.654326    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:40.617147 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:40.617095    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:46:41.644974 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:41.644940    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:41.703561 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:41.703512    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:41.756530 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:41.756494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:44.415209 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:44.415149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:46:44.479583 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:46:44.479546    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:05.310507 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:05.310469    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:05.401774 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:05.401735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:08.404841 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:08.404805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:26.856215 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:26.856171    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:27.542427 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:27.542391    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:27.650508 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:27.650469    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:27.753286 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:27.753261    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:30.262728 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:30.262684    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:30.362944 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:30.362907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:32.288804 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:32.288772    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:32.387007 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:32.386972    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:32.809401 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:32.809366    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:32.945151 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:32.945119    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:34.509360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:34.509331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:34.688579 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:34.688545    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:35.616869 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:35.616831    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:47:35.632595 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:35.632567    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:47:36.502519 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:36.502490    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:47:37.257771 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:37.257738    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:37.311542 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:37.311511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:39.599008 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:39.598963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:42.305351 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:42.305317    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:44.268872 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:44.268815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:44.370122 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:44.370091    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:49.518740 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:49.518650    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:49.616644 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:49.616600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:51.640786 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:51.640744    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:47:55.339339 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:47:55.339287    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:05.892905 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:05.892863    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:06.004175 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:06.004138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:06.523591 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:06.523560    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:06.869897 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:06.869866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:06.968666 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:06.968634    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:07.131364 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.131274    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"]
Jul 18 00:48:07.134632 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.134609    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.137414 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.137389    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 00:48:07.137603 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.137586    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 00:48:07.137669 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.137618    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 00:48:07.137840 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.137820    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 00:48:07.142337 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.142322    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8pvjh\""
Jul 18 00:48:07.199290 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.199259    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/174dcb18-92e3-4bae-b5b0-317a764fdc47-tmp\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.199434 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.199335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/174dcb18-92e3-4bae-b5b0-317a764fdc47-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.199434 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.199361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcnn8\" (UniqueName: \"kubernetes.io/projected/174dcb18-92e3-4bae-b5b0-317a764fdc47-kube-api-access-jcnn8\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.199434 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.199421    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/174dcb18-92e3-4bae-b5b0-317a764fdc47-manifests\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.199559 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.199444    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/174dcb18-92e3-4bae-b5b0-317a764fdc47-webhook-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.223885 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.223859    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"]
Jul 18 00:48:07.300065 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.300034    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/174dcb18-92e3-4bae-b5b0-317a764fdc47-tmp\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.300258 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.300102    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/174dcb18-92e3-4bae-b5b0-317a764fdc47-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.300258 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.300131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcnn8\" (UniqueName: \"kubernetes.io/projected/174dcb18-92e3-4bae-b5b0-317a764fdc47-kube-api-access-jcnn8\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.300258 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.300170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/174dcb18-92e3-4bae-b5b0-317a764fdc47-manifests\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.300258 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.300220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/174dcb18-92e3-4bae-b5b0-317a764fdc47-webhook-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.300556 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.300527    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/174dcb18-92e3-4bae-b5b0-317a764fdc47-manifests\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.302409 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.302388    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/174dcb18-92e3-4bae-b5b0-317a764fdc47-tmp\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.302660 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.302640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/174dcb18-92e3-4bae-b5b0-317a764fdc47-webhook-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.302723 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.302650    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/174dcb18-92e3-4bae-b5b0-317a764fdc47-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.314281 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.314255    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcnn8\" (UniqueName: \"kubernetes.io/projected/174dcb18-92e3-4bae-b5b0-317a764fdc47-kube-api-access-jcnn8\") pod \"opendatahub-operator-controller-manager-794f69c6d-dq64t\" (UID: \"174dcb18-92e3-4bae-b5b0-317a764fdc47\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.383406 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.383327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:07.444942 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.444914    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:07.473693 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.473664    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:07.558676 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.558642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:07.580130 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.577961    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"]
Jul 18 00:48:07.581835 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:48:07.581804    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174dcb18_92e3_4bae_b5b0_317a764fdc47.slice/crio-92979490f27e252b0f829ad4e565488c3024cfac430fedc62753fa004e43e8fc WatchSource:0}: Error finding container 92979490f27e252b0f829ad4e565488c3024cfac430fedc62753fa004e43e8fc: Status 404 returned error can't find the container with id 92979490f27e252b0f829ad4e565488c3024cfac430fedc62753fa004e43e8fc
Jul 18 00:48:07.583861 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.583847    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 00:48:07.610001 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.609963    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t" event={"ID":"174dcb18-92e3-4bae-b5b0-317a764fdc47","Type":"ContainerStarted","Data":"92979490f27e252b0f829ad4e565488c3024cfac430fedc62753fa004e43e8fc"}
Jul 18 00:48:07.637756 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.637694    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:07.743096 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.743058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:07.869131 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:07.869096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:10.625727 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:10.625690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t" event={"ID":"174dcb18-92e3-4bae-b5b0-317a764fdc47","Type":"ContainerStarted","Data":"c2e9c4020181af598035830992cac69ae97acf7b428393fae2be5f26440ac34a"}
Jul 18 00:48:11.632146 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:11.632112    2569 generic.go:356] "Generic (PLEG): container finished" podID="174dcb18-92e3-4bae-b5b0-317a764fdc47" containerID="c2e9c4020181af598035830992cac69ae97acf7b428393fae2be5f26440ac34a" exitCode=0
Jul 18 00:48:11.632510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:11.632206    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t" event={"ID":"174dcb18-92e3-4bae-b5b0-317a764fdc47","Type":"ContainerDied","Data":"c2e9c4020181af598035830992cac69ae97acf7b428393fae2be5f26440ac34a"}
Jul 18 00:48:12.638463 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:12.638427    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t" event={"ID":"174dcb18-92e3-4bae-b5b0-317a764fdc47","Type":"ContainerStarted","Data":"b7761021a871ca8b1d1da54b7a822a01ae9fb493d60adf03a791205dca3685c0"}
Jul 18 00:48:12.638842 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:12.638570    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:12.662032 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:12.661979    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t" podStartSLOduration=1.390819548 podStartE2EDuration="5.661963192s" totalImagesPullingTime="3.194865993s" totalInitContainerRuntime="1.076277651s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:12.660997421 +0000 UTC m=+466.373108719" watchObservedRunningTime="2026-07-18 00:48:12.661963192 +0000 UTC m=+466.374074477"
Jul 18 00:48:20.712086 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:20.712045    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:20.905135 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:20.905094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:23.645275 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:23.645247    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-dq64t"
Jul 18 00:48:24.125220 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:24.125169    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:24.191422 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:24.191394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:25.951129 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:25.951092    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:26.089753 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.089723    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:26.724957 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.724921    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-k27wl"]
Jul 18 00:48:26.731023 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.731001    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:26.733923 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:26.733893    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-dockercfg-6657k\" is forbidden: User \"system:node:ip-10-0-142-221.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6657k\"" type="*v1.Secret"
Jul 18 00:48:26.734036 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:26.733988    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-142-221.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret"
Jul 18 00:48:26.734099 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:26.734050    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"odh-model-controller-7998c67dc4-k27wl\" is forbidden: User \"system:node:ip-10-0-142-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-221.ec2.internal' and this object" podUID="257c49ef-bf57-437d-be2f-47bbb83e4236" pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:26.760646 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.760615    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-k27wl"]
Jul 18 00:48:26.845027 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.844982    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:26.872955 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.872922    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k6sk\" (UniqueName: \"kubernetes.io/projected/257c49ef-bf57-437d-be2f-47bbb83e4236-kube-api-access-4k6sk\") pod \"odh-model-controller-7998c67dc4-k27wl\" (UID: \"257c49ef-bf57-437d-be2f-47bbb83e4236\") " pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:26.873095 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.873002    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/257c49ef-bf57-437d-be2f-47bbb83e4236-cert\") pod \"odh-model-controller-7998c67dc4-k27wl\" (UID: \"257c49ef-bf57-437d-be2f-47bbb83e4236\") " pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:26.973559 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.973526    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k6sk\" (UniqueName: \"kubernetes.io/projected/257c49ef-bf57-437d-be2f-47bbb83e4236-kube-api-access-4k6sk\") pod \"odh-model-controller-7998c67dc4-k27wl\" (UID: \"257c49ef-bf57-437d-be2f-47bbb83e4236\") " pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:26.973983 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.973634    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/257c49ef-bf57-437d-be2f-47bbb83e4236-cert\") pod \"odh-model-controller-7998c67dc4-k27wl\" (UID: \"257c49ef-bf57-437d-be2f-47bbb83e4236\") " pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:26.988135 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:26.988069    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k6sk\" (UniqueName: \"kubernetes.io/projected/257c49ef-bf57-437d-be2f-47bbb83e4236-kube-api-access-4k6sk\") pod \"odh-model-controller-7998c67dc4-k27wl\" (UID: \"257c49ef-bf57-437d-be2f-47bbb83e4236\") " pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:27.032156 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.032112    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:27.143495 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.143460    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:27.718847 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.718815    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q28lc"]
Jul 18 00:48:27.720948 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.720927    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:27.723405 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.723387    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 18 00:48:27.740604 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.740576    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q28lc"]
Jul 18 00:48:27.779164 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.779134    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:27.868150 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.868116    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:27.881251 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.881224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4j9p\" (UniqueName: \"kubernetes.io/projected/f28e7be2-6fc4-4777-bfce-d955ecac0029-kube-api-access-p4j9p\") pod \"model-serving-api-54d89bd5fc-q28lc\" (UID: \"f28e7be2-6fc4-4777-bfce-d955ecac0029\") " pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:27.881376 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.881310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28e7be2-6fc4-4777-bfce-d955ecac0029-tls-certs\") pod \"model-serving-api-54d89bd5fc-q28lc\" (UID: \"f28e7be2-6fc4-4777-bfce-d955ecac0029\") " pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:27.904853 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.904822    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6657k\""
Jul 18 00:48:27.974275 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:27.974186    2569 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: failed to sync secret cache: timed out waiting for the condition
Jul 18 00:48:27.974607 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:27.974284    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/257c49ef-bf57-437d-be2f-47bbb83e4236-cert podName:257c49ef-bf57-437d-be2f-47bbb83e4236 nodeName:}" failed. No retries permitted until 2026-07-18 00:48:28.474263655 +0000 UTC m=+482.186374939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/257c49ef-bf57-437d-be2f-47bbb83e4236-cert") pod "odh-model-controller-7998c67dc4-k27wl" (UID: "257c49ef-bf57-437d-be2f-47bbb83e4236") : failed to sync secret cache: timed out waiting for the condition
Jul 18 00:48:27.981685 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.981658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28e7be2-6fc4-4777-bfce-d955ecac0029-tls-certs\") pod \"model-serving-api-54d89bd5fc-q28lc\" (UID: \"f28e7be2-6fc4-4777-bfce-d955ecac0029\") " pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:27.981780 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.981703    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4j9p\" (UniqueName: \"kubernetes.io/projected/f28e7be2-6fc4-4777-bfce-d955ecac0029-kube-api-access-p4j9p\") pod \"model-serving-api-54d89bd5fc-q28lc\" (UID: \"f28e7be2-6fc4-4777-bfce-d955ecac0029\") " pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:27.982828 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.982809    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 18 00:48:27.984067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.984048    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28e7be2-6fc4-4777-bfce-d955ecac0029-tls-certs\") pod \"model-serving-api-54d89bd5fc-q28lc\" (UID: \"f28e7be2-6fc4-4777-bfce-d955ecac0029\") " pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:27.999701 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:27.999672    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4j9p\" (UniqueName: \"kubernetes.io/projected/f28e7be2-6fc4-4777-bfce-d955ecac0029-kube-api-access-p4j9p\") pod \"model-serving-api-54d89bd5fc-q28lc\" (UID: \"f28e7be2-6fc4-4777-bfce-d955ecac0029\") " pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:28.030598 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:28.030578    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:28.178311 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:28.178233    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q28lc"]
Jul 18 00:48:28.180374 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:48:28.180343    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28e7be2_6fc4_4777_bfce_d955ecac0029.slice/crio-c214fac707de9735e33c267683b1ad94df701887971a0c539a276609263a8798 WatchSource:0}: Error finding container c214fac707de9735e33c267683b1ad94df701887971a0c539a276609263a8798: Status 404 returned error can't find the container with id c214fac707de9735e33c267683b1ad94df701887971a0c539a276609263a8798
Jul 18 00:48:28.486545 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:28.486511    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/257c49ef-bf57-437d-be2f-47bbb83e4236-cert\") pod \"odh-model-controller-7998c67dc4-k27wl\" (UID: \"257c49ef-bf57-437d-be2f-47bbb83e4236\") " pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:28.488936 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:28.488917    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/257c49ef-bf57-437d-be2f-47bbb83e4236-cert\") pod \"odh-model-controller-7998c67dc4-k27wl\" (UID: \"257c49ef-bf57-437d-be2f-47bbb83e4236\") " pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:28.540782 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:28.540753    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:28.667751 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:28.667721    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-k27wl"]
Jul 18 00:48:28.668955 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:48:28.668923    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257c49ef_bf57_437d_be2f_47bbb83e4236.slice/crio-d421d5bba803f25f9ab7818f2634bfcda9e76b9ff17ff5eb9a8786e51d2bd57a WatchSource:0}: Error finding container d421d5bba803f25f9ab7818f2634bfcda9e76b9ff17ff5eb9a8786e51d2bd57a: Status 404 returned error can't find the container with id d421d5bba803f25f9ab7818f2634bfcda9e76b9ff17ff5eb9a8786e51d2bd57a
Jul 18 00:48:28.708820 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:28.708787    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q28lc" event={"ID":"f28e7be2-6fc4-4777-bfce-d955ecac0029","Type":"ContainerStarted","Data":"c214fac707de9735e33c267683b1ad94df701887971a0c539a276609263a8798"}
Jul 18 00:48:28.709840 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:28.709815    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-k27wl" event={"ID":"257c49ef-bf57-437d-be2f-47bbb83e4236","Type":"ContainerStarted","Data":"d421d5bba803f25f9ab7818f2634bfcda9e76b9ff17ff5eb9a8786e51d2bd57a"}
Jul 18 00:48:30.722936 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:30.722883    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q28lc" event={"ID":"f28e7be2-6fc4-4777-bfce-d955ecac0029","Type":"ContainerStarted","Data":"88543e113055dcea1aca23ed36ee648827bfed6047cf9ce143825126d7fe6ae8"}
Jul 18 00:48:30.723415 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:30.723021    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:30.741469 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:30.741416    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-q28lc" podStartSLOduration=2.174046374 podStartE2EDuration="3.741397747s" totalImagesPullingTime="1.567351373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:30.73958438 +0000 UTC m=+484.451695689" watchObservedRunningTime="2026-07-18 00:48:30.741397747 +0000 UTC m=+484.453509033"
Jul 18 00:48:31.729087 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:31.728984    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-k27wl" event={"ID":"257c49ef-bf57-437d-be2f-47bbb83e4236","Type":"ContainerStarted","Data":"b0ee476dda035e79f031a244a94cfe0308a1184c5385d76f8b0cb930e3f36e9e"}
Jul 18 00:48:31.729527 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:31.729175    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:31.745827 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:31.745767    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-k27wl" podStartSLOduration=3.05345585 podStartE2EDuration="5.745754676s" totalImagesPullingTime="2.692298826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:31.744324379 +0000 UTC m=+485.456435678" watchObservedRunningTime="2026-07-18 00:48:31.745754676 +0000 UTC m=+485.457866005"
Jul 18 00:48:36.239916 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.239883    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"]
Jul 18 00:48:36.242247 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.242229    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:36.244333 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.244315    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 18 00:48:36.244604 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.244589    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cr87l\""
Jul 18 00:48:36.251755 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.251726    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"]
Jul 18 00:48:36.253906 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.253886    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"]
Jul 18 00:48:36.254018 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.253977    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:36.257488 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.257467    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 18 00:48:36.257598 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.257545    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dd4t4\""
Jul 18 00:48:36.264395 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.264373    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"]
Jul 18 00:48:36.303545 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.303498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:36.355625 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.355598    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527e3d6c-781a-492e-bc44-0cce3780e4e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-6xhz4\" (UID: \"527e3d6c-781a-492e-bc44-0cce3780e4e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:36.355769 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.355666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flql5\" (UniqueName: \"kubernetes.io/projected/8f4bf076-dec8-435f-b3fe-0e33330de605-kube-api-access-flql5\") pod \"llmisvc-controller-manager-777c6bd7d5-27zj7\" (UID: \"8f4bf076-dec8-435f-b3fe-0e33330de605\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:36.355769 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.355694    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5k2r\" (UniqueName: \"kubernetes.io/projected/527e3d6c-781a-492e-bc44-0cce3780e4e8-kube-api-access-b5k2r\") pod \"kserve-controller-manager-d6f4b65b8-6xhz4\" (UID: \"527e3d6c-781a-492e-bc44-0cce3780e4e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:36.355769 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.355721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4bf076-dec8-435f-b3fe-0e33330de605-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-27zj7\" (UID: \"8f4bf076-dec8-435f-b3fe-0e33330de605\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:36.382066 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.382030    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:36.456902 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.456869    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flql5\" (UniqueName: \"kubernetes.io/projected/8f4bf076-dec8-435f-b3fe-0e33330de605-kube-api-access-flql5\") pod \"llmisvc-controller-manager-777c6bd7d5-27zj7\" (UID: \"8f4bf076-dec8-435f-b3fe-0e33330de605\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:36.457054 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.456909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5k2r\" (UniqueName: \"kubernetes.io/projected/527e3d6c-781a-492e-bc44-0cce3780e4e8-kube-api-access-b5k2r\") pod \"kserve-controller-manager-d6f4b65b8-6xhz4\" (UID: \"527e3d6c-781a-492e-bc44-0cce3780e4e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:36.457054 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.456928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4bf076-dec8-435f-b3fe-0e33330de605-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-27zj7\" (UID: \"8f4bf076-dec8-435f-b3fe-0e33330de605\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:36.457054 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.456957    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527e3d6c-781a-492e-bc44-0cce3780e4e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-6xhz4\" (UID: \"527e3d6c-781a-492e-bc44-0cce3780e4e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:36.457151 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:36.457107    2569 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 18 00:48:36.457151 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:36.457122    2569 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 18 00:48:36.457249 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:36.457175    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f4bf076-dec8-435f-b3fe-0e33330de605-cert podName:8f4bf076-dec8-435f-b3fe-0e33330de605 nodeName:}" failed. No retries permitted until 2026-07-18 00:48:36.957155443 +0000 UTC m=+490.669266714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f4bf076-dec8-435f-b3fe-0e33330de605-cert") pod "llmisvc-controller-manager-777c6bd7d5-27zj7" (UID: "8f4bf076-dec8-435f-b3fe-0e33330de605") : secret "llmisvc-webhook-server-cert" not found
Jul 18 00:48:36.457249 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:36.457221    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527e3d6c-781a-492e-bc44-0cce3780e4e8-cert podName:527e3d6c-781a-492e-bc44-0cce3780e4e8 nodeName:}" failed. No retries permitted until 2026-07-18 00:48:36.957185813 +0000 UTC m=+490.669297078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/527e3d6c-781a-492e-bc44-0cce3780e4e8-cert") pod "kserve-controller-manager-d6f4b65b8-6xhz4" (UID: "527e3d6c-781a-492e-bc44-0cce3780e4e8") : secret "kserve-webhook-server-cert" not found
Jul 18 00:48:36.470025 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.470003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flql5\" (UniqueName: \"kubernetes.io/projected/8f4bf076-dec8-435f-b3fe-0e33330de605-kube-api-access-flql5\") pod \"llmisvc-controller-manager-777c6bd7d5-27zj7\" (UID: \"8f4bf076-dec8-435f-b3fe-0e33330de605\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:36.477914 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.477894    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5k2r\" (UniqueName: \"kubernetes.io/projected/527e3d6c-781a-492e-bc44-0cce3780e4e8-kube-api-access-b5k2r\") pod \"kserve-controller-manager-d6f4b65b8-6xhz4\" (UID: \"527e3d6c-781a-492e-bc44-0cce3780e4e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:36.572800 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.572718    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:36.844433 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.844390    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:36.954962 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.954930    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"]
Jul 18 00:48:36.956532 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.956499    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:36.957297 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.957281    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:36.960098 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.960074    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g7rmj\""
Jul 18 00:48:36.960186 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.960136    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 18 00:48:36.960419 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.960403    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 18 00:48:36.960774 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.960755    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4bf076-dec8-435f-b3fe-0e33330de605-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-27zj7\" (UID: \"8f4bf076-dec8-435f-b3fe-0e33330de605\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:36.960850 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.960804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527e3d6c-781a-492e-bc44-0cce3780e4e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-6xhz4\" (UID: \"527e3d6c-781a-492e-bc44-0cce3780e4e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:36.963244 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.963224    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527e3d6c-781a-492e-bc44-0cce3780e4e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-6xhz4\" (UID: \"527e3d6c-781a-492e-bc44-0cce3780e4e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:36.963328 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.963283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4bf076-dec8-435f-b3fe-0e33330de605-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-27zj7\" (UID: \"8f4bf076-dec8-435f-b3fe-0e33330de605\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:36.976695 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:36.976674    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"]
Jul 18 00:48:37.061504 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.061465    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aba05fd-4990-47f3-bae3-83d258f8a3a6-tmp\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.061678 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.061553    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2zlq\" (UniqueName: \"kubernetes.io/projected/3aba05fd-4990-47f3-bae3-83d258f8a3a6-kube-api-access-p2zlq\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.061678 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.061591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aba05fd-4990-47f3-bae3-83d258f8a3a6-tls-certs\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.153541 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.153469    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:37.162607 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.162581    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2zlq\" (UniqueName: \"kubernetes.io/projected/3aba05fd-4990-47f3-bae3-83d258f8a3a6-kube-api-access-p2zlq\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.162671 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.162628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aba05fd-4990-47f3-bae3-83d258f8a3a6-tls-certs\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.162726 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.162682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aba05fd-4990-47f3-bae3-83d258f8a3a6-tmp\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.162882 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:37.162860    2569 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 18 00:48:37.162960 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:48:37.162948    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aba05fd-4990-47f3-bae3-83d258f8a3a6-tls-certs podName:3aba05fd-4990-47f3-bae3-83d258f8a3a6 nodeName:}" failed. No retries permitted until 2026-07-18 00:48:37.66292776 +0000 UTC m=+491.375039046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3aba05fd-4990-47f3-bae3-83d258f8a3a6-tls-certs") pod "kube-auth-proxy-54498b876f-mc4hz" (UID: "3aba05fd-4990-47f3-bae3-83d258f8a3a6") : secret "kube-auth-proxy-tls" not found
Jul 18 00:48:37.163285 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.163262    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:37.164811 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.164787    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aba05fd-4990-47f3-bae3-83d258f8a3a6-tmp\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.172094 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.172071    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2zlq\" (UniqueName: \"kubernetes.io/projected/3aba05fd-4990-47f3-bae3-83d258f8a3a6-kube-api-access-p2zlq\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.309567 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.309530    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"]
Jul 18 00:48:37.312400 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:48:37.312372    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527e3d6c_781a_492e_bc44_0cce3780e4e8.slice/crio-f23a5f703552b0bad99a1b55da144a63e02774a40508b23584216ade41884fdb WatchSource:0}: Error finding container f23a5f703552b0bad99a1b55da144a63e02774a40508b23584216ade41884fdb: Status 404 returned error can't find the container with id f23a5f703552b0bad99a1b55da144a63e02774a40508b23584216ade41884fdb
Jul 18 00:48:37.324113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.324084    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"]
Jul 18 00:48:37.326567 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:48:37.326544    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8f4bf076_dec8_435f_b3fe_0e33330de605.slice/crio-cf7a212e50ba0b9fef3e9155e0727a74287f5adc4ac5832f9ced37c22590362f WatchSource:0}: Error finding container cf7a212e50ba0b9fef3e9155e0727a74287f5adc4ac5832f9ced37c22590362f: Status 404 returned error can't find the container with id cf7a212e50ba0b9fef3e9155e0727a74287f5adc4ac5832f9ced37c22590362f
Jul 18 00:48:37.343280 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.343257    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:37.597033 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.597001    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:37.668233 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.668179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aba05fd-4990-47f3-bae3-83d258f8a3a6-tls-certs\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.670573 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.670555    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aba05fd-4990-47f3-bae3-83d258f8a3a6-tls-certs\") pod \"kube-auth-proxy-54498b876f-mc4hz\" (UID: \"3aba05fd-4990-47f3-bae3-83d258f8a3a6\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:37.729051 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.729024    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:37.755699 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.755668    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4" event={"ID":"527e3d6c-781a-492e-bc44-0cce3780e4e8","Type":"ContainerStarted","Data":"f23a5f703552b0bad99a1b55da144a63e02774a40508b23584216ade41884fdb"}
Jul 18 00:48:37.756683 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.756663    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7" event={"ID":"8f4bf076-dec8-435f-b3fe-0e33330de605","Type":"ContainerStarted","Data":"cf7a212e50ba0b9fef3e9155e0727a74287f5adc4ac5832f9ced37c22590362f"}
Jul 18 00:48:37.875319 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:37.875256    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"
Jul 18 00:48:38.015049 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:38.015025    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54498b876f-mc4hz"]
Jul 18 00:48:38.038010 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:48:38.037975    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aba05fd_4990_47f3_bae3_83d258f8a3a6.slice/crio-3c30e231ffca450b6df50dbf791dd2fe61768c3d164edd861ae400858227582e WatchSource:0}: Error finding container 3c30e231ffca450b6df50dbf791dd2fe61768c3d164edd861ae400858227582e: Status 404 returned error can't find the container with id 3c30e231ffca450b6df50dbf791dd2fe61768c3d164edd861ae400858227582e
Jul 18 00:48:38.765547 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:38.765508    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz" event={"ID":"3aba05fd-4990-47f3-bae3-83d258f8a3a6","Type":"ContainerStarted","Data":"3c30e231ffca450b6df50dbf791dd2fe61768c3d164edd861ae400858227582e"}
Jul 18 00:48:39.134901 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.134849    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"]
Jul 18 00:48:39.137869 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.137844    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.140498 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.140470    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 18 00:48:39.140498 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.140492    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 18 00:48:39.140675 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.140551    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8c7qd\""
Jul 18 00:48:39.140730 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.140678    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 18 00:48:39.140730 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.140684    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 00:48:39.143020 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.142989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:39.156337 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.156280    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"]
Jul 18 00:48:39.183682 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.183655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98c8fab2-6a4c-496a-ad99-ebab331066de-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.183836 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.183693    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.183836 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.183717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.183836 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.183761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.184004 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.183894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98c8fab2-6a4c-496a-ad99-ebab331066de-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.184004 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.183927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.184113 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.184002    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8pdn\" (UniqueName: \"kubernetes.io/projected/98c8fab2-6a4c-496a-ad99-ebab331066de-kube-api-access-k8pdn\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.239723 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.239687    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:39.284556 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.284519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8pdn\" (UniqueName: \"kubernetes.io/projected/98c8fab2-6a4c-496a-ad99-ebab331066de-kube-api-access-k8pdn\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.284737 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.284596    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98c8fab2-6a4c-496a-ad99-ebab331066de-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.284737 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.284622    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.284737 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.284662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.284737 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.284682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.284737 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.284733    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98c8fab2-6a4c-496a-ad99-ebab331066de-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.285017 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.284760    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.285514 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.285446    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.287904 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.287857    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98c8fab2-6a4c-496a-ad99-ebab331066de-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.288018 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.287908    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.288673 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.288515    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.288861 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.288838    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98c8fab2-6a4c-496a-ad99-ebab331066de-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.294771 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.294725    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98c8fab2-6a4c-496a-ad99-ebab331066de-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.295059 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.295033    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8pdn\" (UniqueName: \"kubernetes.io/projected/98c8fab2-6a4c-496a-ad99-ebab331066de-kube-api-access-k8pdn\") pod \"istiod-openshift-gateway-94bb8fbfd-mtdqs\" (UID: \"98c8fab2-6a4c-496a-ad99-ebab331066de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:39.452767 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:39.452468    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:40.631368 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:40.631332    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:41.133447 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.133412    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"]
Jul 18 00:48:41.138310 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:48:41.138265    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c8fab2_6a4c_496a_ad99_ebab331066de.slice/crio-f17a3f3564577ac1f4b9d5596f3d9ba7fb997688c5478f53a0857324157239d1 WatchSource:0}: Error finding container f17a3f3564577ac1f4b9d5596f3d9ba7fb997688c5478f53a0857324157239d1: Status 404 returned error can't find the container with id f17a3f3564577ac1f4b9d5596f3d9ba7fb997688c5478f53a0857324157239d1
Jul 18 00:48:41.732869 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.732839    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-q28lc"
Jul 18 00:48:41.783017 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.782983    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs" event={"ID":"98c8fab2-6a4c-496a-ad99-ebab331066de","Type":"ContainerStarted","Data":"f17a3f3564577ac1f4b9d5596f3d9ba7fb997688c5478f53a0857324157239d1"}
Jul 18 00:48:41.784868 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.784827    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz" event={"ID":"3aba05fd-4990-47f3-bae3-83d258f8a3a6","Type":"ContainerStarted","Data":"4177496f1ce7cabf5bf32f3a3bd55b86e4a23e308755a301eee250dbb9f29216"}
Jul 18 00:48:41.786748 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.786723    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4" event={"ID":"527e3d6c-781a-492e-bc44-0cce3780e4e8","Type":"ContainerStarted","Data":"dfdbb15cf837c0c60f3ca6c1929cf10c210ce23e073a4d1656d5376ddd894496"}
Jul 18 00:48:41.786891 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.786825    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:48:41.788276 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.788254    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7" event={"ID":"8f4bf076-dec8-435f-b3fe-0e33330de605","Type":"ContainerStarted","Data":"1408ca114edb07ff56ce3fbbc578d534bfa54ee45f89f849acecc6a5c5c688f5"}
Jul 18 00:48:41.788388 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.788317    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:48:41.815218 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.815148    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54498b876f-mc4hz" podStartSLOduration=2.861109583 podStartE2EDuration="5.815131545s" totalImagesPullingTime="2.954021962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:41.814510075 +0000 UTC m=+495.526621361" watchObservedRunningTime="2026-07-18 00:48:41.815131545 +0000 UTC m=+495.527242829"
Jul 18 00:48:41.835838 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.835777    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4" podStartSLOduration=2.161975098 podStartE2EDuration="5.835758644s" totalImagesPullingTime="3.673783546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:41.83384587 +0000 UTC m=+495.545957157" watchObservedRunningTime="2026-07-18 00:48:41.835758644 +0000 UTC m=+495.547869929"
Jul 18 00:48:41.862478 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:41.861440    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7" podStartSLOduration=2.201193274 podStartE2EDuration="5.861413905s" totalImagesPullingTime="3.660220631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:41.860455231 +0000 UTC m=+495.572566517" watchObservedRunningTime="2026-07-18 00:48:41.861413905 +0000 UTC m=+495.573525195"
Jul 18 00:48:42.736072 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:42.736036    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-k27wl"
Jul 18 00:48:43.592052 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:43.592016    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 18 00:48:43.592136 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:43.592082    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 18 00:48:43.801027 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:43.800997    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs" event={"ID":"98c8fab2-6a4c-496a-ad99-ebab331066de","Type":"ContainerStarted","Data":"bb67b136cd4f521d9ca69604ebe3a3374670520481f9b84d20ac8fe5f334e48f"}
Jul 18 00:48:43.801421 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:43.801126    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:43.874157 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:43.874091    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs" podStartSLOduration=2.4227489220000002 podStartE2EDuration="4.874067609s" totalImagesPullingTime="2.451318687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:43.872922667 +0000 UTC m=+497.585033955" watchObservedRunningTime="2026-07-18 00:48:43.874067609 +0000 UTC m=+497.586178897"
Jul 18 00:48:44.434625 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:44.434588    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:44.547485 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:44.547431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:44.808224 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:44.808133    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-mtdqs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 00:48:44.808224 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:44.808188    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs" podUID="98c8fab2-6a4c-496a-ad99-ebab331066de" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 00:48:45.487307 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:45.487276    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:45.717473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:45.717438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:45.828430 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:45.828344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:47.808063 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:47.808024    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mtdqs"
Jul 18 00:48:49.741908 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:49.741869    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:48:49.880375 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:48:49.880339    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:49:12.795544 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:49:12.795515    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27zj7"
Jul 18 00:49:12.798675 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:49:12.798655    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6xhz4"
Jul 18 00:49:27.302052 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:49:27.301968    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:49:28.530822 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:49:28.530786    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:49:56.907472 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:49:56.907436    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:00.510148 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:00.510115    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:03.576139 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:03.576101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:05.041099 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:05.041054    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:06.355142 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:06.355101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:08.527556 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:08.527513    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:08.913283 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:08.913246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:09.234051 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:09.233942    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:09.433058 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:09.433003    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:11.688589 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.688553    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-52j82"]
Jul 18 00:50:11.692110 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.692091    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82"
Jul 18 00:50:11.695608 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.695587    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-s5nlr\""
Jul 18 00:50:11.695702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.695611    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 00:50:11.696442 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.696428    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 00:50:11.706806 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.706781    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-52j82"]
Jul 18 00:50:11.796292 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.796253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn4lg\" (UniqueName: \"kubernetes.io/projected/2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28-kube-api-access-tn4lg\") pod \"authorino-operator-75cc8d5cb7-52j82\" (UID: \"2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82"
Jul 18 00:50:11.897187 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.897155    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn4lg\" (UniqueName: \"kubernetes.io/projected/2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28-kube-api-access-tn4lg\") pod \"authorino-operator-75cc8d5cb7-52j82\" (UID: \"2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82"
Jul 18 00:50:11.922277 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.922244    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn4lg\" (UniqueName: \"kubernetes.io/projected/2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28-kube-api-access-tn4lg\") pod \"authorino-operator-75cc8d5cb7-52j82\" (UID: \"2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82"
Jul 18 00:50:11.982698 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:11.982605    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:12.002142 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:12.002120    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82"
Jul 18 00:50:12.144454 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:12.144430    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-52j82"]
Jul 18 00:50:12.146836 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:50:12.146805    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dffcc1b_e8a5_4aca_b34d_a3d9b1a0fd28.slice/crio-ad25b2ad7c4deb469b39bc8e52aaa5b681393355a3da56aeb4dcee4f5b327dee WatchSource:0}: Error finding container ad25b2ad7c4deb469b39bc8e52aaa5b681393355a3da56aeb4dcee4f5b327dee: Status 404 returned error can't find the container with id ad25b2ad7c4deb469b39bc8e52aaa5b681393355a3da56aeb4dcee4f5b327dee
Jul 18 00:50:12.199109 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:12.199077    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82" event={"ID":"2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28","Type":"ContainerStarted","Data":"ad25b2ad7c4deb469b39bc8e52aaa5b681393355a3da56aeb4dcee4f5b327dee"}
Jul 18 00:50:13.377464 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:13.377415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:13.477760 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:13.477715    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:14.081594 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:14.081558    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:14.523716 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:14.523672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:15.217279 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:15.217237    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82" event={"ID":"2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28","Type":"ContainerStarted","Data":"9eaff1db2c765c777589216f785697c30ff88c285c58224729d9ce13f56ba71f"}
Jul 18 00:50:15.217448 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:15.217309    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82"
Jul 18 00:50:15.250552 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:15.250501    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82" podStartSLOduration=2.185971481 podStartE2EDuration="4.250485559s" totalImagesPullingTime="2.064514078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:15.248157547 +0000 UTC m=+588.960268833" watchObservedRunningTime="2026-07-18 00:50:15.250485559 +0000 UTC m=+588.962596847"
Jul 18 00:50:17.119207 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:17.119134    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:17.295305 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:17.295183    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:24.563306 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:24.563275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:24.664496 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:24.664458    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:26.224832 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:26.224805    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52j82"
Jul 18 00:50:26.657004 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:26.656977    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:50:26.657860 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:26.657839    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:50:29.334642 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:29.334609    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:29.434497 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:29.434449    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:29.533512 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:29.533475    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:29.708867 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:29.708832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:29.802221 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:29.802174    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:30.233155 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:30.233122    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:30.333133 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:30.333098    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:31.132634 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:31.132599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:31.191916 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:31.191881    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:31.850111 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:31.850074    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:31.980270 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:31.980227    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:32.881252 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:32.881215    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:32.943260 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:32.943224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:35.250072 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:35.250037    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:35.343525 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:35.343490    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:41.017550 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:41.017513    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:41.114023 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:41.113991    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:41.215840 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:41.215804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:42.299373 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:42.299338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:42.405868 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:42.405834    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:47.059396 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:47.059359    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:47.159615 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:47.159570    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:49.676302 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:49.676210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:49.775310 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:49.775263    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:50.776448 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:50.776414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:52.670512 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:52.670472    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:52.953608 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:52.953520    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:53.270346 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:53.270246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:53.369626 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:53.369588    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:54.393443 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:54.393407    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:54.518644 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:54.518611    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:54.589635 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:54.589596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:55.237839 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:55.237804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:50:55.303463 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:50:55.303425    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:00.864558 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:00.864506    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:00.955655 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:00.955621    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:05.668548 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:05.668506    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:05.769757 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:05.769712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:10.442063 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:10.442012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:10.537926 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:10.537880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:10.954007 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:10.953964    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:12.876094 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:12.876059    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:23.390662 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:23.390628    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:23.491416 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:23.491375    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:29.576056 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.576019    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:29.590964 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.590934    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c55bc4c-gt566"]
Jul 18 00:51:29.594421 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.594399    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:29.597186 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.597163    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 18 00:51:29.597186 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.597188    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 18 00:51:29.597383 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.597263    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2lpjj\""
Jul 18 00:51:29.603120 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.603097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a962aba-a244-446c-a2da-6429bffe28f8-webhook-cert\") pod \"maas-controller-56c55bc4c-gt566\" (UID: \"8a962aba-a244-446c-a2da-6429bffe28f8\") " pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:29.603241 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.603145    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mxxn\" (UniqueName: \"kubernetes.io/projected/8a962aba-a244-446c-a2da-6429bffe28f8-kube-api-access-8mxxn\") pod \"maas-controller-56c55bc4c-gt566\" (UID: \"8a962aba-a244-446c-a2da-6429bffe28f8\") " pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:29.608702 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.608680    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c55bc4c-gt566"]
Jul 18 00:51:29.670159 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.670128    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:29.704589 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.704551    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a962aba-a244-446c-a2da-6429bffe28f8-webhook-cert\") pod \"maas-controller-56c55bc4c-gt566\" (UID: \"8a962aba-a244-446c-a2da-6429bffe28f8\") " pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:29.704759 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.704611    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mxxn\" (UniqueName: \"kubernetes.io/projected/8a962aba-a244-446c-a2da-6429bffe28f8-kube-api-access-8mxxn\") pod \"maas-controller-56c55bc4c-gt566\" (UID: \"8a962aba-a244-446c-a2da-6429bffe28f8\") " pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:29.707117 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.707099    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a962aba-a244-446c-a2da-6429bffe28f8-webhook-cert\") pod \"maas-controller-56c55bc4c-gt566\" (UID: \"8a962aba-a244-446c-a2da-6429bffe28f8\") " pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:29.713615 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.713575    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mxxn\" (UniqueName: \"kubernetes.io/projected/8a962aba-a244-446c-a2da-6429bffe28f8-kube-api-access-8mxxn\") pod \"maas-controller-56c55bc4c-gt566\" (UID: \"8a962aba-a244-446c-a2da-6429bffe28f8\") " pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:29.754912 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.754882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:29.762203 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.762174    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-768c66bff7-hnxp4"]
Jul 18 00:51:29.765755 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.765734    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:29.774463 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.774442    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-768c66bff7-hnxp4"]
Jul 18 00:51:29.805473 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.805448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5tz5\" (UniqueName: \"kubernetes.io/projected/99376782-ad3e-49b8-b800-a3999c6d4551-kube-api-access-z5tz5\") pod \"maas-controller-768c66bff7-hnxp4\" (UID: \"99376782-ad3e-49b8-b800-a3999c6d4551\") " pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:29.805604 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.805504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99376782-ad3e-49b8-b800-a3999c6d4551-webhook-cert\") pod \"maas-controller-768c66bff7-hnxp4\" (UID: \"99376782-ad3e-49b8-b800-a3999c6d4551\") " pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:29.823222 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.823181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:29.904426 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.904390    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:29.906711 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.906688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99376782-ad3e-49b8-b800-a3999c6d4551-webhook-cert\") pod \"maas-controller-768c66bff7-hnxp4\" (UID: \"99376782-ad3e-49b8-b800-a3999c6d4551\") " pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:29.906825 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.906750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5tz5\" (UniqueName: \"kubernetes.io/projected/99376782-ad3e-49b8-b800-a3999c6d4551-kube-api-access-z5tz5\") pod \"maas-controller-768c66bff7-hnxp4\" (UID: \"99376782-ad3e-49b8-b800-a3999c6d4551\") " pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:29.909340 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.909318    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99376782-ad3e-49b8-b800-a3999c6d4551-webhook-cert\") pod \"maas-controller-768c66bff7-hnxp4\" (UID: \"99376782-ad3e-49b8-b800-a3999c6d4551\") " pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:29.918459 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:29.918439    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5tz5\" (UniqueName: \"kubernetes.io/projected/99376782-ad3e-49b8-b800-a3999c6d4551-kube-api-access-z5tz5\") pod \"maas-controller-768c66bff7-hnxp4\" (UID: \"99376782-ad3e-49b8-b800-a3999c6d4551\") " pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:30.038049 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:30.038024    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c55bc4c-gt566"]
Jul 18 00:51:30.040108 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:51:30.040083    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a962aba_a244_446c_a2da_6429bffe28f8.slice/crio-6fba6e6cc352265c75c1ddae65e03a9330e82e8d26fe66ce3309dd6d6aedceee WatchSource:0}: Error finding container 6fba6e6cc352265c75c1ddae65e03a9330e82e8d26fe66ce3309dd6d6aedceee: Status 404 returned error can't find the container with id 6fba6e6cc352265c75c1ddae65e03a9330e82e8d26fe66ce3309dd6d6aedceee
Jul 18 00:51:30.076689 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:30.076658    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:30.208115 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:30.208092    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-768c66bff7-hnxp4"]
Jul 18 00:51:30.210053 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:51:30.210025    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99376782_ad3e_49b8_b800_a3999c6d4551.slice/crio-126dfa15260275b367530412d4dd5e5a860a6b8cb5fb98433e4ba10eaba32d79 WatchSource:0}: Error finding container 126dfa15260275b367530412d4dd5e5a860a6b8cb5fb98433e4ba10eaba32d79: Status 404 returned error can't find the container with id 126dfa15260275b367530412d4dd5e5a860a6b8cb5fb98433e4ba10eaba32d79
Jul 18 00:51:30.558278 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:30.558173    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768c66bff7-hnxp4" event={"ID":"99376782-ad3e-49b8-b800-a3999c6d4551","Type":"ContainerStarted","Data":"126dfa15260275b367530412d4dd5e5a860a6b8cb5fb98433e4ba10eaba32d79"}
Jul 18 00:51:30.559266 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:30.559243    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c55bc4c-gt566" event={"ID":"8a962aba-a244-446c-a2da-6429bffe28f8","Type":"ContainerStarted","Data":"6fba6e6cc352265c75c1ddae65e03a9330e82e8d26fe66ce3309dd6d6aedceee"}
Jul 18 00:51:32.963142 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:32.963059    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:33.064015 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:33.063957    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:51:33.579668 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:33.579632    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768c66bff7-hnxp4" event={"ID":"99376782-ad3e-49b8-b800-a3999c6d4551","Type":"ContainerStarted","Data":"c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879"}
Jul 18 00:51:33.579873 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:33.579751    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:33.581279 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:33.581255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c55bc4c-gt566" event={"ID":"8a962aba-a244-446c-a2da-6429bffe28f8","Type":"ContainerStarted","Data":"f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757"}
Jul 18 00:51:33.581409 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:33.581394    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:33.598228 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:33.598161    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-768c66bff7-hnxp4" podStartSLOduration=2.084533444 podStartE2EDuration="4.598143061s" totalImagesPullingTime="2.513609617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:51:33.597684806 +0000 UTC m=+667.309796093" watchObservedRunningTime="2026-07-18 00:51:33.598143061 +0000 UTC m=+667.310254346"
Jul 18 00:51:33.615648 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:33.615597    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56c55bc4c-gt566" podStartSLOduration=1.9427525669999999 podStartE2EDuration="4.61558373s" totalImagesPullingTime="2.672831163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:51:33.614302772 +0000 UTC m=+667.326414086" watchObservedRunningTime="2026-07-18 00:51:33.61558373 +0000 UTC m=+667.327695014"
Jul 18 00:51:44.590730 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:44.590697    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:51:44.591284 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:44.590897    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:44.633767 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:44.633734    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c55bc4c-gt566"]
Jul 18 00:51:44.633940 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:44.633923    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-56c55bc4c-gt566" podUID="8a962aba-a244-446c-a2da-6429bffe28f8" containerName="manager" containerID="cri-o://f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757" gracePeriod=30
Jul 18 00:51:44.881480 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:44.881454    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:44.945039 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:44.945008    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a962aba-a244-446c-a2da-6429bffe28f8-webhook-cert\") pod \"8a962aba-a244-446c-a2da-6429bffe28f8\" (UID: \"8a962aba-a244-446c-a2da-6429bffe28f8\") "
Jul 18 00:51:44.945232 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:44.945071    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mxxn\" (UniqueName: \"kubernetes.io/projected/8a962aba-a244-446c-a2da-6429bffe28f8-kube-api-access-8mxxn\") pod \"8a962aba-a244-446c-a2da-6429bffe28f8\" (UID: \"8a962aba-a244-446c-a2da-6429bffe28f8\") "
Jul 18 00:51:44.947213 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:44.947171    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a962aba-a244-446c-a2da-6429bffe28f8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8a962aba-a244-446c-a2da-6429bffe28f8" (UID: "8a962aba-a244-446c-a2da-6429bffe28f8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:51:44.947342 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:44.947319    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a962aba-a244-446c-a2da-6429bffe28f8-kube-api-access-8mxxn" (OuterVolumeSpecName: "kube-api-access-8mxxn") pod "8a962aba-a244-446c-a2da-6429bffe28f8" (UID: "8a962aba-a244-446c-a2da-6429bffe28f8"). InnerVolumeSpecName "kube-api-access-8mxxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:51:45.046658 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.046625    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a962aba-a244-446c-a2da-6429bffe28f8-webhook-cert\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:51:45.046658 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.046657    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mxxn\" (UniqueName: \"kubernetes.io/projected/8a962aba-a244-446c-a2da-6429bffe28f8-kube-api-access-8mxxn\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:51:45.636451 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.636418    2569 generic.go:356] "Generic (PLEG): container finished" podID="8a962aba-a244-446c-a2da-6429bffe28f8" containerID="f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757" exitCode=0
Jul 18 00:51:45.636890 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.636512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c55bc4c-gt566" event={"ID":"8a962aba-a244-446c-a2da-6429bffe28f8","Type":"ContainerDied","Data":"f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757"}
Jul 18 00:51:45.636890 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.636532    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c55bc4c-gt566"
Jul 18 00:51:45.636890 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.636556    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c55bc4c-gt566" event={"ID":"8a962aba-a244-446c-a2da-6429bffe28f8","Type":"ContainerDied","Data":"6fba6e6cc352265c75c1ddae65e03a9330e82e8d26fe66ce3309dd6d6aedceee"}
Jul 18 00:51:45.636890 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.636578    2569 scope.go:117] "RemoveContainer" containerID="f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757"
Jul 18 00:51:45.645160 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.645147    2569 scope.go:117] "RemoveContainer" containerID="f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757"
Jul 18 00:51:45.645422 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:51:45.645405    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757\": container with ID starting with f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757 not found: ID does not exist" containerID="f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757"
Jul 18 00:51:45.645475 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.645430    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757"} err="failed to get container status \"f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757\": rpc error: code = NotFound desc = could not find container \"f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757\": container with ID starting with f6c5852feffb602398d58206ff836d707e90ebd9fcff850f4a9158fdb12f4757 not found: ID does not exist"
Jul 18 00:51:45.656741 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.656716    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c55bc4c-gt566"]
Jul 18 00:51:45.660507 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:45.660486    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56c55bc4c-gt566"]
Jul 18 00:51:46.832603 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:51:46.832565    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a962aba-a244-446c-a2da-6429bffe28f8" path="/var/lib/kubelet/pods/8a962aba-a244-446c-a2da-6429bffe28f8/volumes"
Jul 18 00:52:04.346636 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:04.346598    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:04.923403 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:04.923364    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:04.996303 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:04.996266    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"]
Jul 18 00:52:04.996649 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:04.996638    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a962aba-a244-446c-a2da-6429bffe28f8" containerName="manager"
Jul 18 00:52:04.996693 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:04.996651    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a962aba-a244-446c-a2da-6429bffe28f8" containerName="manager"
Jul 18 00:52:04.996727 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:04.996705    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a962aba-a244-446c-a2da-6429bffe28f8" containerName="manager"
Jul 18 00:52:04.999716 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:04.999699    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.002419 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.002394    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7gcm6\""
Jul 18 00:52:05.002548 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.002436    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 00:52:05.002548 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.002439    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 18 00:52:05.003123 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.003108    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 18 00:52:05.007723 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.007703    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"]
Jul 18 00:52:05.131807 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.131776    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b42b60-c7f5-41f8-b4be-345637998ea5-openshift-service-ca\") pod \"maas-api-549d77cfc-mjxvn\" (UID: \"e7b42b60-c7f5-41f8-b4be-345637998ea5\") " pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.131987 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.131815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7b42b60-c7f5-41f8-b4be-345637998ea5-maas-api-tls\") pod \"maas-api-549d77cfc-mjxvn\" (UID: \"e7b42b60-c7f5-41f8-b4be-345637998ea5\") " pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.131987 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.131903    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwz6b\" (UniqueName: \"kubernetes.io/projected/e7b42b60-c7f5-41f8-b4be-345637998ea5-kube-api-access-vwz6b\") pod \"maas-api-549d77cfc-mjxvn\" (UID: \"e7b42b60-c7f5-41f8-b4be-345637998ea5\") " pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.194895 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.194790    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:05.232661 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.232631    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b42b60-c7f5-41f8-b4be-345637998ea5-openshift-service-ca\") pod \"maas-api-549d77cfc-mjxvn\" (UID: \"e7b42b60-c7f5-41f8-b4be-345637998ea5\") " pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.232826 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.232669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7b42b60-c7f5-41f8-b4be-345637998ea5-maas-api-tls\") pod \"maas-api-549d77cfc-mjxvn\" (UID: \"e7b42b60-c7f5-41f8-b4be-345637998ea5\") " pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.232826 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.232721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwz6b\" (UniqueName: \"kubernetes.io/projected/e7b42b60-c7f5-41f8-b4be-345637998ea5-kube-api-access-vwz6b\") pod \"maas-api-549d77cfc-mjxvn\" (UID: \"e7b42b60-c7f5-41f8-b4be-345637998ea5\") " pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.233299 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.233277    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b42b60-c7f5-41f8-b4be-345637998ea5-openshift-service-ca\") pod \"maas-api-549d77cfc-mjxvn\" (UID: \"e7b42b60-c7f5-41f8-b4be-345637998ea5\") " pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.235092 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.235071    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7b42b60-c7f5-41f8-b4be-345637998ea5-maas-api-tls\") pod \"maas-api-549d77cfc-mjxvn\" (UID: \"e7b42b60-c7f5-41f8-b4be-345637998ea5\") " pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.240683 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.240662    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwz6b\" (UniqueName: \"kubernetes.io/projected/e7b42b60-c7f5-41f8-b4be-345637998ea5-kube-api-access-vwz6b\") pod \"maas-api-549d77cfc-mjxvn\" (UID: \"e7b42b60-c7f5-41f8-b4be-345637998ea5\") " pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.311364 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.311330    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:05.357057 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.357022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:05.454630 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.454607    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"]
Jul 18 00:52:05.457566 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:52:05.457536    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b42b60_c7f5_41f8_b4be_345637998ea5.slice/crio-0f4c3c430ce55d246787693b648e98b4377cdc97f09c0760126effc833127cf8 WatchSource:0}: Error finding container 0f4c3c430ce55d246787693b648e98b4377cdc97f09c0760126effc833127cf8: Status 404 returned error can't find the container with id 0f4c3c430ce55d246787693b648e98b4377cdc97f09c0760126effc833127cf8
Jul 18 00:52:05.458052 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.458022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:05.464788 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.464766    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-xqxkf"]
Jul 18 00:52:05.469373 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.469353    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:05.471936 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.471915    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 18 00:52:05.471936 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.471928    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wvf8n\""
Jul 18 00:52:05.477264 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.477131    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-xqxkf"]
Jul 18 00:52:05.499434 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.499402    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dl6bm"]
Jul 18 00:52:05.502823 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.502807    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:05.514435 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.514410    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dl6bm"]
Jul 18 00:52:05.637270 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.637236    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68j5\" (UniqueName: \"kubernetes.io/projected/8cd20c00-2b97-406c-a073-437a4ed6f8d2-kube-api-access-x68j5\") pod \"payload-processing-58f86c7798-dl6bm\" (UID: \"8cd20c00-2b97-406c-a073-437a4ed6f8d2\") " pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:05.637439 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.637303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvw6z\" (UniqueName: \"kubernetes.io/projected/8be910a1-0957-4659-ac3b-6c7213629050-kube-api-access-nvw6z\") pod \"payload-pre-processing-7964457696-xqxkf\" (UID: \"8be910a1-0957-4659-ac3b-6c7213629050\") " pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:05.637439 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.637366    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8be910a1-0957-4659-ac3b-6c7213629050-plugins-config-volume\") pod \"payload-pre-processing-7964457696-xqxkf\" (UID: \"8be910a1-0957-4659-ac3b-6c7213629050\") " pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:05.637439 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.637436    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cd20c00-2b97-406c-a073-437a4ed6f8d2-plugins-config-volume\") pod \"payload-processing-58f86c7798-dl6bm\" (UID: \"8cd20c00-2b97-406c-a073-437a4ed6f8d2\") " pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:05.731933 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.731841    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn" event={"ID":"e7b42b60-c7f5-41f8-b4be-345637998ea5","Type":"ContainerStarted","Data":"0f4c3c430ce55d246787693b648e98b4377cdc97f09c0760126effc833127cf8"}
Jul 18 00:52:05.738394 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.738350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvw6z\" (UniqueName: \"kubernetes.io/projected/8be910a1-0957-4659-ac3b-6c7213629050-kube-api-access-nvw6z\") pod \"payload-pre-processing-7964457696-xqxkf\" (UID: \"8be910a1-0957-4659-ac3b-6c7213629050\") " pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:05.738549 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.738413    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8be910a1-0957-4659-ac3b-6c7213629050-plugins-config-volume\") pod \"payload-pre-processing-7964457696-xqxkf\" (UID: \"8be910a1-0957-4659-ac3b-6c7213629050\") " pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:05.738549 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.738486    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cd20c00-2b97-406c-a073-437a4ed6f8d2-plugins-config-volume\") pod \"payload-processing-58f86c7798-dl6bm\" (UID: \"8cd20c00-2b97-406c-a073-437a4ed6f8d2\") " pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:05.738549 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.738513    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68j5\" (UniqueName: \"kubernetes.io/projected/8cd20c00-2b97-406c-a073-437a4ed6f8d2-kube-api-access-x68j5\") pod \"payload-processing-58f86c7798-dl6bm\" (UID: \"8cd20c00-2b97-406c-a073-437a4ed6f8d2\") " pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:05.739227 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.739187    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8be910a1-0957-4659-ac3b-6c7213629050-plugins-config-volume\") pod \"payload-pre-processing-7964457696-xqxkf\" (UID: \"8be910a1-0957-4659-ac3b-6c7213629050\") " pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:05.739227 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.739188    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cd20c00-2b97-406c-a073-437a4ed6f8d2-plugins-config-volume\") pod \"payload-processing-58f86c7798-dl6bm\" (UID: \"8cd20c00-2b97-406c-a073-437a4ed6f8d2\") " pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:05.746067 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.746038    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68j5\" (UniqueName: \"kubernetes.io/projected/8cd20c00-2b97-406c-a073-437a4ed6f8d2-kube-api-access-x68j5\") pod \"payload-processing-58f86c7798-dl6bm\" (UID: \"8cd20c00-2b97-406c-a073-437a4ed6f8d2\") " pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:05.746210 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.746130    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvw6z\" (UniqueName: \"kubernetes.io/projected/8be910a1-0957-4659-ac3b-6c7213629050-kube-api-access-nvw6z\") pod \"payload-pre-processing-7964457696-xqxkf\" (UID: \"8be910a1-0957-4659-ac3b-6c7213629050\") " pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:05.781692 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.781665    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:05.814606 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.814572    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:05.926437 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.926406    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-xqxkf"]
Jul 18 00:52:05.929990 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:52:05.929950    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be910a1_0957_4659_ac3b_6c7213629050.slice/crio-c89f6cb7382364ff5ecd9b4b1c1e98cce6620b4de1bbc0184b9f42436f692f31 WatchSource:0}: Error finding container c89f6cb7382364ff5ecd9b4b1c1e98cce6620b4de1bbc0184b9f42436f692f31: Status 404 returned error can't find the container with id c89f6cb7382364ff5ecd9b4b1c1e98cce6620b4de1bbc0184b9f42436f692f31
Jul 18 00:52:05.966130 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:05.966103    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dl6bm"]
Jul 18 00:52:05.968528 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:52:05.968500    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd20c00_2b97_406c_a073_437a4ed6f8d2.slice/crio-89b24d3b04bf4a0ec48eab423f08839a49b770a6a2a8c975f28fafc794d72b49 WatchSource:0}: Error finding container 89b24d3b04bf4a0ec48eab423f08839a49b770a6a2a8c975f28fafc794d72b49: Status 404 returned error can't find the container with id 89b24d3b04bf4a0ec48eab423f08839a49b770a6a2a8c975f28fafc794d72b49
Jul 18 00:52:06.740389 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:06.740310    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dl6bm" event={"ID":"8cd20c00-2b97-406c-a073-437a4ed6f8d2","Type":"ContainerStarted","Data":"89b24d3b04bf4a0ec48eab423f08839a49b770a6a2a8c975f28fafc794d72b49"}
Jul 18 00:52:06.742119 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:06.742087    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf" event={"ID":"8be910a1-0957-4659-ac3b-6c7213629050","Type":"ContainerStarted","Data":"c89f6cb7382364ff5ecd9b4b1c1e98cce6620b4de1bbc0184b9f42436f692f31"}
Jul 18 00:52:06.986140 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:06.986115    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:07.087277 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.087182    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:07.748866 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.748826    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dl6bm" event={"ID":"8cd20c00-2b97-406c-a073-437a4ed6f8d2","Type":"ContainerStarted","Data":"76efc37987462faeafc7ec6e65093fa9e840b55b01797bc5666d12b288956440"}
Jul 18 00:52:07.749338 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.748900    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:07.750306 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.750284    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn" event={"ID":"e7b42b60-c7f5-41f8-b4be-345637998ea5","Type":"ContainerStarted","Data":"e23c7039f8926014e01b014ae3d413c33725c11bf5894336ef5936d0112b3b74"}
Jul 18 00:52:07.750386 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.750334    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:07.751719 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.751693    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf" event={"ID":"8be910a1-0957-4659-ac3b-6c7213629050","Type":"ContainerStarted","Data":"2dee1c955f2aab85958ffc15698ee9865a8d7b7694be7cd12271223a4c5c44f9"}
Jul 18 00:52:07.752250 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.752159    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:07.766694 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.766638    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-dl6bm" podStartSLOduration=1.417011006 podStartE2EDuration="2.766623108s" totalImagesPullingTime="1.349612102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:52:07.7642417 +0000 UTC m=+701.476352981" watchObservedRunningTime="2026-07-18 00:52:07.766623108 +0000 UTC m=+701.478734392"
Jul 18 00:52:07.781103 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.781062    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf" podStartSLOduration=1.3909891220000001 podStartE2EDuration="2.781046946s" totalImagesPullingTime="1.390057824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:52:07.779645921 +0000 UTC m=+701.491757207" watchObservedRunningTime="2026-07-18 00:52:07.781046946 +0000 UTC m=+701.493158230"
Jul 18 00:52:07.798089 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:07.798037    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn" podStartSLOduration=2.3292139 podStartE2EDuration="3.798020492s" totalImagesPullingTime="1.468806592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:52:07.797375088 +0000 UTC m=+701.509486377" watchObservedRunningTime="2026-07-18 00:52:07.798020492 +0000 UTC m=+701.510131778"
Jul 18 00:52:13.762271 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:13.762243    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-549d77cfc-mjxvn"
Jul 18 00:52:14.718575 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:14.718534    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:14.817431 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:14.817398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:18.760080 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:18.760054    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-dl6bm"
Jul 18 00:52:18.760587 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:18.760172    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-xqxkf"
Jul 18 00:52:27.450645 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:27.450611    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:35.021455 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.021420    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"]
Jul 18 00:52:35.026648 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.026624    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.029510 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.029487    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 00:52:35.030544 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.030520    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q8kn7\""
Jul 18 00:52:35.030669 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.030525    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 00:52:35.030669 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.030584    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 18 00:52:35.037178 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.037156    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"]
Jul 18 00:52:35.058256 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.058229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:35.101588 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.101550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.101588 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.101586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70836de2-1b22-46ae-a301-a37ac894eb45-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.101829 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.101649    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.101829 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.101767    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.102004 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.101847    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbhmr\" (UniqueName: \"kubernetes.io/projected/70836de2-1b22-46ae-a301-a37ac894eb45-kube-api-access-qbhmr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.102004 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.101924    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.202521 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.202486    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.202686 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.202547    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.202686 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.202589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbhmr\" (UniqueName: \"kubernetes.io/projected/70836de2-1b22-46ae-a301-a37ac894eb45-kube-api-access-qbhmr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.202686 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.202650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.202844 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.202692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.202844 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.202717    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70836de2-1b22-46ae-a301-a37ac894eb45-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.202981 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.202954    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.203124 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.202990    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.203124 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.203089    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.204920 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.204899    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70836de2-1b22-46ae-a301-a37ac894eb45-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.205267 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.205249    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70836de2-1b22-46ae-a301-a37ac894eb45-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.209794 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.209773    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbhmr\" (UniqueName: \"kubernetes.io/projected/70836de2-1b22-46ae-a301-a37ac894eb45-kube-api-access-qbhmr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqtdx\" (UID: \"70836de2-1b22-46ae-a301-a37ac894eb45\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.338184 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.338079    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:35.483293 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:52:35.483259    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70836de2_1b22_46ae_a301_a37ac894eb45.slice/crio-52c0e4e6159cf008975e458eef1d24d5c2a6a959b082a83dfb9fb313e7628cb9 WatchSource:0}: Error finding container 52c0e4e6159cf008975e458eef1d24d5c2a6a959b082a83dfb9fb313e7628cb9: Status 404 returned error can't find the container with id 52c0e4e6159cf008975e458eef1d24d5c2a6a959b082a83dfb9fb313e7628cb9
Jul 18 00:52:35.491562 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.491536    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"]
Jul 18 00:52:35.888606 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:35.888564    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx" event={"ID":"70836de2-1b22-46ae-a301-a37ac894eb45","Type":"ContainerStarted","Data":"52c0e4e6159cf008975e458eef1d24d5c2a6a959b082a83dfb9fb313e7628cb9"}
Jul 18 00:52:36.894305 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:36.894270    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx" event={"ID":"70836de2-1b22-46ae-a301-a37ac894eb45","Type":"ContainerStarted","Data":"9c89735ae6e3d1493a4b81c1404ade0a256fd44cba588b8b9cb1d8e08c17cf3b"}
Jul 18 00:52:36.911682 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:36.911629    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx" podStartSLOduration=0.92389069 podStartE2EDuration="1.91161327s" totalImagesPullingTime="987.72258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:52:36.910093668 +0000 UTC m=+730.622204953" watchObservedRunningTime="2026-07-18 00:52:36.91161327 +0000 UTC m=+730.623724555"
Jul 18 00:52:40.915164 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:40.915126    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"]
Jul 18 00:52:40.918692 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:40.918673    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:40.921379 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:40.921356    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 18 00:52:40.927476 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:40.927449    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"]
Jul 18 00:52:40.936558 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:40.936527    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:41.059508 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.059454    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.059508 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.059515    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.059776 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.059572    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eac6af4-abba-4def-8df5-517be62bac26-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.059776 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.059640    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.059776 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.059703    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9lq8\" (UniqueName: \"kubernetes.io/projected/3eac6af4-abba-4def-8df5-517be62bac26-kube-api-access-g9lq8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.059776 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.059728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.161058 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.161022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.161058 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.161065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.161343 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.161109    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eac6af4-abba-4def-8df5-517be62bac26-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.161343 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.161138    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.161343 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.161250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9lq8\" (UniqueName: \"kubernetes.io/projected/3eac6af4-abba-4def-8df5-517be62bac26-kube-api-access-g9lq8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.161343 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.161284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.161571 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.161520    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.161571 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.161555    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.161683 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.161587    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.163755 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.163721    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eac6af4-abba-4def-8df5-517be62bac26-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.163962 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.163945    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eac6af4-abba-4def-8df5-517be62bac26-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.168587 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.168540    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9lq8\" (UniqueName: \"kubernetes.io/projected/3eac6af4-abba-4def-8df5-517be62bac26-kube-api-access-g9lq8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9whr7\" (UID: \"3eac6af4-abba-4def-8df5-517be62bac26\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.230554 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.230525    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:41.363118 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.363091    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"]
Jul 18 00:52:41.365293 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:52:41.365265    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eac6af4_abba_4def_8df5_517be62bac26.slice/crio-031173b2172570647f3d1300f78afe800e162f8d762f8c4082b11525e2c7b7ed WatchSource:0}: Error finding container 031173b2172570647f3d1300f78afe800e162f8d762f8c4082b11525e2c7b7ed: Status 404 returned error can't find the container with id 031173b2172570647f3d1300f78afe800e162f8d762f8c4082b11525e2c7b7ed
Jul 18 00:52:41.920441 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.920400    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7" event={"ID":"3eac6af4-abba-4def-8df5-517be62bac26","Type":"ContainerStarted","Data":"fde8fb3e20013bc4a0e9a217186070a9dd85b3e892f9f3447f1ab38a5bb482ce"}
Jul 18 00:52:41.920811 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.920462    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7" event={"ID":"3eac6af4-abba-4def-8df5-517be62bac26","Type":"ContainerStarted","Data":"031173b2172570647f3d1300f78afe800e162f8d762f8c4082b11525e2c7b7ed"}
Jul 18 00:52:41.939187 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:41.939138    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7" podStartSLOduration=1.790147212 podStartE2EDuration="1.939123664s" totalImagesPullingTime="148.976452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:52:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:52:41.937705372 +0000 UTC m=+735.649816692" watchObservedRunningTime="2026-07-18 00:52:41.939123664 +0000 UTC m=+735.651234948"
Jul 18 00:52:45.152680 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:45.152640    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:52:45.338204 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:45.338169    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:45.338349 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:45.338245    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:45.350925 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:45.350899    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:45.957297 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:45.957265    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqtdx"
Jul 18 00:52:51.231357 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:51.231318    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:51.231822 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:51.231413    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:51.244052 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:51.244033    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:52:51.981571 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:52:51.981538    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9whr7"
Jul 18 00:53:04.157657 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:04.157618    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:53:24.407024 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.406987    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"]
Jul 18 00:53:24.411456 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.411433    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.413851 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.413827    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 18 00:53:24.418999 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.418969    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"]
Jul 18 00:53:24.435778 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.435744    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:53:24.570334 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.570300    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.570511 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.570343    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.570511 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.570447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.570511 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.570487    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h97g5\" (UniqueName: \"kubernetes.io/projected/c517d99b-3afd-424f-9437-d23f13c8ff2d-kube-api-access-h97g5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.570616 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.570526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.570616 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.570600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c517d99b-3afd-424f-9437-d23f13c8ff2d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.671404 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.671321    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.671404 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.671373    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c517d99b-3afd-424f-9437-d23f13c8ff2d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.671598 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.671416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.671598 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.671439    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.671598 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.671505    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.671598 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.671536    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h97g5\" (UniqueName: \"kubernetes.io/projected/c517d99b-3afd-424f-9437-d23f13c8ff2d-kube-api-access-h97g5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.671812 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.671773    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.671812 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.671792    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.671925 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.671896    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.673786 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.673765    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c517d99b-3afd-424f-9437-d23f13c8ff2d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.674071 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.674052    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c517d99b-3afd-424f-9437-d23f13c8ff2d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.678923 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.678901    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h97g5\" (UniqueName: \"kubernetes.io/projected/c517d99b-3afd-424f-9437-d23f13c8ff2d-kube-api-access-h97g5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cvqgk\" (UID: \"c517d99b-3afd-424f-9437-d23f13c8ff2d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.724112 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.724074    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:24.860421 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.860394    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"]
Jul 18 00:53:24.862395 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:53:24.862358    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc517d99b_3afd_424f_9437_d23f13c8ff2d.slice/crio-a7d33b2a0f1cece8c8e8f580828f025468a932bcb932842ccc3506c3f728ab5f WatchSource:0}: Error finding container a7d33b2a0f1cece8c8e8f580828f025468a932bcb932842ccc3506c3f728ab5f: Status 404 returned error can't find the container with id a7d33b2a0f1cece8c8e8f580828f025468a932bcb932842ccc3506c3f728ab5f
Jul 18 00:53:24.864033 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:24.864016    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 00:53:25.142922 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:25.142886    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk" event={"ID":"c517d99b-3afd-424f-9437-d23f13c8ff2d","Type":"ContainerStarted","Data":"faf1ad4e99dd26fc7a4ca39628660fd5f35b398c2023ee831dd9da1a71820cfb"}
Jul 18 00:53:25.143100 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:25.142948    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk" event={"ID":"c517d99b-3afd-424f-9437-d23f13c8ff2d","Type":"ContainerStarted","Data":"a7d33b2a0f1cece8c8e8f580828f025468a932bcb932842ccc3506c3f728ab5f"}
Jul 18 00:53:25.160110 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:25.159935    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk" podStartSLOduration=0.980968239 podStartE2EDuration="1.159912682s" totalImagesPullingTime="178.944443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:53:25.159518323 +0000 UTC m=+778.871629630" watchObservedRunningTime="2026-07-18 00:53:25.159912682 +0000 UTC m=+778.872023967"
Jul 18 00:53:28.935674 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:28.935637    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:53:34.724638 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:34.724601    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:34.725143 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:34.724685    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:34.737021 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:34.736997    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:35.211453 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:35.211421    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cvqgk"
Jul 18 00:53:39.345524 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:53:39.345493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:54:43.846427 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:54:43.846379    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:54:44.927575 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:54:44.927537    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:54:45.022639 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:54:45.022598    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:54:59.013527 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:54:59.013488    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:54:59.397734 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:54:59.397703    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:54:59.457319 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:54:59.457270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:55:26.688125 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:26.688096    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:55:26.689986 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:26.689967    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 00:55:55.031735 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.031699    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:55:55.135908 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.135869    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-768c66bff7-hnxp4"]
Jul 18 00:55:55.136165 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.136129    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-768c66bff7-hnxp4" podUID="99376782-ad3e-49b8-b800-a3999c6d4551" containerName="manager" containerID="cri-o://c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879" gracePeriod=30
Jul 18 00:55:55.387757 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.387731    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:55:55.499982 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.499951    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99376782-ad3e-49b8-b800-a3999c6d4551-webhook-cert\") pod \"99376782-ad3e-49b8-b800-a3999c6d4551\" (UID: \"99376782-ad3e-49b8-b800-a3999c6d4551\") "
Jul 18 00:55:55.500182 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.499992    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5tz5\" (UniqueName: \"kubernetes.io/projected/99376782-ad3e-49b8-b800-a3999c6d4551-kube-api-access-z5tz5\") pod \"99376782-ad3e-49b8-b800-a3999c6d4551\" (UID: \"99376782-ad3e-49b8-b800-a3999c6d4551\") "
Jul 18 00:55:55.502140 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.502102    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99376782-ad3e-49b8-b800-a3999c6d4551-kube-api-access-z5tz5" (OuterVolumeSpecName: "kube-api-access-z5tz5") pod "99376782-ad3e-49b8-b800-a3999c6d4551" (UID: "99376782-ad3e-49b8-b800-a3999c6d4551"). InnerVolumeSpecName "kube-api-access-z5tz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:55:55.502140 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.502114    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99376782-ad3e-49b8-b800-a3999c6d4551-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "99376782-ad3e-49b8-b800-a3999c6d4551" (UID: "99376782-ad3e-49b8-b800-a3999c6d4551"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:55:55.601158 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.601130    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99376782-ad3e-49b8-b800-a3999c6d4551-webhook-cert\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:55:55.601158 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.601157    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5tz5\" (UniqueName: \"kubernetes.io/projected/99376782-ad3e-49b8-b800-a3999c6d4551-kube-api-access-z5tz5\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 00:55:55.904138 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.904051    2569 generic.go:356] "Generic (PLEG): container finished" podID="99376782-ad3e-49b8-b800-a3999c6d4551" containerID="c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879" exitCode=0
Jul 18 00:55:55.904138 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.904097    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768c66bff7-hnxp4"
Jul 18 00:55:55.904348 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.904136    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768c66bff7-hnxp4" event={"ID":"99376782-ad3e-49b8-b800-a3999c6d4551","Type":"ContainerDied","Data":"c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879"}
Jul 18 00:55:55.904348 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.904225    2569 scope.go:117] "RemoveContainer" containerID="c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879"
Jul 18 00:55:55.904348 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.904229    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768c66bff7-hnxp4" event={"ID":"99376782-ad3e-49b8-b800-a3999c6d4551","Type":"ContainerDied","Data":"126dfa15260275b367530412d4dd5e5a860a6b8cb5fb98433e4ba10eaba32d79"}
Jul 18 00:55:55.913904 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.913885    2569 scope.go:117] "RemoveContainer" containerID="c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879"
Jul 18 00:55:55.914168 ip-10-0-142-221 kubenswrapper[2569]: E0718 00:55:55.914150    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879\": container with ID starting with c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879 not found: ID does not exist" containerID="c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879"
Jul 18 00:55:55.914249 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.914176    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879"} err="failed to get container status \"c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879\": rpc error: code = NotFound desc = could not find container \"c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879\": container with ID starting with c810b04757bdbb2c297cf88f9bd35c7f9054eab12152fe9d97420092e9c3a879 not found: ID does not exist"
Jul 18 00:55:55.924921 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.924899    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-768c66bff7-hnxp4"]
Jul 18 00:55:55.928772 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:55.928750    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-768c66bff7-hnxp4"]
Jul 18 00:55:56.569114 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.569079    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:55:56.682923 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.682891    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-768c66bff7-7z6n4"]
Jul 18 00:55:56.683410 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.683388    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99376782-ad3e-49b8-b800-a3999c6d4551" containerName="manager"
Jul 18 00:55:56.683410 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.683411    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="99376782-ad3e-49b8-b800-a3999c6d4551" containerName="manager"
Jul 18 00:55:56.683609 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.683531    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="99376782-ad3e-49b8-b800-a3999c6d4551" containerName="manager"
Jul 18 00:55:56.687894 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.687875    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:55:56.690914 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.690885    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 18 00:55:56.691021 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.690902    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 18 00:55:56.691021 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.690929    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2lpjj\""
Jul 18 00:55:56.694880 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.694858    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-768c66bff7-7z6n4"]
Jul 18 00:55:56.810782 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.810748    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a28317cd-a353-472f-a53b-2d50a1c29094-webhook-cert\") pod \"maas-controller-768c66bff7-7z6n4\" (UID: \"a28317cd-a353-472f-a53b-2d50a1c29094\") " pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:55:56.810947 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.810864    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjm6s\" (UniqueName: \"kubernetes.io/projected/a28317cd-a353-472f-a53b-2d50a1c29094-kube-api-access-xjm6s\") pod \"maas-controller-768c66bff7-7z6n4\" (UID: \"a28317cd-a353-472f-a53b-2d50a1c29094\") " pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:55:56.832785 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.832723    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99376782-ad3e-49b8-b800-a3999c6d4551" path="/var/lib/kubelet/pods/99376782-ad3e-49b8-b800-a3999c6d4551/volumes"
Jul 18 00:55:56.911522 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.911486    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjm6s\" (UniqueName: \"kubernetes.io/projected/a28317cd-a353-472f-a53b-2d50a1c29094-kube-api-access-xjm6s\") pod \"maas-controller-768c66bff7-7z6n4\" (UID: \"a28317cd-a353-472f-a53b-2d50a1c29094\") " pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:55:56.911695 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.911552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a28317cd-a353-472f-a53b-2d50a1c29094-webhook-cert\") pod \"maas-controller-768c66bff7-7z6n4\" (UID: \"a28317cd-a353-472f-a53b-2d50a1c29094\") " pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:55:56.914431 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.914406    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a28317cd-a353-472f-a53b-2d50a1c29094-webhook-cert\") pod \"maas-controller-768c66bff7-7z6n4\" (UID: \"a28317cd-a353-472f-a53b-2d50a1c29094\") " pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:55:56.921623 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:56.921598    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjm6s\" (UniqueName: \"kubernetes.io/projected/a28317cd-a353-472f-a53b-2d50a1c29094-kube-api-access-xjm6s\") pod \"maas-controller-768c66bff7-7z6n4\" (UID: \"a28317cd-a353-472f-a53b-2d50a1c29094\") " pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:55:57.000496 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:57.000465    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:55:57.131187 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:57.131162    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-768c66bff7-7z6n4"]
Jul 18 00:55:57.133182 ip-10-0-142-221 kubenswrapper[2569]: W0718 00:55:57.133152    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28317cd_a353_472f_a53b_2d50a1c29094.slice/crio-29a994cd1fb0d643f0cd57860779e3aa1d762d9c1a68ef49d9688a35d070b079 WatchSource:0}: Error finding container 29a994cd1fb0d643f0cd57860779e3aa1d762d9c1a68ef49d9688a35d070b079: Status 404 returned error can't find the container with id 29a994cd1fb0d643f0cd57860779e3aa1d762d9c1a68ef49d9688a35d070b079
Jul 18 00:55:57.917772 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:57.917738    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768c66bff7-7z6n4" event={"ID":"a28317cd-a353-472f-a53b-2d50a1c29094","Type":"ContainerStarted","Data":"8017f3ed95f410c8e99ded5c9a4ab1e6bfbff18f6464a418b8d5f48139eb10b6"}
Jul 18 00:55:57.918254 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:57.917790    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768c66bff7-7z6n4" event={"ID":"a28317cd-a353-472f-a53b-2d50a1c29094","Type":"ContainerStarted","Data":"29a994cd1fb0d643f0cd57860779e3aa1d762d9c1a68ef49d9688a35d070b079"}
Jul 18 00:55:57.918254 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:57.917887    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:55:57.936451 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:55:57.936401    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-768c66bff7-7z6n4" podStartSLOduration=1.274808673 podStartE2EDuration="1.936385364s" totalImagesPullingTime="661.576691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:57.935296395 +0000 UTC m=+931.647407677" watchObservedRunningTime="2026-07-18 00:55:57.936385364 +0000 UTC m=+931.648496649"
Jul 18 00:56:08.929970 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:08.929936    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-768c66bff7-7z6n4"
Jul 18 00:56:37.171260 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:37.171228    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:56:37.268387 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:37.268346    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:56:37.376468 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:37.376430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:56:43.147781 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:43.147746    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:56:43.257462 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:43.257412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:56:43.347720 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:43.347683    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:56:43.469530 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:43.469431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:56:49.089692 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:49.089604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:56:49.154746 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:56:49.154714    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:57:40.935620 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:57:40.935558    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:57:40.987663 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:57:40.987626    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:59:42.572244 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:59:42.572188    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 00:59:42.660360 ip-10-0-142-221 kubenswrapper[2569]: I0718 00:59:42.660322    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:00:00.145423 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:00.145334    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"]
Jul 18 01:00:00.149141 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:00.149117    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"
Jul 18 01:00:00.163473 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:00.163436    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs5t5\" (UniqueName: \"kubernetes.io/projected/cd5f294e-5e54-4728-977f-2da65802afdf-kube-api-access-bs5t5\") pod \"maas-api-key-cleanup-29738940-5vs58\" (UID: \"cd5f294e-5e54-4728-977f-2da65802afdf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"
Jul 18 01:00:00.166806 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:00.166782    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"]
Jul 18 01:00:00.264765 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:00.264732    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs5t5\" (UniqueName: \"kubernetes.io/projected/cd5f294e-5e54-4728-977f-2da65802afdf-kube-api-access-bs5t5\") pod \"maas-api-key-cleanup-29738940-5vs58\" (UID: \"cd5f294e-5e54-4728-977f-2da65802afdf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"
Jul 18 01:00:00.277482 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:00.277449    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs5t5\" (UniqueName: \"kubernetes.io/projected/cd5f294e-5e54-4728-977f-2da65802afdf-kube-api-access-bs5t5\") pod \"maas-api-key-cleanup-29738940-5vs58\" (UID: \"cd5f294e-5e54-4728-977f-2da65802afdf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"
Jul 18 01:00:00.459804 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:00.459717    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"
Jul 18 01:00:00.594325 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:00.594225    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"]
Jul 18 01:00:00.600366 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:00.600344    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:00:01.126259 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:01.126221    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58" event={"ID":"cd5f294e-5e54-4728-977f-2da65802afdf","Type":"ContainerStarted","Data":"081f23a29251f95fb353038f531b8af3d8c48fac7ac55ae9adaa90cfae7183e8"}
Jul 18 01:00:26.916644 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:26.916614    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:00:26.917175 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:26.916856    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:00:27.058383 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:27.058350    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:00:28.264294 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:28.264258    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58" event={"ID":"cd5f294e-5e54-4728-977f-2da65802afdf","Type":"ContainerStarted","Data":"41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3"}
Jul 18 01:00:28.281528 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:28.281481    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58" podStartSLOduration=1.931487872 podStartE2EDuration="28.281464729s" totalImagesPullingTime="26.349976857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:28.279467903 +0000 UTC m=+1201.991579187" watchObservedRunningTime="2026-07-18 01:00:28.281464729 +0000 UTC m=+1201.993576014"
Jul 18 01:00:29.474257 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:00:29.474222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:01:00.010966 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:00.010930    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"]
Jul 18 01:01:00.011488 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:00.011151    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58" podUID="cd5f294e-5e54-4728-977f-2da65802afdf" containerName="cleanup" containerID="cri-o://41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3" gracePeriod=30
Jul 18 01:01:30.195616 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.195583    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"
Jul 18 01:01:30.348370 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.348337    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs5t5\" (UniqueName: \"kubernetes.io/projected/cd5f294e-5e54-4728-977f-2da65802afdf-kube-api-access-bs5t5\") pod \"cd5f294e-5e54-4728-977f-2da65802afdf\" (UID: \"cd5f294e-5e54-4728-977f-2da65802afdf\") "
Jul 18 01:01:30.350550 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.350522    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd5f294e-5e54-4728-977f-2da65802afdf-kube-api-access-bs5t5" (OuterVolumeSpecName: "kube-api-access-bs5t5") pod "cd5f294e-5e54-4728-977f-2da65802afdf" (UID: "cd5f294e-5e54-4728-977f-2da65802afdf"). InnerVolumeSpecName "kube-api-access-bs5t5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:01:30.450005 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.449969    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs5t5\" (UniqueName: \"kubernetes.io/projected/cd5f294e-5e54-4728-977f-2da65802afdf-kube-api-access-bs5t5\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:01:30.586381 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.586335    2569 generic.go:356] "Generic (PLEG): container finished" podID="cd5f294e-5e54-4728-977f-2da65802afdf" containerID="41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3" exitCode=137
Jul 18 01:01:30.586547 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.586390    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"
Jul 18 01:01:30.586547 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.586418    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58" event={"ID":"cd5f294e-5e54-4728-977f-2da65802afdf","Type":"ContainerDied","Data":"41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3"}
Jul 18 01:01:30.586547 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.586478    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58" event={"ID":"cd5f294e-5e54-4728-977f-2da65802afdf","Type":"ContainerDied","Data":"081f23a29251f95fb353038f531b8af3d8c48fac7ac55ae9adaa90cfae7183e8"}
Jul 18 01:01:30.586547 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.586509    2569 scope.go:117] "RemoveContainer" containerID="41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3"
Jul 18 01:01:30.596349 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.596330    2569 scope.go:117] "RemoveContainer" containerID="41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3"
Jul 18 01:01:30.596598 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:01:30.596578    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3\": container with ID starting with 41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3 not found: ID does not exist" containerID="41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3"
Jul 18 01:01:30.596646 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.596607    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3"} err="failed to get container status \"41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3\": rpc error: code = NotFound desc = could not find container \"41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3\": container with ID starting with 41cd96a6d886ba80065e59e7af468c89998abc8c674bcca799b390be5f74b7f3 not found: ID does not exist"
Jul 18 01:01:30.609694 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.609624    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"]
Jul 18 01:01:30.612079 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.612058    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738940-5vs58"]
Jul 18 01:01:30.832485 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:01:30.832453    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd5f294e-5e54-4728-977f-2da65802afdf" path="/var/lib/kubelet/pods/cd5f294e-5e54-4728-977f-2da65802afdf/volumes"
Jul 18 01:02:44.803120 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:02:44.803089    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:04:50.519693 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:04:50.519615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:05:26.952792 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:05:26.952766    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:05:26.953367 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:05:26.952835    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:07:45.927579 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:07:45.927499    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:07:53.355147 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:07:53.355108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:01.643370 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:01.643334    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:06.754559 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:06.754521    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:09.647245 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:09.647210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:09.745409 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:09.745373    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:10.107290 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:10.107254    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:15.619018 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:15.618983    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:15.726129 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:15.726096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:15.823285 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:15.823251    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:15.919513 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:15.919406    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:17.015638 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.015577    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:17.113564 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.113528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:17.230764 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.230730    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"]
Jul 18 01:08:17.231368 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.231344    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5f294e-5e54-4728-977f-2da65802afdf" containerName="cleanup"
Jul 18 01:08:17.231368 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.231367    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5f294e-5e54-4728-977f-2da65802afdf" containerName="cleanup"
Jul 18 01:08:17.231539 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.231454    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd5f294e-5e54-4728-977f-2da65802afdf" containerName="cleanup"
Jul 18 01:08:17.234639 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.234622    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.237132 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.237112    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-89911758-serving-cert\""
Jul 18 01:08:17.243728 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.243705    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"]
Jul 18 01:08:17.259347 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.259316    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:17.354864 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.354826    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac6f913-1ff3-408b-99e6-80c52da200ae-maas-api-tls\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.355064 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.354896    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jjsj\" (UniqueName: \"kubernetes.io/projected/bac6f913-1ff3-408b-99e6-80c52da200ae-kube-api-access-8jjsj\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.355064 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.354924    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac6f913-1ff3-408b-99e6-80c52da200ae-openshift-service-ca\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.456050 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.456013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac6f913-1ff3-408b-99e6-80c52da200ae-maas-api-tls\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.456270 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.456173    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jjsj\" (UniqueName: \"kubernetes.io/projected/bac6f913-1ff3-408b-99e6-80c52da200ae-kube-api-access-8jjsj\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.456270 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:08:17.456217    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-89911758-serving-cert: secret "maas-api-e2e-ait-89911758-serving-cert" not found
Jul 18 01:08:17.456270 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.456226    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac6f913-1ff3-408b-99e6-80c52da200ae-openshift-service-ca\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.456460 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:08:17.456322    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bac6f913-1ff3-408b-99e6-80c52da200ae-maas-api-tls podName:bac6f913-1ff3-408b-99e6-80c52da200ae nodeName:}" failed. No retries permitted until 2026-07-18 01:08:17.956299111 +0000 UTC m=+1671.668410387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bac6f913-1ff3-408b-99e6-80c52da200ae-maas-api-tls") pod "maas-api-e2e-ait-89911758-79dc87df44-htvs2" (UID: "bac6f913-1ff3-408b-99e6-80c52da200ae") : secret "maas-api-e2e-ait-89911758-serving-cert" not found
Jul 18 01:08:17.457095 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.457075    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac6f913-1ff3-408b-99e6-80c52da200ae-openshift-service-ca\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.464262 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.464233    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jjsj\" (UniqueName: \"kubernetes.io/projected/bac6f913-1ff3-408b-99e6-80c52da200ae-kube-api-access-8jjsj\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.645500 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.645408    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:17.848925 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.848894    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:17.920790 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.920531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:17.961137 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.961096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac6f913-1ff3-408b-99e6-80c52da200ae-maas-api-tls\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:17.963781 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:17.963749    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac6f913-1ff3-408b-99e6-80c52da200ae-maas-api-tls\") pod \"maas-api-e2e-ait-89911758-79dc87df44-htvs2\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:18.146378 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:18.146340    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:18.285933 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:18.285902    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"]
Jul 18 01:08:18.288553 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:08:18.288527    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac6f913_1ff3_408b_99e6_80c52da200ae.slice/crio-64465a4c9cd75b445775a0f757c8e9261c91a698c81f79dbad54edca467b17bb WatchSource:0}: Error finding container 64465a4c9cd75b445775a0f757c8e9261c91a698c81f79dbad54edca467b17bb: Status 404 returned error can't find the container with id 64465a4c9cd75b445775a0f757c8e9261c91a698c81f79dbad54edca467b17bb
Jul 18 01:08:18.290057 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:18.290036    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:08:18.647208 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:18.647166    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2" event={"ID":"bac6f913-1ff3-408b-99e6-80c52da200ae","Type":"ContainerStarted","Data":"64465a4c9cd75b445775a0f757c8e9261c91a698c81f79dbad54edca467b17bb"}
Jul 18 01:08:19.654287 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:19.654253    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2" event={"ID":"bac6f913-1ff3-408b-99e6-80c52da200ae","Type":"ContainerStarted","Data":"4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c"}
Jul 18 01:08:19.654672 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:19.654369    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:19.670863 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:19.670806    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2" podStartSLOduration=2.164221682 podStartE2EDuration="2.670789244s" totalImagesPullingTime="506.567562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:08:19.669021454 +0000 UTC m=+1673.381132740" watchObservedRunningTime="2026-07-18 01:08:19.670789244 +0000 UTC m=+1673.382900568"
Jul 18 01:08:19.746710 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:19.746678    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:22.029614 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.029579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:22.230475 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.230438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:22.327491 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.327411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:22.358274 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.358238    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"]
Jul 18 01:08:22.358515 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.358481    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2" podUID="bac6f913-1ff3-408b-99e6-80c52da200ae" containerName="maas-api" containerID="cri-o://4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c" gracePeriod=30
Jul 18 01:08:22.389113 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.389087    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:22.617018 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.616994    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:22.673003 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.672973    2569 generic.go:356] "Generic (PLEG): container finished" podID="bac6f913-1ff3-408b-99e6-80c52da200ae" containerID="4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c" exitCode=0
Jul 18 01:08:22.673162 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.673002    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2" event={"ID":"bac6f913-1ff3-408b-99e6-80c52da200ae","Type":"ContainerDied","Data":"4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c"}
Jul 18 01:08:22.673162 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.673015    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"
Jul 18 01:08:22.673162 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.673061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2" event={"ID":"bac6f913-1ff3-408b-99e6-80c52da200ae","Type":"ContainerDied","Data":"64465a4c9cd75b445775a0f757c8e9261c91a698c81f79dbad54edca467b17bb"}
Jul 18 01:08:22.673162 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.673092    2569 scope.go:117] "RemoveContainer" containerID="4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c"
Jul 18 01:08:22.681675 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.681658    2569 scope.go:117] "RemoveContainer" containerID="4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c"
Jul 18 01:08:22.681921 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:08:22.681904    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c\": container with ID starting with 4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c not found: ID does not exist" containerID="4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c"
Jul 18 01:08:22.682001 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.681932    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c"} err="failed to get container status \"4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c\": rpc error: code = NotFound desc = could not find container \"4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c\": container with ID starting with 4c8657e70922e81cc164134826e0820633240d1479be3a15a2da7be39d83f75c not found: ID does not exist"
Jul 18 01:08:22.705397 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.705373    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jjsj\" (UniqueName: \"kubernetes.io/projected/bac6f913-1ff3-408b-99e6-80c52da200ae-kube-api-access-8jjsj\") pod \"bac6f913-1ff3-408b-99e6-80c52da200ae\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") "
Jul 18 01:08:22.705502 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.705466    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac6f913-1ff3-408b-99e6-80c52da200ae-openshift-service-ca\") pod \"bac6f913-1ff3-408b-99e6-80c52da200ae\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") "
Jul 18 01:08:22.705576 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.705561    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac6f913-1ff3-408b-99e6-80c52da200ae-maas-api-tls\") pod \"bac6f913-1ff3-408b-99e6-80c52da200ae\" (UID: \"bac6f913-1ff3-408b-99e6-80c52da200ae\") "
Jul 18 01:08:22.705861 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.705835    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bac6f913-1ff3-408b-99e6-80c52da200ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bac6f913-1ff3-408b-99e6-80c52da200ae" (UID: "bac6f913-1ff3-408b-99e6-80c52da200ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:08:22.707503 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.707483    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bac6f913-1ff3-408b-99e6-80c52da200ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bac6f913-1ff3-408b-99e6-80c52da200ae" (UID: "bac6f913-1ff3-408b-99e6-80c52da200ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:08:22.707585 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.707507    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac6f913-1ff3-408b-99e6-80c52da200ae-kube-api-access-8jjsj" (OuterVolumeSpecName: "kube-api-access-8jjsj") pod "bac6f913-1ff3-408b-99e6-80c52da200ae" (UID: "bac6f913-1ff3-408b-99e6-80c52da200ae"). InnerVolumeSpecName "kube-api-access-8jjsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:08:22.806983 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.806954    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac6f913-1ff3-408b-99e6-80c52da200ae-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:08:22.806983 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.806979    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jjsj\" (UniqueName: \"kubernetes.io/projected/bac6f913-1ff3-408b-99e6-80c52da200ae-kube-api-access-8jjsj\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:08:22.806983 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.806991    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac6f913-1ff3-408b-99e6-80c52da200ae-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:08:22.989060 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.989028    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"]
Jul 18 01:08:22.992626 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:22.992600    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-89911758-79dc87df44-htvs2"]
Jul 18 01:08:24.401091 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:24.401047    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:24.833249 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:24.833140    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac6f913-1ff3-408b-99e6-80c52da200ae" path="/var/lib/kubelet/pods/bac6f913-1ff3-408b-99e6-80c52da200ae/volumes"
Jul 18 01:08:28.269172 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:28.269141    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:28.337245 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:28.337169    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:28.471433 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:28.471402    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:28.571471 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:28.571369    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:29.576388 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.576347    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:29.639333 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.639297    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"]
Jul 18 01:08:29.639746 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.639731    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac6f913-1ff3-408b-99e6-80c52da200ae" containerName="maas-api"
Jul 18 01:08:29.639746 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.639746    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac6f913-1ff3-408b-99e6-80c52da200ae" containerName="maas-api"
Jul 18 01:08:29.639845 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.639807    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac6f913-1ff3-408b-99e6-80c52da200ae" containerName="maas-api"
Jul 18 01:08:29.643029 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.643006    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.645373 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.645343    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1af78f27-serving-cert\""
Jul 18 01:08:29.655961 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.655931    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"]
Jul 18 01:08:29.665127 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.665101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:29.773680 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.773645    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7kw2\" (UniqueName: \"kubernetes.io/projected/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-kube-api-access-d7kw2\") pod \"maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.773853 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.773727    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-openshift-service-ca\") pod \"maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.773853 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.773746    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-maas-api-tls\") pod \"maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.870517 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.870469    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:29.874714 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.874691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-openshift-service-ca\") pod \"maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.874817 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.874725    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-maas-api-tls\") pod \"maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.874817 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.874800    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7kw2\" (UniqueName: \"kubernetes.io/projected/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-kube-api-access-d7kw2\") pod \"maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.875365 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.875338    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-openshift-service-ca\") pod \"maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.877369 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.877349    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-maas-api-tls\") pod \"maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.891459 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.891436    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7kw2\" (UniqueName: \"kubernetes.io/projected/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-kube-api-access-d7kw2\") pod \"maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.954313 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.954283    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:29.971094 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:29.971056    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:30.095366 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:30.095333    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"]
Jul 18 01:08:30.227670 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:30.227587    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:30.328517 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:30.328482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:30.720967 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:30.720931    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn" event={"ID":"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9","Type":"ContainerStarted","Data":"5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb"}
Jul 18 01:08:30.721399 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:30.720983    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn" event={"ID":"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9","Type":"ContainerStarted","Data":"a81a6fbee31f734539abe9559891e72cf1739fd06fcb5871b7b9c3f23428c2ae"}
Jul 18 01:08:30.721399 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:30.721025    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:30.739518 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:30.739472    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn" podStartSLOduration=1.324400134 podStartE2EDuration="1.739458215s" totalImagesPullingTime="415.058081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:08:30.73671263 +0000 UTC m=+1684.448823927" watchObservedRunningTime="2026-07-18 01:08:30.739458215 +0000 UTC m=+1684.451569500"
Jul 18 01:08:31.882740 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:31.882707    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:34.691045 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:34.691002    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:34.997679 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:34.997601    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"]
Jul 18 01:08:34.997831 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:34.997802    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn" podUID="d24066c1-6bc3-4d8e-a81a-a3df54ede2e9" containerName="maas-api" containerID="cri-o://5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb" gracePeriod=30
Jul 18 01:08:35.023619 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.023589    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:35.255552 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.255491    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:35.326973 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.326945    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7kw2\" (UniqueName: \"kubernetes.io/projected/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-kube-api-access-d7kw2\") pod \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") "
Jul 18 01:08:35.327144 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.327013    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-maas-api-tls\") pod \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") "
Jul 18 01:08:35.327144 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.327046    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-openshift-service-ca\") pod \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\" (UID: \"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9\") "
Jul 18 01:08:35.327451 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.327427    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d24066c1-6bc3-4d8e-a81a-a3df54ede2e9" (UID: "d24066c1-6bc3-4d8e-a81a-a3df54ede2e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:08:35.329139 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.329108    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-kube-api-access-d7kw2" (OuterVolumeSpecName: "kube-api-access-d7kw2") pod "d24066c1-6bc3-4d8e-a81a-a3df54ede2e9" (UID: "d24066c1-6bc3-4d8e-a81a-a3df54ede2e9"). InnerVolumeSpecName "kube-api-access-d7kw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:08:35.329139 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.329111    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d24066c1-6bc3-4d8e-a81a-a3df54ede2e9" (UID: "d24066c1-6bc3-4d8e-a81a-a3df54ede2e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:08:35.428277 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.428242    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7kw2\" (UniqueName: \"kubernetes.io/projected/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-kube-api-access-d7kw2\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:08:35.428277 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.428271    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:08:35.428277 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.428282    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:08:35.747539 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.747504    2569 generic.go:356] "Generic (PLEG): container finished" podID="d24066c1-6bc3-4d8e-a81a-a3df54ede2e9" containerID="5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb" exitCode=0
Jul 18 01:08:35.747942 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.747547    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"
Jul 18 01:08:35.747942 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.747567    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn" event={"ID":"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9","Type":"ContainerDied","Data":"5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb"}
Jul 18 01:08:35.747942 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.747608    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn" event={"ID":"d24066c1-6bc3-4d8e-a81a-a3df54ede2e9","Type":"ContainerDied","Data":"a81a6fbee31f734539abe9559891e72cf1739fd06fcb5871b7b9c3f23428c2ae"}
Jul 18 01:08:35.747942 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.747631    2569 scope.go:117] "RemoveContainer" containerID="5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb"
Jul 18 01:08:35.756771 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.756754    2569 scope.go:117] "RemoveContainer" containerID="5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb"
Jul 18 01:08:35.757027 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:08:35.757009    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb\": container with ID starting with 5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb not found: ID does not exist" containerID="5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb"
Jul 18 01:08:35.757084 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.757035    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb"} err="failed to get container status \"5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb\": rpc error: code = NotFound desc = could not find container \"5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb\": container with ID starting with 5f8d559ca95acb2918088396e6c550c1893fc55fb996bf9de4ec819d6ec777eb not found: ID does not exist"
Jul 18 01:08:35.767644 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.767623    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"]
Jul 18 01:08:35.771663 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:35.771642    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1af78f27-6b9fc89cc6-6dfjn"]
Jul 18 01:08:36.835048 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:36.835015    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d24066c1-6bc3-4d8e-a81a-a3df54ede2e9" path="/var/lib/kubelet/pods/d24066c1-6bc3-4d8e-a81a-a3df54ede2e9/volumes"
Jul 18 01:08:40.816541 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:40.816506    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:40.925672 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:40.925633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:42.916426 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:42.916374    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:45.371756 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:45.371717    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:45.472213 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:45.472162    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:47.035131 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:47.035091    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:47.140063 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:47.140026    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:47.266929 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:47.266901    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:47.365516 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:47.365482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:48.448684 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.448652    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:48.547146 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.547113    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:48.628383 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.628351    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"]
Jul 18 01:08:48.628815 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.628801    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d24066c1-6bc3-4d8e-a81a-a3df54ede2e9" containerName="maas-api"
Jul 18 01:08:48.628858 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.628817    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d24066c1-6bc3-4d8e-a81a-a3df54ede2e9" containerName="maas-api"
Jul 18 01:08:48.628911 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.628901    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d24066c1-6bc3-4d8e-a81a-a3df54ede2e9" containerName="maas-api"
Jul 18 01:08:48.633099 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.633077    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:48.635580 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.635560    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-42e43dea-serving-cert\""
Jul 18 01:08:48.646421 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.646389    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"]
Jul 18 01:08:48.668408 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.668381    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:48.751399 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.751304    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-maas-api-tls\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:48.751399 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.751354    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcbzz\" (UniqueName: \"kubernetes.io/projected/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-kube-api-access-zcbzz\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:48.751596 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.751399    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-openshift-service-ca\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:48.852917 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.852881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcbzz\" (UniqueName: \"kubernetes.io/projected/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-kube-api-access-zcbzz\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:48.853108 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.852923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-openshift-service-ca\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:48.853108 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.853061    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-maas-api-tls\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:48.853278 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:08:48.853163    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-serving-cert: secret "maas-api-e2e-derive-42e43dea-serving-cert" not found
Jul 18 01:08:48.853278 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:08:48.853271    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-maas-api-tls podName:7583c250-6884-4d1b-8a1f-e18ea0f0dab4 nodeName:}" failed. No retries permitted until 2026-07-18 01:08:49.353249111 +0000 UTC m=+1703.065360391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-maas-api-tls") pod "maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc" (UID: "7583c250-6884-4d1b-8a1f-e18ea0f0dab4") : secret "maas-api-e2e-derive-42e43dea-serving-cert" not found
Jul 18 01:08:48.853698 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.853672    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-openshift-service-ca\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:48.865554 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:48.865531    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcbzz\" (UniqueName: \"kubernetes.io/projected/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-kube-api-access-zcbzz\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:49.026659 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:49.026541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:49.155689 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:49.155648    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:49.251924 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:49.251878    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:49.357724 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:49.357685    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-maas-api-tls\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:49.360155 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:49.360130    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-maas-api-tls\") pod \"maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:49.543374 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:49.543339    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:49.685610 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:49.685564    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"]
Jul 18 01:08:49.688131 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:08:49.688098    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7583c250_6884_4d1b_8a1f_e18ea0f0dab4.slice/crio-afef3cf7f6c9efcb149aae8a6ce12ddc9800a37da385910908aef25e4c8d4a37 WatchSource:0}: Error finding container afef3cf7f6c9efcb149aae8a6ce12ddc9800a37da385910908aef25e4c8d4a37: Status 404 returned error can't find the container with id afef3cf7f6c9efcb149aae8a6ce12ddc9800a37da385910908aef25e4c8d4a37
Jul 18 01:08:49.821086 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:49.821052    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc" event={"ID":"7583c250-6884-4d1b-8a1f-e18ea0f0dab4","Type":"ContainerStarted","Data":"afef3cf7f6c9efcb149aae8a6ce12ddc9800a37da385910908aef25e4c8d4a37"}
Jul 18 01:08:50.580367 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:50.580336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:50.831699 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:50.831607    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc" event={"ID":"7583c250-6884-4d1b-8a1f-e18ea0f0dab4","Type":"ContainerStarted","Data":"41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2"}
Jul 18 01:08:50.831699 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:50.831670    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:50.847237 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:50.847092    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc" podStartSLOduration=2.5149130570000002 podStartE2EDuration="2.847074751s" totalImagesPullingTime="332.161694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:08:50.846671692 +0000 UTC m=+1704.558782978" watchObservedRunningTime="2026-07-18 01:08:50.847074751 +0000 UTC m=+1704.559186043"
Jul 18 01:08:52.810862 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:52.810827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:53.007425 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.007385    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:53.120050 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.120017    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:53.244510 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.244477    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"]
Jul 18 01:08:53.244712 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.244691    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc" podUID="7583c250-6884-4d1b-8a1f-e18ea0f0dab4" containerName="maas-api" containerID="cri-o://41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2" gracePeriod=30
Jul 18 01:08:53.287204 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.287161    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:53.499246 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.499223    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:53.597682 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.597647    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-maas-api-tls\") pod \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") "
Jul 18 01:08:53.597682 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.597687    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcbzz\" (UniqueName: \"kubernetes.io/projected/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-kube-api-access-zcbzz\") pod \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") "
Jul 18 01:08:53.597927 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.597725    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-openshift-service-ca\") pod \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\" (UID: \"7583c250-6884-4d1b-8a1f-e18ea0f0dab4\") "
Jul 18 01:08:53.598055 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.598037    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7583c250-6884-4d1b-8a1f-e18ea0f0dab4" (UID: "7583c250-6884-4d1b-8a1f-e18ea0f0dab4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:08:53.598171 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.598154    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:08:53.599871 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.599840    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7583c250-6884-4d1b-8a1f-e18ea0f0dab4" (UID: "7583c250-6884-4d1b-8a1f-e18ea0f0dab4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:08:53.599971 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.599916    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-kube-api-access-zcbzz" (OuterVolumeSpecName: "kube-api-access-zcbzz") pod "7583c250-6884-4d1b-8a1f-e18ea0f0dab4" (UID: "7583c250-6884-4d1b-8a1f-e18ea0f0dab4"). InnerVolumeSpecName "kube-api-access-zcbzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:08:53.699481 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.699400    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcbzz\" (UniqueName: \"kubernetes.io/projected/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-kube-api-access-zcbzz\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:08:53.699481 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.699429    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7583c250-6884-4d1b-8a1f-e18ea0f0dab4-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:08:53.844947 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.844909    2569 generic.go:356] "Generic (PLEG): container finished" podID="7583c250-6884-4d1b-8a1f-e18ea0f0dab4" containerID="41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2" exitCode=0
Jul 18 01:08:53.844947 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.844950    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"
Jul 18 01:08:53.845403 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.845001    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc" event={"ID":"7583c250-6884-4d1b-8a1f-e18ea0f0dab4","Type":"ContainerDied","Data":"41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2"}
Jul 18 01:08:53.845403 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.845054    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc" event={"ID":"7583c250-6884-4d1b-8a1f-e18ea0f0dab4","Type":"ContainerDied","Data":"afef3cf7f6c9efcb149aae8a6ce12ddc9800a37da385910908aef25e4c8d4a37"}
Jul 18 01:08:53.845403 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.845077    2569 scope.go:117] "RemoveContainer" containerID="41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2"
Jul 18 01:08:53.854548 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.854533    2569 scope.go:117] "RemoveContainer" containerID="41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2"
Jul 18 01:08:53.854830 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:08:53.854777    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2\": container with ID starting with 41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2 not found: ID does not exist" containerID="41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2"
Jul 18 01:08:53.854935 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.854834    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2"} err="failed to get container status \"41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2\": rpc error: code = NotFound desc = could not find container \"41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2\": container with ID starting with 41a8acc3f486eeb896d2993b579ed181c88c5ac00d43774c6716fb42429700a2 not found: ID does not exist"
Jul 18 01:08:53.867280 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.867251    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"]
Jul 18 01:08:53.870677 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:53.870654    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42e43dea-6965ddcd5-fmvtc"]
Jul 18 01:08:54.832393 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:54.832358    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7583c250-6884-4d1b-8a1f-e18ea0f0dab4" path="/var/lib/kubelet/pods/7583c250-6884-4d1b-8a1f-e18ea0f0dab4/volumes"
Jul 18 01:08:55.254893 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:55.254856    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:58.697930 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:58.697896    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:58.762104 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:58.762074    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:59.175333 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:59.175301    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:59.276579 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:59.276543    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:08:59.375729 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:08:59.375697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:00.795100 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:00.795064    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:06.577528 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:06.577493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:06.682374 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:06.682338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:06.777710 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:06.777676    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:06.880895 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:06.880861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:07.289211 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:07.289118    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:33.248100 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:33.248066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:39.034235 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:39.034179    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:39.099060 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:39.099013    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:39.187016 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:39.186980    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:39.285359 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:39.285282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:09:55.165818 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:09:55.165781    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:01.024327 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:01.024293    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:01.133182 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:01.133149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:01.259171 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:01.259138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:11.796970 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:11.796935    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:12.635052 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:12.635018    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:18.571555 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:18.571519    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:18.673389 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:18.673358    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:18.772078 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:18.772047    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:18.871439 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:18.871414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:19.687895 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:19.687857    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:19.786403 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:19.786372    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:19.891537 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:19.891505    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:21.546865 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:21.546829    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:24.849963 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:24.849930    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:26.982889 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:26.982858    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:10:26.984850 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:26.984827    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:10:27.282579 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:27.282498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:27.348186 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:27.348152    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:27.961064 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:27.961028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:33.788259 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:33.788221    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:33.889874 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:33.889836    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:34.047324 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:34.047230    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:34.451555 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:34.451525    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:34.649063 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:34.649024    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:40.404513 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.404476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:40.498365 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.498330    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:40.621985 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.621953    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"]
Jul 18 01:10:40.622415 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.622400    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7583c250-6884-4d1b-8a1f-e18ea0f0dab4" containerName="maas-api"
Jul 18 01:10:40.622415 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.622416    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7583c250-6884-4d1b-8a1f-e18ea0f0dab4" containerName="maas-api"
Jul 18 01:10:40.622561 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.622499    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7583c250-6884-4d1b-8a1f-e18ea0f0dab4" containerName="maas-api"
Jul 18 01:10:40.625888 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.625869    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.628312 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.628265    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5d7b09a4-serving-cert\""
Jul 18 01:10:40.636016 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.635992    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"]
Jul 18 01:10:40.653336 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.653306    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:40.722825 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.722743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb458776-9dd8-41cd-a16e-55f80646e2fa-openshift-service-ca\") pod \"maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.722825 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.722784    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9wk5\" (UniqueName: \"kubernetes.io/projected/fb458776-9dd8-41cd-a16e-55f80646e2fa-kube-api-access-f9wk5\") pod \"maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.723022 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.722890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb458776-9dd8-41cd-a16e-55f80646e2fa-maas-api-tls\") pod \"maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.782384 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.782352    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:40.823675 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.823641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb458776-9dd8-41cd-a16e-55f80646e2fa-openshift-service-ca\") pod \"maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.823837 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.823678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wk5\" (UniqueName: \"kubernetes.io/projected/fb458776-9dd8-41cd-a16e-55f80646e2fa-kube-api-access-f9wk5\") pod \"maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.823837 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.823718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb458776-9dd8-41cd-a16e-55f80646e2fa-maas-api-tls\") pod \"maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.824433 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.824414    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb458776-9dd8-41cd-a16e-55f80646e2fa-openshift-service-ca\") pod \"maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.826323 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.826302    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb458776-9dd8-41cd-a16e-55f80646e2fa-maas-api-tls\") pod \"maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.831879 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.831851    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9wk5\" (UniqueName: \"kubernetes.io/projected/fb458776-9dd8-41cd-a16e-55f80646e2fa-kube-api-access-f9wk5\") pod \"maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:40.939022 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:40.938986    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:41.078862 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:41.078764    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"]
Jul 18 01:10:41.081368 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:10:41.081335    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb458776_9dd8_41cd_a16e_55f80646e2fa.slice/crio-7fc6b10d406200929bde4d83f9025dfae09ba9c01bb448c1d9cd986b68417c65 WatchSource:0}: Error finding container 7fc6b10d406200929bde4d83f9025dfae09ba9c01bb448c1d9cd986b68417c65: Status 404 returned error can't find the container with id 7fc6b10d406200929bde4d83f9025dfae09ba9c01bb448c1d9cd986b68417c65
Jul 18 01:10:41.186714 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:41.186677    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:41.288722 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:41.288630    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:41.388830 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:41.388793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c" event={"ID":"fb458776-9dd8-41cd-a16e-55f80646e2fa","Type":"ContainerStarted","Data":"7fc6b10d406200929bde4d83f9025dfae09ba9c01bb448c1d9cd986b68417c65"}
Jul 18 01:10:42.396125 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:42.396088    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c" event={"ID":"fb458776-9dd8-41cd-a16e-55f80646e2fa","Type":"ContainerStarted","Data":"61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14"}
Jul 18 01:10:42.396526 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:42.396227    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:42.413766 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:42.413714    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c" podStartSLOduration=2.001035386 podStartE2EDuration="2.41369875s" totalImagesPullingTime="412.663364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:10:42.412241374 +0000 UTC m=+1816.124352690" watchObservedRunningTime="2026-07-18 01:10:42.41369875 +0000 UTC m=+1816.125810049"
Jul 18 01:10:44.903349 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:44.903316    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:45.575076 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:45.575042    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:45.674390 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:45.674357    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:46.028781 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:46.028745    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:48.407026 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:48.406993    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:51.902648 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:51.902612    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:51.963392 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:51.963360    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:52.318685 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:52.318601    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:52.646704 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:52.646671    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"]
Jul 18 01:10:52.646910 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:52.646864    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c" podUID="fb458776-9dd8-41cd-a16e-55f80646e2fa" containerName="maas-api" containerID="cri-o://61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14" gracePeriod=30
Jul 18 01:10:52.673117 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:52.673080    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:52.732081 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:52.732011    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:52.900221 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:52.900147    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:53.042287 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.042255    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb458776-9dd8-41cd-a16e-55f80646e2fa-openshift-service-ca\") pod \"fb458776-9dd8-41cd-a16e-55f80646e2fa\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") "
Jul 18 01:10:53.042707 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.042339    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb458776-9dd8-41cd-a16e-55f80646e2fa-maas-api-tls\") pod \"fb458776-9dd8-41cd-a16e-55f80646e2fa\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") "
Jul 18 01:10:53.042707 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.042383    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9wk5\" (UniqueName: \"kubernetes.io/projected/fb458776-9dd8-41cd-a16e-55f80646e2fa-kube-api-access-f9wk5\") pod \"fb458776-9dd8-41cd-a16e-55f80646e2fa\" (UID: \"fb458776-9dd8-41cd-a16e-55f80646e2fa\") "
Jul 18 01:10:53.042707 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.042619    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb458776-9dd8-41cd-a16e-55f80646e2fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb458776-9dd8-41cd-a16e-55f80646e2fa" (UID: "fb458776-9dd8-41cd-a16e-55f80646e2fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:10:53.044501 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.044476    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb458776-9dd8-41cd-a16e-55f80646e2fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb458776-9dd8-41cd-a16e-55f80646e2fa" (UID: "fb458776-9dd8-41cd-a16e-55f80646e2fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:10:53.044604 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.044535    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb458776-9dd8-41cd-a16e-55f80646e2fa-kube-api-access-f9wk5" (OuterVolumeSpecName: "kube-api-access-f9wk5") pod "fb458776-9dd8-41cd-a16e-55f80646e2fa" (UID: "fb458776-9dd8-41cd-a16e-55f80646e2fa"). InnerVolumeSpecName "kube-api-access-f9wk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:10:53.143425 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.143393    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb458776-9dd8-41cd-a16e-55f80646e2fa-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:10:53.143425 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.143420    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9wk5\" (UniqueName: \"kubernetes.io/projected/fb458776-9dd8-41cd-a16e-55f80646e2fa-kube-api-access-f9wk5\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:10:53.143425 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.143431    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb458776-9dd8-41cd-a16e-55f80646e2fa-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:10:53.457167 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.457136    2569 generic.go:356] "Generic (PLEG): container finished" podID="fb458776-9dd8-41cd-a16e-55f80646e2fa" containerID="61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14" exitCode=0
Jul 18 01:10:53.457396 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.457181    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c" event={"ID":"fb458776-9dd8-41cd-a16e-55f80646e2fa","Type":"ContainerDied","Data":"61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14"}
Jul 18 01:10:53.457396 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.457189    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"
Jul 18 01:10:53.457396 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.457250    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c" event={"ID":"fb458776-9dd8-41cd-a16e-55f80646e2fa","Type":"ContainerDied","Data":"7fc6b10d406200929bde4d83f9025dfae09ba9c01bb448c1d9cd986b68417c65"}
Jul 18 01:10:53.457396 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.457275    2569 scope.go:117] "RemoveContainer" containerID="61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14"
Jul 18 01:10:53.467304 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.467281    2569 scope.go:117] "RemoveContainer" containerID="61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14"
Jul 18 01:10:53.467555 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:10:53.467534    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14\": container with ID starting with 61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14 not found: ID does not exist" containerID="61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14"
Jul 18 01:10:53.467628 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.467563    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14"} err="failed to get container status \"61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14\": rpc error: code = NotFound desc = could not find container \"61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14\": container with ID starting with 61799c460aca80f4212b42744bf6f01017769c3083da59f60989e369e4d98d14 not found: ID does not exist"
Jul 18 01:10:53.479125 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.479094    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"]
Jul 18 01:10:53.483238 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:53.483214    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d7b09a4-86d9c8dcc9-tb98c"]
Jul 18 01:10:54.839089 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:54.839054    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb458776-9dd8-41cd-a16e-55f80646e2fa" path="/var/lib/kubelet/pods/fb458776-9dd8-41cd-a16e-55f80646e2fa/volumes"
Jul 18 01:10:58.395342 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:58.395305    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:58.495720 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:58.495682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:58.682889 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:58.682808    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:59.055852 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:59.055774    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:59.154588 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:59.154552    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:10:59.270503 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:10:59.270469    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:04.956972 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:04.956937    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:05.064275 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:05.064245    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:05.157387 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:05.157358    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:05.366093 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:05.366065    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:11.016767 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:11.016732    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:11.081384 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:11.081351    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:17.770099 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:17.770053    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:18.110225 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:18.110179    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:18.308848 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:18.308810    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:18.926308 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:18.926268    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:19.024281 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:19.024245    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:20.679885 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.679841    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:20.782874 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.782835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:20.925421 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.925384    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"]
Jul 18 01:11:20.925931 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.925910    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb458776-9dd8-41cd-a16e-55f80646e2fa" containerName="maas-api"
Jul 18 01:11:20.925931 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.925930    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb458776-9dd8-41cd-a16e-55f80646e2fa" containerName="maas-api"
Jul 18 01:11:20.926092 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.925999    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb458776-9dd8-41cd-a16e-55f80646e2fa" containerName="maas-api"
Jul 18 01:11:20.929352 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.929330    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:20.931862 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.931795    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3482f028-serving-cert\""
Jul 18 01:11:20.936951 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.936925    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"]
Jul 18 01:11:20.952485 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:20.952453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:21.013786 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.013751    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfhpx\" (UniqueName: \"kubernetes.io/projected/be64dbb1-d87c-4809-9d07-962bf36f2970-kube-api-access-bfhpx\") pod \"maas-api-e2e-mt-3482f028-64b596858b-4zpcp\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.013927 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.013809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be64dbb1-d87c-4809-9d07-962bf36f2970-openshift-service-ca\") pod \"maas-api-e2e-mt-3482f028-64b596858b-4zpcp\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.013927 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.013880    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be64dbb1-d87c-4809-9d07-962bf36f2970-maas-api-tls\") pod \"maas-api-e2e-mt-3482f028-64b596858b-4zpcp\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.111545 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.111517    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:21.114613 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.114590    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfhpx\" (UniqueName: \"kubernetes.io/projected/be64dbb1-d87c-4809-9d07-962bf36f2970-kube-api-access-bfhpx\") pod \"maas-api-e2e-mt-3482f028-64b596858b-4zpcp\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.114695 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.114653    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be64dbb1-d87c-4809-9d07-962bf36f2970-openshift-service-ca\") pod \"maas-api-e2e-mt-3482f028-64b596858b-4zpcp\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.114758 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.114741    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be64dbb1-d87c-4809-9d07-962bf36f2970-maas-api-tls\") pod \"maas-api-e2e-mt-3482f028-64b596858b-4zpcp\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.115443 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.115415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be64dbb1-d87c-4809-9d07-962bf36f2970-openshift-service-ca\") pod \"maas-api-e2e-mt-3482f028-64b596858b-4zpcp\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.117273 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.117251    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be64dbb1-d87c-4809-9d07-962bf36f2970-maas-api-tls\") pod \"maas-api-e2e-mt-3482f028-64b596858b-4zpcp\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.122782 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.122752    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfhpx\" (UniqueName: \"kubernetes.io/projected/be64dbb1-d87c-4809-9d07-962bf36f2970-kube-api-access-bfhpx\") pod \"maas-api-e2e-mt-3482f028-64b596858b-4zpcp\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.242119 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.242033    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:21.382667 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.382589    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"]
Jul 18 01:11:21.385948 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:11:21.385913    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe64dbb1_d87c_4809_9d07_962bf36f2970.slice/crio-4e882dc42f53db0957f792e876831fc62830c96fde5ed8efa626a5a68548ca68 WatchSource:0}: Error finding container 4e882dc42f53db0957f792e876831fc62830c96fde5ed8efa626a5a68548ca68: Status 404 returned error can't find the container with id 4e882dc42f53db0957f792e876831fc62830c96fde5ed8efa626a5a68548ca68
Jul 18 01:11:21.452678 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.452649    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:21.554055 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.553976    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:21.599031 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:21.598999    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp" event={"ID":"be64dbb1-d87c-4809-9d07-962bf36f2970","Type":"ContainerStarted","Data":"4e882dc42f53db0957f792e876831fc62830c96fde5ed8efa626a5a68548ca68"}
Jul 18 01:11:22.606138 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:22.606099    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp" event={"ID":"be64dbb1-d87c-4809-9d07-962bf36f2970","Type":"ContainerStarted","Data":"8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6"}
Jul 18 01:11:22.606553 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:22.606164    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:22.623583 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:22.623532    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp" podStartSLOduration=2.327727329 podStartE2EDuration="2.62351736s" totalImagesPullingTime="295.790031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:11:22.620735349 +0000 UTC m=+1856.332846635" watchObservedRunningTime="2026-07-18 01:11:22.62351736 +0000 UTC m=+1856.335628647"
Jul 18 01:11:25.128832 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:25.128794    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:11:28.616805 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:28.616775    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:11:41.649270 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:11:41.649237    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:12:13.033851 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.033809    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:12:13.390781 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.390743    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"]
Jul 18 01:12:13.391014 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.390985    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp" podUID="be64dbb1-d87c-4809-9d07-962bf36f2970" containerName="maas-api" containerID="cri-o://8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6" gracePeriod=30
Jul 18 01:12:13.414405 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.414370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:12:13.647794 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.647736    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:12:13.817293 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.817262    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be64dbb1-d87c-4809-9d07-962bf36f2970-maas-api-tls\") pod \"be64dbb1-d87c-4809-9d07-962bf36f2970\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") "
Jul 18 01:12:13.817463 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.817328    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be64dbb1-d87c-4809-9d07-962bf36f2970-openshift-service-ca\") pod \"be64dbb1-d87c-4809-9d07-962bf36f2970\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") "
Jul 18 01:12:13.817463 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.817373    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfhpx\" (UniqueName: \"kubernetes.io/projected/be64dbb1-d87c-4809-9d07-962bf36f2970-kube-api-access-bfhpx\") pod \"be64dbb1-d87c-4809-9d07-962bf36f2970\" (UID: \"be64dbb1-d87c-4809-9d07-962bf36f2970\") "
Jul 18 01:12:13.817698 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.817674    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be64dbb1-d87c-4809-9d07-962bf36f2970-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "be64dbb1-d87c-4809-9d07-962bf36f2970" (UID: "be64dbb1-d87c-4809-9d07-962bf36f2970"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:12:13.819530 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.819507    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be64dbb1-d87c-4809-9d07-962bf36f2970-kube-api-access-bfhpx" (OuterVolumeSpecName: "kube-api-access-bfhpx") pod "be64dbb1-d87c-4809-9d07-962bf36f2970" (UID: "be64dbb1-d87c-4809-9d07-962bf36f2970"). InnerVolumeSpecName "kube-api-access-bfhpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:12:13.819631 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.819512    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be64dbb1-d87c-4809-9d07-962bf36f2970-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "be64dbb1-d87c-4809-9d07-962bf36f2970" (UID: "be64dbb1-d87c-4809-9d07-962bf36f2970"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:12:13.860627 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.860597    2569 generic.go:356] "Generic (PLEG): container finished" podID="be64dbb1-d87c-4809-9d07-962bf36f2970" containerID="8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6" exitCode=0
Jul 18 01:12:13.860790 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.860633    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp" event={"ID":"be64dbb1-d87c-4809-9d07-962bf36f2970","Type":"ContainerDied","Data":"8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6"}
Jul 18 01:12:13.860790 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.860639    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"
Jul 18 01:12:13.860790 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.860670    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp" event={"ID":"be64dbb1-d87c-4809-9d07-962bf36f2970","Type":"ContainerDied","Data":"4e882dc42f53db0957f792e876831fc62830c96fde5ed8efa626a5a68548ca68"}
Jul 18 01:12:13.860790 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.860691    2569 scope.go:117] "RemoveContainer" containerID="8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6"
Jul 18 01:12:13.870243 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.870225    2569 scope.go:117] "RemoveContainer" containerID="8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6"
Jul 18 01:12:13.870512 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:12:13.870492    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6\": container with ID starting with 8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6 not found: ID does not exist" containerID="8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6"
Jul 18 01:12:13.870576 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.870521    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6"} err="failed to get container status \"8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6\": rpc error: code = NotFound desc = could not find container \"8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6\": container with ID starting with 8344fd0148abf91f9ad80bf5efc5bc9d9cbef3450fcea315ece98aba2a994ca6 not found: ID does not exist"
Jul 18 01:12:13.881778 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.881752    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"]
Jul 18 01:12:13.885575 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.885552    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp"]
Jul 18 01:12:13.918780 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.918692    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be64dbb1-d87c-4809-9d07-962bf36f2970-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:12:13.918780 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.918722    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfhpx\" (UniqueName: \"kubernetes.io/projected/be64dbb1-d87c-4809-9d07-962bf36f2970-kube-api-access-bfhpx\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:12:13.918780 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:13.918733    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be64dbb1-d87c-4809-9d07-962bf36f2970-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:12:14.832430 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:14.832395    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be64dbb1-d87c-4809-9d07-962bf36f2970" path="/var/lib/kubelet/pods/be64dbb1-d87c-4809-9d07-962bf36f2970/volumes"
Jul 18 01:12:16.611715 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:16.611675    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3482f028-64b596858b-4zpcp" podUID="be64dbb1-d87c-4809-9d07-962bf36f2970" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.44:8443/health\": context deadline exceeded"
Jul 18 01:12:19.155934 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:19.155891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:12:24.233438 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:24.233400    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:12:28.202709 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:12:28.202658    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:00.409864 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:00.409828    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:01.467027 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:01.466990    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:06.765337 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:06.765302    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:06.834067 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:06.834034    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:07.032451 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:07.032370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:08.366465 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:08.366431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:08.465693 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:08.465659    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:08.522210 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:08.522167    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:09.362186 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:09.362156    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:09.462042 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:09.462006    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:09.562024 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:09.561943    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:10.978280 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:10.978240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:16.765792 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:16.765733    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:16.866392 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:16.866353    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:17.464384 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:17.464353    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:23.375560 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:23.375465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:23.484489 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:23.484442    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:23.576878 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:23.576832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:26.763500 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:26.763462    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:34.138395 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:34.138357    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:34.499450 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:34.499342    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:13:55.474517 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:13:55.474485    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:01.202899 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:01.202862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:01.262623 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:01.262582    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:01.559015 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:01.558906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:01.850726 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:01.850688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:01.966005 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:01.965949    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:04.397691 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.397647    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:04.482982 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.482951    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"]
Jul 18 01:14:04.483442 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.483427    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be64dbb1-d87c-4809-9d07-962bf36f2970" containerName="maas-api"
Jul 18 01:14:04.483491 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.483444    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="be64dbb1-d87c-4809-9d07-962bf36f2970" containerName="maas-api"
Jul 18 01:14:04.483526 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.483519    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="be64dbb1-d87c-4809-9d07-962bf36f2970" containerName="maas-api"
Jul 18 01:14:04.486895 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.486872    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:04.487651 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.487627    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:04.490310 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.490291    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-9d3231-serving-cert\""
Jul 18 01:14:04.498160 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.498140    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"]
Jul 18 01:14:04.556483 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.556439    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:04.589840 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.589808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9fea32-2db2-4c0a-858d-d4140a6bc578-maas-api-tls\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:04.589986 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.589847    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7zt\" (UniqueName: \"kubernetes.io/projected/db9fea32-2db2-4c0a-858d-d4140a6bc578-kube-api-access-bq7zt\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:04.589986 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.589920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9fea32-2db2-4c0a-858d-d4140a6bc578-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:04.690970 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.690876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9fea32-2db2-4c0a-858d-d4140a6bc578-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:04.691141 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.690975    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9fea32-2db2-4c0a-858d-d4140a6bc578-maas-api-tls\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:04.691141 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.691015    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7zt\" (UniqueName: \"kubernetes.io/projected/db9fea32-2db2-4c0a-858d-d4140a6bc578-kube-api-access-bq7zt\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:04.691141 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:14:04.691117    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-serving-cert: secret "maas-api-e2e-inf-a-9d3231-serving-cert" not found
Jul 18 01:14:04.691304 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:14:04.691184    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9fea32-2db2-4c0a-858d-d4140a6bc578-maas-api-tls podName:db9fea32-2db2-4c0a-858d-d4140a6bc578 nodeName:}" failed. No retries permitted until 2026-07-18 01:14:05.191167738 +0000 UTC m=+2018.903279001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db9fea32-2db2-4c0a-858d-d4140a6bc578-maas-api-tls") pod "maas-api-e2e-inf-a-9d3231-68886565f-hw29d" (UID: "db9fea32-2db2-4c0a-858d-d4140a6bc578") : secret "maas-api-e2e-inf-a-9d3231-serving-cert" not found
Jul 18 01:14:04.691543 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.691525    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9fea32-2db2-4c0a-858d-d4140a6bc578-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:04.701295 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.701269    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7zt\" (UniqueName: \"kubernetes.io/projected/db9fea32-2db2-4c0a-858d-d4140a6bc578-kube-api-access-bq7zt\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:04.965396 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:04.965317    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:05.062683 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:05.062650    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:05.132425 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:05.132348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:05.196663 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:05.196616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9fea32-2db2-4c0a-858d-d4140a6bc578-maas-api-tls\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:05.199272 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:05.199243    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9fea32-2db2-4c0a-858d-d4140a6bc578-maas-api-tls\") pod \"maas-api-e2e-inf-a-9d3231-68886565f-hw29d\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:05.398270 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:05.398232    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:05.559385 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:05.559361    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:14:05.564165 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:05.564138    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"]
Jul 18 01:14:06.432071 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:06.432033    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d" event={"ID":"db9fea32-2db2-4c0a-858d-d4140a6bc578","Type":"ContainerStarted","Data":"32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04"}
Jul 18 01:14:06.432539 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:06.432091    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d" event={"ID":"db9fea32-2db2-4c0a-858d-d4140a6bc578","Type":"ContainerStarted","Data":"2c59a041aafb3449b91ced81cba15696cbbf8f86a770c92cac5dda19efec8fba"}
Jul 18 01:14:06.432539 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:06.432214    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:06.449227 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:06.449165    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d" podStartSLOduration=1.928344305 podStartE2EDuration="2.449150898s" totalImagesPullingTime="520.806593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:14:06.446692136 +0000 UTC m=+2020.158803424" watchObservedRunningTime="2026-07-18 01:14:06.449150898 +0000 UTC m=+2020.161262230"
Jul 18 01:14:08.907698 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:08.907664    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:09.263399 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:09.263287    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:09.561462 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:09.561360    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:09.738727 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:09.738696    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:12.442773 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.442743    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:14:12.577680 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.577636    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:12.669728 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.669680    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:12.811536 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.811453    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"]
Jul 18 01:14:12.815953 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.815927    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:12.818158 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.818128    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-b13551-serving-cert\""
Jul 18 01:14:12.824331 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.824302    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"]
Jul 18 01:14:12.850649 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.850610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:12.873978 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.873939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab9048b7-e4a9-4eed-b139-23948c4979f1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:12.874186 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.874002    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab9048b7-e4a9-4eed-b139-23948c4979f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:12.874186 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.874074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tp5h\" (UniqueName: \"kubernetes.io/projected/ab9048b7-e4a9-4eed-b139-23948c4979f1-kube-api-access-9tp5h\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:12.974675 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.974636    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab9048b7-e4a9-4eed-b139-23948c4979f1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:12.974847 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.974797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab9048b7-e4a9-4eed-b139-23948c4979f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:12.974902 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.974847    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tp5h\" (UniqueName: \"kubernetes.io/projected/ab9048b7-e4a9-4eed-b139-23948c4979f1-kube-api-access-9tp5h\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:12.974948 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:14:12.974913    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-serving-cert: secret "maas-api-e2e-inf-b-b13551-serving-cert" not found
Jul 18 01:14:12.974988 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:14:12.974981    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab9048b7-e4a9-4eed-b139-23948c4979f1-maas-api-tls podName:ab9048b7-e4a9-4eed-b139-23948c4979f1 nodeName:}" failed. No retries permitted until 2026-07-18 01:14:13.474964898 +0000 UTC m=+2027.187076161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab9048b7-e4a9-4eed-b139-23948c4979f1-maas-api-tls") pod "maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5" (UID: "ab9048b7-e4a9-4eed-b139-23948c4979f1") : secret "maas-api-e2e-inf-b-b13551-serving-cert" not found
Jul 18 01:14:12.975486 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.975468    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab9048b7-e4a9-4eed-b139-23948c4979f1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:12.984841 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:12.984814    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tp5h\" (UniqueName: \"kubernetes.io/projected/ab9048b7-e4a9-4eed-b139-23948c4979f1-kube-api-access-9tp5h\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:13.199918 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:13.199881    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:13.342691 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:13.342642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:13.438647 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:13.438604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:13.478584 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:13.478504    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab9048b7-e4a9-4eed-b139-23948c4979f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:13.481027 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:13.481004    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab9048b7-e4a9-4eed-b139-23948c4979f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:13.729741 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:13.729661    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:13.883916 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:13.883888    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"]
Jul 18 01:14:13.886305 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:14:13.886279    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9048b7_e4a9_4eed_b139_23948c4979f1.slice/crio-d395dbbf47167534d5596ef3b8ded33a18ae2b6831c471dbc65440d2dbce08e2 WatchSource:0}: Error finding container d395dbbf47167534d5596ef3b8ded33a18ae2b6831c471dbc65440d2dbce08e2: Status 404 returned error can't find the container with id d395dbbf47167534d5596ef3b8ded33a18ae2b6831c471dbc65440d2dbce08e2
Jul 18 01:14:14.476674 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:14.476637    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5" event={"ID":"ab9048b7-e4a9-4eed-b139-23948c4979f1","Type":"ContainerStarted","Data":"53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c"}
Jul 18 01:14:14.476865 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:14.476704    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5" event={"ID":"ab9048b7-e4a9-4eed-b139-23948c4979f1","Type":"ContainerStarted","Data":"d395dbbf47167534d5596ef3b8ded33a18ae2b6831c471dbc65440d2dbce08e2"}
Jul 18 01:14:14.476865 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:14.476752    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:14.493909 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:14.493854    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5" podStartSLOduration=2.085573799 podStartE2EDuration="2.493840267s" totalImagesPullingTime="408.266468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:14:14.492505445 +0000 UTC m=+2028.204616752" watchObservedRunningTime="2026-07-18 01:14:14.493840267 +0000 UTC m=+2028.205951552"
Jul 18 01:14:17.100676 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:17.100635    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:20.486908 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:20.486883    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:14:26.615514 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:26.615478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:26.716472 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:26.716436    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:34.030659 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:34.030624    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:34.136243 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:34.136217    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:37.432185 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:37.432155    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:14:53.409025 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:14:53.408951    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:00.131782 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.131747    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"]
Jul 18 01:15:00.135700 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.135682    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"
Jul 18 01:15:00.139467 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.139447    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"]
Jul 18 01:15:00.143902 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.143865    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"]
Jul 18 01:15:00.144514 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.144088    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"
Jul 18 01:15:00.147496 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.147472    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"]
Jul 18 01:15:00.147611 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.147585    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"
Jul 18 01:15:00.153303 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.153277    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"]
Jul 18 01:15:00.156327 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.156300    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"]
Jul 18 01:15:00.229678 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.229648    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j6hk\" (UniqueName: \"kubernetes.io/projected/cde67d15-6590-4c6f-a6f4-065fd7cb9450-kube-api-access-7j6hk\") pod \"maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2\" (UID: \"cde67d15-6590-4c6f-a6f4-065fd7cb9450\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"
Jul 18 01:15:00.229838 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.229754    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v42g\" (UniqueName: \"kubernetes.io/projected/6377da34-a799-4e68-ab64-5a3529d2a0ef-kube-api-access-4v42g\") pod \"maas-api-key-cleanup-29738955-bqdjz\" (UID: \"6377da34-a799-4e68-ab64-5a3529d2a0ef\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"
Jul 18 01:15:00.229838 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.229811    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jlw5\" (UniqueName: \"kubernetes.io/projected/02699a78-4782-4c0a-9ee2-492bbeee5ec5-kube-api-access-5jlw5\") pod \"maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb\" (UID: \"02699a78-4782-4c0a-9ee2-492bbeee5ec5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"
Jul 18 01:15:00.330762 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.330719    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v42g\" (UniqueName: \"kubernetes.io/projected/6377da34-a799-4e68-ab64-5a3529d2a0ef-kube-api-access-4v42g\") pod \"maas-api-key-cleanup-29738955-bqdjz\" (UID: \"6377da34-a799-4e68-ab64-5a3529d2a0ef\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"
Jul 18 01:15:00.330961 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.330777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jlw5\" (UniqueName: \"kubernetes.io/projected/02699a78-4782-4c0a-9ee2-492bbeee5ec5-kube-api-access-5jlw5\") pod \"maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb\" (UID: \"02699a78-4782-4c0a-9ee2-492bbeee5ec5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"
Jul 18 01:15:00.330961 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.330849    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j6hk\" (UniqueName: \"kubernetes.io/projected/cde67d15-6590-4c6f-a6f4-065fd7cb9450-kube-api-access-7j6hk\") pod \"maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2\" (UID: \"cde67d15-6590-4c6f-a6f4-065fd7cb9450\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"
Jul 18 01:15:00.340337 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.340299    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j6hk\" (UniqueName: \"kubernetes.io/projected/cde67d15-6590-4c6f-a6f4-065fd7cb9450-kube-api-access-7j6hk\") pod \"maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2\" (UID: \"cde67d15-6590-4c6f-a6f4-065fd7cb9450\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"
Jul 18 01:15:00.340337 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.340327    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v42g\" (UniqueName: \"kubernetes.io/projected/6377da34-a799-4e68-ab64-5a3529d2a0ef-kube-api-access-4v42g\") pod \"maas-api-key-cleanup-29738955-bqdjz\" (UID: \"6377da34-a799-4e68-ab64-5a3529d2a0ef\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"
Jul 18 01:15:00.340570 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.340532    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jlw5\" (UniqueName: \"kubernetes.io/projected/02699a78-4782-4c0a-9ee2-492bbeee5ec5-kube-api-access-5jlw5\") pod \"maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb\" (UID: \"02699a78-4782-4c0a-9ee2-492bbeee5ec5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"
Jul 18 01:15:00.447603 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.447510    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"
Jul 18 01:15:00.461635 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.461606    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"
Jul 18 01:15:00.467948 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.467923    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"
Jul 18 01:15:00.603446 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.602791    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"]
Jul 18 01:15:00.605666 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:15:00.605634    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6377da34_a799_4e68_ab64_5a3529d2a0ef.slice/crio-bb69edc5847704aac6e20e295f22e797b1e284dcd17cf31a60fe474a4ee62acc WatchSource:0}: Error finding container bb69edc5847704aac6e20e295f22e797b1e284dcd17cf31a60fe474a4ee62acc: Status 404 returned error can't find the container with id bb69edc5847704aac6e20e295f22e797b1e284dcd17cf31a60fe474a4ee62acc
Jul 18 01:15:00.706399 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.706321    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz" event={"ID":"6377da34-a799-4e68-ab64-5a3529d2a0ef","Type":"ContainerStarted","Data":"bb69edc5847704aac6e20e295f22e797b1e284dcd17cf31a60fe474a4ee62acc"}
Jul 18 01:15:00.853113 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.853088    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"]
Jul 18 01:15:00.854943 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:15:00.854916    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02699a78_4782_4c0a_9ee2_492bbeee5ec5.slice/crio-c142fec35f66ecf49b662887a8dd48b032dba152875750c3fed9b5615f4a3cfd WatchSource:0}: Error finding container c142fec35f66ecf49b662887a8dd48b032dba152875750c3fed9b5615f4a3cfd: Status 404 returned error can't find the container with id c142fec35f66ecf49b662887a8dd48b032dba152875750c3fed9b5615f4a3cfd
Jul 18 01:15:00.855122 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:00.855100    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"]
Jul 18 01:15:00.855725 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:15:00.855706    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde67d15_6590_4c6f_a6f4_065fd7cb9450.slice/crio-035827aae2d0e794f3a1729932387d7f346d227c5addb9dccd8107d6f69c7fd4 WatchSource:0}: Error finding container 035827aae2d0e794f3a1729932387d7f346d227c5addb9dccd8107d6f69c7fd4: Status 404 returned error can't find the container with id 035827aae2d0e794f3a1729932387d7f346d227c5addb9dccd8107d6f69c7fd4
Jul 18 01:15:01.713390 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:01.713353    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2" event={"ID":"cde67d15-6590-4c6f-a6f4-065fd7cb9450","Type":"ContainerStarted","Data":"6155abda1d740e128312f29cb8c1969cb882247b8c733df482ddd9c7790c1682"}
Jul 18 01:15:01.713825 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:01.713419    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2" event={"ID":"cde67d15-6590-4c6f-a6f4-065fd7cb9450","Type":"ContainerStarted","Data":"035827aae2d0e794f3a1729932387d7f346d227c5addb9dccd8107d6f69c7fd4"}
Jul 18 01:15:01.714838 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:01.714812    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz" event={"ID":"6377da34-a799-4e68-ab64-5a3529d2a0ef","Type":"ContainerStarted","Data":"e88b428aff50fc4726768adbbea32dbf562c82b6eeb7029a3f7356ce1db21c94"}
Jul 18 01:15:01.716178 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:01.716151    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb" event={"ID":"02699a78-4782-4c0a-9ee2-492bbeee5ec5","Type":"ContainerStarted","Data":"19ac1cbab86a6de52eead3736769359a7c03a2d597052fc1b292dd99b40dd31f"}
Jul 18 01:15:01.716286 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:01.716211    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb" event={"ID":"02699a78-4782-4c0a-9ee2-492bbeee5ec5","Type":"ContainerStarted","Data":"c142fec35f66ecf49b662887a8dd48b032dba152875750c3fed9b5615f4a3cfd"}
Jul 18 01:15:01.730807 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:01.730757    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2" podStartSLOduration=1.730742324 podStartE2EDuration="1.730742324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:15:01.728902217 +0000 UTC m=+2075.441013504" watchObservedRunningTime="2026-07-18 01:15:01.730742324 +0000 UTC m=+2075.442853609"
Jul 18 01:15:01.745321 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:01.745277    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz" podStartSLOduration=1.745261165 podStartE2EDuration="1.745261165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:15:01.7433759 +0000 UTC m=+2075.455487188" watchObservedRunningTime="2026-07-18 01:15:01.745261165 +0000 UTC m=+2075.457372450"
Jul 18 01:15:01.760625 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:01.760585    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb" podStartSLOduration=1.760571903 podStartE2EDuration="1.760571903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:15:01.759409569 +0000 UTC m=+2075.471520857" watchObservedRunningTime="2026-07-18 01:15:01.760571903 +0000 UTC m=+2075.472683187"
Jul 18 01:15:07.754817 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:07.754786    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:25.968121 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:25.968088    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:27.025031 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.025003    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:15:27.028298 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.028275    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:15:27.044705 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.044678    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:27.199395 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.199337    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:27.611691 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.611655    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:27.712168 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.712127    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:27.812206 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.812155    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:27.842177 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.842134    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"]
Jul 18 01:15:27.842376 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.842350    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d" podUID="db9fea32-2db2-4c0a-858d-d4140a6bc578" containerName="maas-api" containerID="cri-o://32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04" gracePeriod=30
Jul 18 01:15:27.871437 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.871411    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"]
Jul 18 01:15:27.871651 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.871628    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2" podUID="cde67d15-6590-4c6f-a6f4-065fd7cb9450" containerName="cleanup" containerID="cri-o://6155abda1d740e128312f29cb8c1969cb882247b8c733df482ddd9c7790c1682" gracePeriod=30
Jul 18 01:15:27.886987 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:27.886945    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:28.110649 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.110620    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:15:28.206216 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.206108    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq7zt\" (UniqueName: \"kubernetes.io/projected/db9fea32-2db2-4c0a-858d-d4140a6bc578-kube-api-access-bq7zt\") pod \"db9fea32-2db2-4c0a-858d-d4140a6bc578\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") "
Jul 18 01:15:28.206216 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.206179    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9fea32-2db2-4c0a-858d-d4140a6bc578-openshift-service-ca\") pod \"db9fea32-2db2-4c0a-858d-d4140a6bc578\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") "
Jul 18 01:15:28.206461 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.206230    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9fea32-2db2-4c0a-858d-d4140a6bc578-maas-api-tls\") pod \"db9fea32-2db2-4c0a-858d-d4140a6bc578\" (UID: \"db9fea32-2db2-4c0a-858d-d4140a6bc578\") "
Jul 18 01:15:28.206619 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.206597    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db9fea32-2db2-4c0a-858d-d4140a6bc578-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db9fea32-2db2-4c0a-858d-d4140a6bc578" (UID: "db9fea32-2db2-4c0a-858d-d4140a6bc578"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:15:28.208368 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.208343    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db9fea32-2db2-4c0a-858d-d4140a6bc578-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db9fea32-2db2-4c0a-858d-d4140a6bc578" (UID: "db9fea32-2db2-4c0a-858d-d4140a6bc578"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:15:28.208458 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.208348    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9fea32-2db2-4c0a-858d-d4140a6bc578-kube-api-access-bq7zt" (OuterVolumeSpecName: "kube-api-access-bq7zt") pod "db9fea32-2db2-4c0a-858d-d4140a6bc578" (UID: "db9fea32-2db2-4c0a-858d-d4140a6bc578"). InnerVolumeSpecName "kube-api-access-bq7zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:15:28.307676 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.307636    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9fea32-2db2-4c0a-858d-d4140a6bc578-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:15:28.307676 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.307668    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9fea32-2db2-4c0a-858d-d4140a6bc578-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:15:28.307676 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.307681    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq7zt\" (UniqueName: \"kubernetes.io/projected/db9fea32-2db2-4c0a-858d-d4140a6bc578-kube-api-access-bq7zt\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:15:28.858396 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.858365    2569 generic.go:356] "Generic (PLEG): container finished" podID="db9fea32-2db2-4c0a-858d-d4140a6bc578" containerID="32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04" exitCode=0
Jul 18 01:15:28.858568 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.858423    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"
Jul 18 01:15:28.858568 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.858444    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d" event={"ID":"db9fea32-2db2-4c0a-858d-d4140a6bc578","Type":"ContainerDied","Data":"32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04"}
Jul 18 01:15:28.858568 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.858499    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d" event={"ID":"db9fea32-2db2-4c0a-858d-d4140a6bc578","Type":"ContainerDied","Data":"2c59a041aafb3449b91ced81cba15696cbbf8f86a770c92cac5dda19efec8fba"}
Jul 18 01:15:28.858568 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.858513    2569 scope.go:117] "RemoveContainer" containerID="32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04"
Jul 18 01:15:28.867706 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.867689    2569 scope.go:117] "RemoveContainer" containerID="32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04"
Jul 18 01:15:28.867998 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:15:28.867978    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04\": container with ID starting with 32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04 not found: ID does not exist" containerID="32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04"
Jul 18 01:15:28.868053 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.868006    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04"} err="failed to get container status \"32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04\": rpc error: code = NotFound desc = could not find container \"32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04\": container with ID starting with 32b780dab52a04d62b0951d4ab426d65000849635c5dc254da58f8504b85ab04 not found: ID does not exist"
Jul 18 01:15:28.874895 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.874869    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"]
Jul 18 01:15:28.876869 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:28.876848    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3231-68886565f-hw29d"]
Jul 18 01:15:30.833578 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:30.833544    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db9fea32-2db2-4c0a-858d-d4140a6bc578" path="/var/lib/kubelet/pods/db9fea32-2db2-4c0a-858d-d4140a6bc578/volumes"
Jul 18 01:15:32.688694 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:32.688662    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:15:58.014995 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:58.014957    2569 generic.go:356] "Generic (PLEG): container finished" podID="cde67d15-6590-4c6f-a6f4-065fd7cb9450" containerID="6155abda1d740e128312f29cb8c1969cb882247b8c733df482ddd9c7790c1682" exitCode=137
Jul 18 01:15:58.015388 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:58.015010    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2" event={"ID":"cde67d15-6590-4c6f-a6f4-065fd7cb9450","Type":"ContainerDied","Data":"6155abda1d740e128312f29cb8c1969cb882247b8c733df482ddd9c7790c1682"}
Jul 18 01:15:58.067693 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:58.067671    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"
Jul 18 01:15:58.195967 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:58.195875    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j6hk\" (UniqueName: \"kubernetes.io/projected/cde67d15-6590-4c6f-a6f4-065fd7cb9450-kube-api-access-7j6hk\") pod \"cde67d15-6590-4c6f-a6f4-065fd7cb9450\" (UID: \"cde67d15-6590-4c6f-a6f4-065fd7cb9450\") "
Jul 18 01:15:58.197985 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:58.197960    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde67d15-6590-4c6f-a6f4-065fd7cb9450-kube-api-access-7j6hk" (OuterVolumeSpecName: "kube-api-access-7j6hk") pod "cde67d15-6590-4c6f-a6f4-065fd7cb9450" (UID: "cde67d15-6590-4c6f-a6f4-065fd7cb9450"). InnerVolumeSpecName "kube-api-access-7j6hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:15:58.297554 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:58.297508    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j6hk\" (UniqueName: \"kubernetes.io/projected/cde67d15-6590-4c6f-a6f4-065fd7cb9450-kube-api-access-7j6hk\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:15:59.021495 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:59.021466    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"
Jul 18 01:15:59.021902 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:59.021506    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2" event={"ID":"cde67d15-6590-4c6f-a6f4-065fd7cb9450","Type":"ContainerDied","Data":"035827aae2d0e794f3a1729932387d7f346d227c5addb9dccd8107d6f69c7fd4"}
Jul 18 01:15:59.021902 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:59.021569    2569 scope.go:117] "RemoveContainer" containerID="6155abda1d740e128312f29cb8c1969cb882247b8c733df482ddd9c7790c1682"
Jul 18 01:15:59.038515 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:59.038488    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"]
Jul 18 01:15:59.044102 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:15:59.044081    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9d3231-29738955-rf7q2"]
Jul 18 01:16:00.010694 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:00.010650    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"]
Jul 18 01:16:00.010972 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:00.010927    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz" podUID="6377da34-a799-4e68-ab64-5a3529d2a0ef" containerName="cleanup" containerID="cri-o://e88b428aff50fc4726768adbbea32dbf562c82b6eeb7029a3f7356ce1db21c94" gracePeriod=30
Jul 18 01:16:00.012974 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:00.012943    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"]
Jul 18 01:16:00.013182 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:00.013140    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb" podUID="02699a78-4782-4c0a-9ee2-492bbeee5ec5" containerName="cleanup" containerID="cri-o://19ac1cbab86a6de52eead3736769359a7c03a2d597052fc1b292dd99b40dd31f" gracePeriod=30
Jul 18 01:16:00.832111 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:00.832078    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cde67d15-6590-4c6f-a6f4-065fd7cb9450" path="/var/lib/kubelet/pods/cde67d15-6590-4c6f-a6f4-065fd7cb9450/volumes"
Jul 18 01:16:09.501875 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:09.501827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:09.831874 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:09.831765    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:10.331166 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:10.331137    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:10.715416 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:10.715377    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:10.816397 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:10.816352    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:10.917505 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:10.917474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:10.999292 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:10.999210    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"]
Jul 18 01:16:10.999702 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:10.999496    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5" podUID="ab9048b7-e4a9-4eed-b139-23948c4979f1" containerName="maas-api" containerID="cri-o://53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c" gracePeriod=30
Jul 18 01:16:11.031923 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.031896    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:11.245156 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.245133    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:16:11.320429 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.320342    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab9048b7-e4a9-4eed-b139-23948c4979f1-openshift-service-ca\") pod \"ab9048b7-e4a9-4eed-b139-23948c4979f1\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") "
Jul 18 01:16:11.320429 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.320419    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab9048b7-e4a9-4eed-b139-23948c4979f1-maas-api-tls\") pod \"ab9048b7-e4a9-4eed-b139-23948c4979f1\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") "
Jul 18 01:16:11.320662 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.320456    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tp5h\" (UniqueName: \"kubernetes.io/projected/ab9048b7-e4a9-4eed-b139-23948c4979f1-kube-api-access-9tp5h\") pod \"ab9048b7-e4a9-4eed-b139-23948c4979f1\" (UID: \"ab9048b7-e4a9-4eed-b139-23948c4979f1\") "
Jul 18 01:16:11.320723 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.320661    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab9048b7-e4a9-4eed-b139-23948c4979f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ab9048b7-e4a9-4eed-b139-23948c4979f1" (UID: "ab9048b7-e4a9-4eed-b139-23948c4979f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:16:11.322619 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.322591    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab9048b7-e4a9-4eed-b139-23948c4979f1-kube-api-access-9tp5h" (OuterVolumeSpecName: "kube-api-access-9tp5h") pod "ab9048b7-e4a9-4eed-b139-23948c4979f1" (UID: "ab9048b7-e4a9-4eed-b139-23948c4979f1"). InnerVolumeSpecName "kube-api-access-9tp5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:16:11.322747 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.322619    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab9048b7-e4a9-4eed-b139-23948c4979f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab9048b7-e4a9-4eed-b139-23948c4979f1" (UID: "ab9048b7-e4a9-4eed-b139-23948c4979f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:16:11.421497 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.421460    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tp5h\" (UniqueName: \"kubernetes.io/projected/ab9048b7-e4a9-4eed-b139-23948c4979f1-kube-api-access-9tp5h\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:11.421497 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.421489    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab9048b7-e4a9-4eed-b139-23948c4979f1-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:11.421497 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:11.421499    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab9048b7-e4a9-4eed-b139-23948c4979f1-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:12.091312 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.091276    2569 generic.go:356] "Generic (PLEG): container finished" podID="ab9048b7-e4a9-4eed-b139-23948c4979f1" containerID="53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c" exitCode=0
Jul 18 01:16:12.091730 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.091326    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"
Jul 18 01:16:12.091730 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.091363    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5" event={"ID":"ab9048b7-e4a9-4eed-b139-23948c4979f1","Type":"ContainerDied","Data":"53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c"}
Jul 18 01:16:12.091730 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.091418    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5" event={"ID":"ab9048b7-e4a9-4eed-b139-23948c4979f1","Type":"ContainerDied","Data":"d395dbbf47167534d5596ef3b8ded33a18ae2b6831c471dbc65440d2dbce08e2"}
Jul 18 01:16:12.091730 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.091442    2569 scope.go:117] "RemoveContainer" containerID="53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c"
Jul 18 01:16:12.100816 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.100799    2569 scope.go:117] "RemoveContainer" containerID="53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c"
Jul 18 01:16:12.101069 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:16:12.101047    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c\": container with ID starting with 53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c not found: ID does not exist" containerID="53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c"
Jul 18 01:16:12.101129 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.101082    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c"} err="failed to get container status \"53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c\": rpc error: code = NotFound desc = could not find container \"53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c\": container with ID starting with 53e13d85196fa90d192c436e9a013605e5fe3d3e4a1787e7507cc04a797fdd7c not found: ID does not exist"
Jul 18 01:16:12.114588 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.114565    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"]
Jul 18 01:16:12.118834 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.118812    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b13551-68d47f7c9-w4jq5"]
Jul 18 01:16:12.832581 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:12.832551    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab9048b7-e4a9-4eed-b139-23948c4979f1" path="/var/lib/kubelet/pods/ab9048b7-e4a9-4eed-b139-23948c4979f1/volumes"
Jul 18 01:16:16.383917 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:16.383884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:16.447588 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:16.447553    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:16.648501 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:16.648420    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:17.264817 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:17.264781    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:17.583048 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:17.582967    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:17.702010 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:17.701974    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:19.669541 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:19.669423    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:19.769682 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:19.769652    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:21.112262 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.112229    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"]
Jul 18 01:16:21.112941 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.112918    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9fea32-2db2-4c0a-858d-d4140a6bc578" containerName="maas-api"
Jul 18 01:16:21.113097 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.113081    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9fea32-2db2-4c0a-858d-d4140a6bc578" containerName="maas-api"
Jul 18 01:16:21.113261 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.113240    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cde67d15-6590-4c6f-a6f4-065fd7cb9450" containerName="cleanup"
Jul 18 01:16:21.113261 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.113261    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cde67d15-6590-4c6f-a6f4-065fd7cb9450" containerName="cleanup"
Jul 18 01:16:21.113443 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.113278    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab9048b7-e4a9-4eed-b139-23948c4979f1" containerName="maas-api"
Jul 18 01:16:21.113443 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.113289    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab9048b7-e4a9-4eed-b139-23948c4979f1" containerName="maas-api"
Jul 18 01:16:21.113443 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.113379    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cde67d15-6590-4c6f-a6f4-065fd7cb9450" containerName="cleanup"
Jul 18 01:16:21.113443 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.113391    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="db9fea32-2db2-4c0a-858d-d4140a6bc578" containerName="maas-api"
Jul 18 01:16:21.113443 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.113402    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab9048b7-e4a9-4eed-b139-23948c4979f1" containerName="maas-api"
Jul 18 01:16:21.117909 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.117886    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.120242 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.120220    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d16b2c-serving-cert\""
Jul 18 01:16:21.124024 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.124000    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"]
Jul 18 01:16:21.198010 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.197977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:21.212167 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.212139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b22dd97-f3bb-40b9-997f-8964493887d5-openshift-service-ca\") pod \"maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.212312 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.212187    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b22dd97-f3bb-40b9-997f-8964493887d5-maas-api-tls\") pod \"maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.212312 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.212257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5hw6\" (UniqueName: \"kubernetes.io/projected/4b22dd97-f3bb-40b9-997f-8964493887d5-kube-api-access-m5hw6\") pod \"maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.299261 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.299228    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:21.313588 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.313557    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5hw6\" (UniqueName: \"kubernetes.io/projected/4b22dd97-f3bb-40b9-997f-8964493887d5-kube-api-access-m5hw6\") pod \"maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.313784 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.313620    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b22dd97-f3bb-40b9-997f-8964493887d5-openshift-service-ca\") pod \"maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.313784 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.313688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b22dd97-f3bb-40b9-997f-8964493887d5-maas-api-tls\") pod \"maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.314339 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.314313    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b22dd97-f3bb-40b9-997f-8964493887d5-openshift-service-ca\") pod \"maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.316363 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.316338    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b22dd97-f3bb-40b9-997f-8964493887d5-maas-api-tls\") pod \"maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.325693 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.325665    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5hw6\" (UniqueName: \"kubernetes.io/projected/4b22dd97-f3bb-40b9-997f-8964493887d5-kube-api-access-m5hw6\") pod \"maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.437069 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.436975    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:21.593233 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.593051    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"]
Jul 18 01:16:21.596362 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:16:21.596334    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b22dd97_f3bb_40b9_997f_8964493887d5.slice/crio-eddb037ce78408d537f848950a54252b497c9438742e7c3057eed1be56e93e87 WatchSource:0}: Error finding container eddb037ce78408d537f848950a54252b497c9438742e7c3057eed1be56e93e87: Status 404 returned error can't find the container with id eddb037ce78408d537f848950a54252b497c9438742e7c3057eed1be56e93e87
Jul 18 01:16:21.630567 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.630527    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:21.733117 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:21.732998    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:22.157003 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:22.156952    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2" event={"ID":"4b22dd97-f3bb-40b9-997f-8964493887d5","Type":"ContainerStarted","Data":"21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b"}
Jul 18 01:16:22.157481 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:22.157038    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2" event={"ID":"4b22dd97-f3bb-40b9-997f-8964493887d5","Type":"ContainerStarted","Data":"eddb037ce78408d537f848950a54252b497c9438742e7c3057eed1be56e93e87"}
Jul 18 01:16:22.157481 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:22.157068    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:22.174560 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:22.174509    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2" podStartSLOduration=0.738537009 podStartE2EDuration="1.174492192s" totalImagesPullingTime="435.955183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:16:22.173007036 +0000 UTC m=+2155.885118321" watchObservedRunningTime="2026-07-18 01:16:22.174492192 +0000 UTC m=+2155.886603478"
Jul 18 01:16:25.576613 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:25.576579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:26.038766 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:26.038732    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:26.342628 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:26.342541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:26.506098 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:26.506070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:28.169531 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:28.169500    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:29.375698 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.375667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:29.448837 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.448800    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"]
Jul 18 01:16:29.452644 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.452617    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.454720 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.454694    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:29.455970 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.455950    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a6b1e0-serving-cert\""
Jul 18 01:16:29.463001 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.462978    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"]
Jul 18 01:16:29.518105 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.518068    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:29.603324 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.603290    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-openshift-service-ca\") pod \"maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.603501 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.603336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-maas-api-tls\") pod \"maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.603543 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.603504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtm4r\" (UniqueName: \"kubernetes.io/projected/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-kube-api-access-qtm4r\") pod \"maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.664711 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.664620    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:29.704545 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.704513    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtm4r\" (UniqueName: \"kubernetes.io/projected/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-kube-api-access-qtm4r\") pod \"maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.704705 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.704567    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-openshift-service-ca\") pod \"maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.704705 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.704600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-maas-api-tls\") pod \"maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.705232 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.705179    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-openshift-service-ca\") pod \"maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.707017 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.706997    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-maas-api-tls\") pod \"maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.712698 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.712664    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtm4r\" (UniqueName: \"kubernetes.io/projected/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-kube-api-access-qtm4r\") pod \"maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.766269 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.766229    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:29.795311 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.795279    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:29.911731 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.911697    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"]
Jul 18 01:16:29.916138 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:16:29.916067    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba3ce0e_cfaa_4a4b_9b46_d76519f2470f.slice/crio-356f87f7e65ac8234e89dfdd4e343694c197c3f5b66a151089ef3455ae77708d WatchSource:0}: Error finding container 356f87f7e65ac8234e89dfdd4e343694c197c3f5b66a151089ef3455ae77708d: Status 404 returned error can't find the container with id 356f87f7e65ac8234e89dfdd4e343694c197c3f5b66a151089ef3455ae77708d
Jul 18 01:16:29.937061 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:29.937035    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:30.037438 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.037408    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:30.209283 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.206383    2569 generic.go:356] "Generic (PLEG): container finished" podID="6377da34-a799-4e68-ab64-5a3529d2a0ef" containerID="e88b428aff50fc4726768adbbea32dbf562c82b6eeb7029a3f7356ce1db21c94" exitCode=137
Jul 18 01:16:30.209283 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.206494    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz" event={"ID":"6377da34-a799-4e68-ab64-5a3529d2a0ef","Type":"ContainerDied","Data":"e88b428aff50fc4726768adbbea32dbf562c82b6eeb7029a3f7356ce1db21c94"}
Jul 18 01:16:30.210498 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.210098    2569 generic.go:356] "Generic (PLEG): container finished" podID="02699a78-4782-4c0a-9ee2-492bbeee5ec5" containerID="19ac1cbab86a6de52eead3736769359a7c03a2d597052fc1b292dd99b40dd31f" exitCode=137
Jul 18 01:16:30.210498 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.210181    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb" event={"ID":"02699a78-4782-4c0a-9ee2-492bbeee5ec5","Type":"ContainerDied","Data":"19ac1cbab86a6de52eead3736769359a7c03a2d597052fc1b292dd99b40dd31f"}
Jul 18 01:16:30.212475 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.212444    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh" event={"ID":"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f","Type":"ContainerStarted","Data":"356f87f7e65ac8234e89dfdd4e343694c197c3f5b66a151089ef3455ae77708d"}
Jul 18 01:16:30.235969 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.235946    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"
Jul 18 01:16:30.261212 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.261157    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"
Jul 18 01:16:30.311320 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.311284    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v42g\" (UniqueName: \"kubernetes.io/projected/6377da34-a799-4e68-ab64-5a3529d2a0ef-kube-api-access-4v42g\") pod \"6377da34-a799-4e68-ab64-5a3529d2a0ef\" (UID: \"6377da34-a799-4e68-ab64-5a3529d2a0ef\") "
Jul 18 01:16:30.313351 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.313324    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6377da34-a799-4e68-ab64-5a3529d2a0ef-kube-api-access-4v42g" (OuterVolumeSpecName: "kube-api-access-4v42g") pod "6377da34-a799-4e68-ab64-5a3529d2a0ef" (UID: "6377da34-a799-4e68-ab64-5a3529d2a0ef"). InnerVolumeSpecName "kube-api-access-4v42g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:16:30.412127 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.412093    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jlw5\" (UniqueName: \"kubernetes.io/projected/02699a78-4782-4c0a-9ee2-492bbeee5ec5-kube-api-access-5jlw5\") pod \"02699a78-4782-4c0a-9ee2-492bbeee5ec5\" (UID: \"02699a78-4782-4c0a-9ee2-492bbeee5ec5\") "
Jul 18 01:16:30.412567 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.412476    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v42g\" (UniqueName: \"kubernetes.io/projected/6377da34-a799-4e68-ab64-5a3529d2a0ef-kube-api-access-4v42g\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:30.414494 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.414465    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02699a78-4782-4c0a-9ee2-492bbeee5ec5-kube-api-access-5jlw5" (OuterVolumeSpecName: "kube-api-access-5jlw5") pod "02699a78-4782-4c0a-9ee2-492bbeee5ec5" (UID: "02699a78-4782-4c0a-9ee2-492bbeee5ec5"). InnerVolumeSpecName "kube-api-access-5jlw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:16:30.513657 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:30.513629    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jlw5\" (UniqueName: \"kubernetes.io/projected/02699a78-4782-4c0a-9ee2-492bbeee5ec5-kube-api-access-5jlw5\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:31.218449 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.218413    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"
Jul 18 01:16:31.218449 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.218442    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb" event={"ID":"02699a78-4782-4c0a-9ee2-492bbeee5ec5","Type":"ContainerDied","Data":"c142fec35f66ecf49b662887a8dd48b032dba152875750c3fed9b5615f4a3cfd"}
Jul 18 01:16:31.218707 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.218506    2569 scope.go:117] "RemoveContainer" containerID="19ac1cbab86a6de52eead3736769359a7c03a2d597052fc1b292dd99b40dd31f"
Jul 18 01:16:31.220146 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.220119    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh" event={"ID":"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f","Type":"ContainerStarted","Data":"6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14"}
Jul 18 01:16:31.220286 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.220173    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:31.221611 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.221591    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz" event={"ID":"6377da34-a799-4e68-ab64-5a3529d2a0ef","Type":"ContainerDied","Data":"bb69edc5847704aac6e20e295f22e797b1e284dcd17cf31a60fe474a4ee62acc"}
Jul 18 01:16:31.221711 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.221622    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"
Jul 18 01:16:31.228336 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.228314    2569 scope.go:117] "RemoveContainer" containerID="e88b428aff50fc4726768adbbea32dbf562c82b6eeb7029a3f7356ce1db21c94"
Jul 18 01:16:31.238333 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.238288    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh" podStartSLOduration=1.742751129 podStartE2EDuration="2.238269325s" totalImagesPullingTime="495.518196ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:16:31.237772508 +0000 UTC m=+2164.949883793" watchObservedRunningTime="2026-07-18 01:16:31.238269325 +0000 UTC m=+2164.950380611"
Jul 18 01:16:31.249972 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.249934    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"]
Jul 18 01:16:31.253511 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.253490    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b13551-29738955-s4kjb"]
Jul 18 01:16:31.268141 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.268116    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"]
Jul 18 01:16:31.271981 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:31.271960    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738955-bqdjz"]
Jul 18 01:16:32.832323 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:32.832284    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02699a78-4782-4c0a-9ee2-492bbeee5ec5" path="/var/lib/kubelet/pods/02699a78-4782-4c0a-9ee2-492bbeee5ec5/volumes"
Jul 18 01:16:32.832699 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:32.832643    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6377da34-a799-4e68-ab64-5a3529d2a0ef" path="/var/lib/kubelet/pods/6377da34-a799-4e68-ab64-5a3529d2a0ef/volumes"
Jul 18 01:16:33.915653 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:33.915620    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:37.234332 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:37.234298    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:42.128873 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:42.128842    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:42.483350 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:42.483263    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:42.595061 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:42.595021    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:42.684679 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:42.684640    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:42.777611 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:42.777537    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"]
Jul 18 01:16:42.777779 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:42.777754    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2" podUID="4b22dd97-f3bb-40b9-997f-8964493887d5" containerName="maas-api" containerID="cri-o://21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b" gracePeriod=30
Jul 18 01:16:42.810097 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:42.810069    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:43.042125 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.042065    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:43.237767 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.237738    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5hw6\" (UniqueName: \"kubernetes.io/projected/4b22dd97-f3bb-40b9-997f-8964493887d5-kube-api-access-m5hw6\") pod \"4b22dd97-f3bb-40b9-997f-8964493887d5\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") "
Jul 18 01:16:43.237767 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.237773    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b22dd97-f3bb-40b9-997f-8964493887d5-maas-api-tls\") pod \"4b22dd97-f3bb-40b9-997f-8964493887d5\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") "
Jul 18 01:16:43.238256 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.237803    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b22dd97-f3bb-40b9-997f-8964493887d5-openshift-service-ca\") pod \"4b22dd97-f3bb-40b9-997f-8964493887d5\" (UID: \"4b22dd97-f3bb-40b9-997f-8964493887d5\") "
Jul 18 01:16:43.238330 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.238247    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b22dd97-f3bb-40b9-997f-8964493887d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b22dd97-f3bb-40b9-997f-8964493887d5" (UID: "4b22dd97-f3bb-40b9-997f-8964493887d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:16:43.240014 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.239990    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b22dd97-f3bb-40b9-997f-8964493887d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b22dd97-f3bb-40b9-997f-8964493887d5" (UID: "4b22dd97-f3bb-40b9-997f-8964493887d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:16:43.240127 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.240007    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b22dd97-f3bb-40b9-997f-8964493887d5-kube-api-access-m5hw6" (OuterVolumeSpecName: "kube-api-access-m5hw6") pod "4b22dd97-f3bb-40b9-997f-8964493887d5" (UID: "4b22dd97-f3bb-40b9-997f-8964493887d5"). InnerVolumeSpecName "kube-api-access-m5hw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:16:43.285452 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.285421    2569 generic.go:356] "Generic (PLEG): container finished" podID="4b22dd97-f3bb-40b9-997f-8964493887d5" containerID="21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b" exitCode=0
Jul 18 01:16:43.285594 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.285472    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"
Jul 18 01:16:43.285594 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.285508    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2" event={"ID":"4b22dd97-f3bb-40b9-997f-8964493887d5","Type":"ContainerDied","Data":"21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b"}
Jul 18 01:16:43.285594 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.285562    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2" event={"ID":"4b22dd97-f3bb-40b9-997f-8964493887d5","Type":"ContainerDied","Data":"eddb037ce78408d537f848950a54252b497c9438742e7c3057eed1be56e93e87"}
Jul 18 01:16:43.285594 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.285585    2569 scope.go:117] "RemoveContainer" containerID="21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b"
Jul 18 01:16:43.295316 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.295297    2569 scope.go:117] "RemoveContainer" containerID="21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b"
Jul 18 01:16:43.295570 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:16:43.295548    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b\": container with ID starting with 21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b not found: ID does not exist" containerID="21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b"
Jul 18 01:16:43.295642 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.295583    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b"} err="failed to get container status \"21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b\": rpc error: code = NotFound desc = could not find container \"21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b\": container with ID starting with 21ec6619cb1f38bd16a90baedc0f8052e9fd7ff6e4676ae0973595a0f9dcd90b not found: ID does not exist"
Jul 18 01:16:43.308380 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.308356    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"]
Jul 18 01:16:43.312048 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.312024    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d16b2c-5b5ffd8976-mx8p2"]
Jul 18 01:16:43.339628 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.339606    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5hw6\" (UniqueName: \"kubernetes.io/projected/4b22dd97-f3bb-40b9-997f-8964493887d5-kube-api-access-m5hw6\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:43.339686 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.339629    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b22dd97-f3bb-40b9-997f-8964493887d5-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:43.339686 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:43.339639    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b22dd97-f3bb-40b9-997f-8964493887d5-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:44.832713 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:44.832676    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b22dd97-f3bb-40b9-997f-8964493887d5" path="/var/lib/kubelet/pods/4b22dd97-f3bb-40b9-997f-8964493887d5/volumes"
Jul 18 01:16:48.362695 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:48.362660    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:48.424088 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:48.424058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:48.634953 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:48.634858    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:49.039613 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:49.039535    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:49.445509 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:49.445477    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:49.585941 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:49.585908    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:49.679705 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:49.679666    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:49.823340 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:49.822763    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"]
Jul 18 01:16:49.823340 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:49.823060    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh" podUID="1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f" containerName="maas-api" containerID="cri-o://6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14" gracePeriod=30
Jul 18 01:16:49.851299 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:49.851266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:50.079096 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.079031    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:50.105167 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.105138    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-openshift-service-ca\") pod \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") "
Jul 18 01:16:50.105370 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.105301    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-maas-api-tls\") pod \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") "
Jul 18 01:16:50.105370 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.105341    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtm4r\" (UniqueName: \"kubernetes.io/projected/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-kube-api-access-qtm4r\") pod \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\" (UID: \"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f\") "
Jul 18 01:16:50.105515 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.105488    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f" (UID: "1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:16:50.105748 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.105720    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:50.107487 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.107460    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-kube-api-access-qtm4r" (OuterVolumeSpecName: "kube-api-access-qtm4r") pod "1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f" (UID: "1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f"). InnerVolumeSpecName "kube-api-access-qtm4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:16:50.107581 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.107507    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f" (UID: "1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:16:50.206456 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.206421    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:50.206456 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.206451    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtm4r\" (UniqueName: \"kubernetes.io/projected/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f-kube-api-access-qtm4r\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:16:50.330875 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.330783    2569 generic.go:356] "Generic (PLEG): container finished" podID="1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f" containerID="6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14" exitCode=0
Jul 18 01:16:50.330875 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.330831    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"
Jul 18 01:16:50.331060 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.330867    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh" event={"ID":"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f","Type":"ContainerDied","Data":"6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14"}
Jul 18 01:16:50.331060 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.330922    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh" event={"ID":"1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f","Type":"ContainerDied","Data":"356f87f7e65ac8234e89dfdd4e343694c197c3f5b66a151089ef3455ae77708d"}
Jul 18 01:16:50.331060 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.330947    2569 scope.go:117] "RemoveContainer" containerID="6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14"
Jul 18 01:16:50.340000 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.339979    2569 scope.go:117] "RemoveContainer" containerID="6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14"
Jul 18 01:16:50.340303 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:16:50.340283    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14\": container with ID starting with 6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14 not found: ID does not exist" containerID="6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14"
Jul 18 01:16:50.340377 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.340315    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14"} err="failed to get container status \"6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14\": rpc error: code = NotFound desc = could not find container \"6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14\": container with ID starting with 6bddfda26011e8d0e8bf64f21118d240f2043e114007486f58e32112e9ae9b14 not found: ID does not exist"
Jul 18 01:16:50.352570 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.352545    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"]
Jul 18 01:16:50.356555 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.356533    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6b1e0-56bb9cbb88-ww2wh"]
Jul 18 01:16:50.832184 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:50.832148    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f" path="/var/lib/kubelet/pods/1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f/volumes"
Jul 18 01:16:55.040589 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:55.040550    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:55.141115 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:55.141083    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:55.321083 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:55.321002    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:55.862813 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:55.862778    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:56.202729 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:56.202654    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:56.375273 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:56.375234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:59.203180 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.203147    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:59.308307 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.308275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:59.422895 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.422859    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"]
Jul 18 01:16:59.423298 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423283    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02699a78-4782-4c0a-9ee2-492bbeee5ec5" containerName="cleanup"
Jul 18 01:16:59.423355 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423299    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="02699a78-4782-4c0a-9ee2-492bbeee5ec5" containerName="cleanup"
Jul 18 01:16:59.423355 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423308    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f" containerName="maas-api"
Jul 18 01:16:59.423355 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423314    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f" containerName="maas-api"
Jul 18 01:16:59.423355 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423331    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6377da34-a799-4e68-ab64-5a3529d2a0ef" containerName="cleanup"
Jul 18 01:16:59.423355 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423337    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6377da34-a799-4e68-ab64-5a3529d2a0ef" containerName="cleanup"
Jul 18 01:16:59.423355 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423356    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b22dd97-f3bb-40b9-997f-8964493887d5" containerName="maas-api"
Jul 18 01:16:59.423537 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423361    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b22dd97-f3bb-40b9-997f-8964493887d5" containerName="maas-api"
Jul 18 01:16:59.423537 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423423    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba3ce0e-cfaa-4a4b-9b46-d76519f2470f" containerName="maas-api"
Jul 18 01:16:59.423537 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423431    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6377da34-a799-4e68-ab64-5a3529d2a0ef" containerName="cleanup"
Jul 18 01:16:59.423537 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423439    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="02699a78-4782-4c0a-9ee2-492bbeee5ec5" containerName="cleanup"
Jul 18 01:16:59.423537 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.423446    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b22dd97-f3bb-40b9-997f-8964493887d5" containerName="maas-api"
Jul 18 01:16:59.426625 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.426609    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.429751 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.429728    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-5a99f1-serving-cert\""
Jul 18 01:16:59.439158 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.439134    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"]
Jul 18 01:16:59.460655 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.460570    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:59.497498 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.497473    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97309b41-bb2e-4646-9aac-143c8dddd211-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.497645 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.497531    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmqr5\" (UniqueName: \"kubernetes.io/projected/97309b41-bb2e-4646-9aac-143c8dddd211-kube-api-access-mmqr5\") pod \"maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.497645 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.497583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97309b41-bb2e-4646-9aac-143c8dddd211-maas-api-tls\") pod \"maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.579045 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.579010    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:16:59.599045 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.599011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97309b41-bb2e-4646-9aac-143c8dddd211-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.599227 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.599091    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqr5\" (UniqueName: \"kubernetes.io/projected/97309b41-bb2e-4646-9aac-143c8dddd211-kube-api-access-mmqr5\") pod \"maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.599227 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.599139    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97309b41-bb2e-4646-9aac-143c8dddd211-maas-api-tls\") pod \"maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.599651 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.599633    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97309b41-bb2e-4646-9aac-143c8dddd211-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.601612 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.601581    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97309b41-bb2e-4646-9aac-143c8dddd211-maas-api-tls\") pod \"maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.608485 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.608459    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmqr5\" (UniqueName: \"kubernetes.io/projected/97309b41-bb2e-4646-9aac-143c8dddd211-kube-api-access-mmqr5\") pod \"maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.736939 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.736854    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:16:59.883707 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.883682    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"]
Jul 18 01:16:59.886212 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:16:59.886165    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97309b41_bb2e_4646_9aac_143c8dddd211.slice/crio-95ae540e6e7f3b6ecb5b338fc9e05b22f0014292091e846d040fc3d2666e543d WatchSource:0}: Error finding container 95ae540e6e7f3b6ecb5b338fc9e05b22f0014292091e846d040fc3d2666e543d: Status 404 returned error can't find the container with id 95ae540e6e7f3b6ecb5b338fc9e05b22f0014292091e846d040fc3d2666e543d
Jul 18 01:16:59.958657 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:16:59.958620    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:00.059962 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:00.059882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:00.388138 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:00.388105    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj" event={"ID":"97309b41-bb2e-4646-9aac-143c8dddd211","Type":"ContainerStarted","Data":"e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f"}
Jul 18 01:17:00.388548 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:00.388160    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj" event={"ID":"97309b41-bb2e-4646-9aac-143c8dddd211","Type":"ContainerStarted","Data":"95ae540e6e7f3b6ecb5b338fc9e05b22f0014292091e846d040fc3d2666e543d"}
Jul 18 01:17:00.388548 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:00.388185    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:17:00.405736 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:00.405689    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj" podStartSLOduration=1.037175374 podStartE2EDuration="1.405672217s" totalImagesPullingTime="368.496843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:17:00.404004026 +0000 UTC m=+2194.116115312" watchObservedRunningTime="2026-07-18 01:17:00.405672217 +0000 UTC m=+2194.117783502"
Jul 18 01:17:03.679629 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:03.679592    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:04.006506 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:04.006424    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:04.332433 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:04.332329    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:04.618126 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:04.618094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:06.397847 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:06.397813    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:17:07.775085 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.775044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:07.858414 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.858372    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"]
Jul 18 01:17:07.862779 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.862757    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:07.865248 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.865221    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-0f09f3-serving-cert\""
Jul 18 01:17:07.878174 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.878147    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"]
Jul 18 01:17:07.881793 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.881760    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:07.980156 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.980119    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4g64\" (UniqueName: \"kubernetes.io/projected/dc97d924-9f53-4534-a1df-f003a7cd324e-kube-api-access-d4g64\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:07.980374 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.980237    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:07.980446 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.980365    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc97d924-9f53-4534-a1df-f003a7cd324e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:07.990784 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:07.990761    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:08.081713 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:08.081638    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc97d924-9f53-4534-a1df-f003a7cd324e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:08.081845 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:08.081726    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g64\" (UniqueName: \"kubernetes.io/projected/dc97d924-9f53-4534-a1df-f003a7cd324e-kube-api-access-d4g64\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:08.081845 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:08.081768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:08.081917 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:17:08.081871    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-serving-cert: secret "maas-api-e2e-shared-b-0f09f3-serving-cert" not found
Jul 18 01:17:08.081955 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:17:08.081931    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls podName:dc97d924-9f53-4534-a1df-f003a7cd324e nodeName:}" failed. No retries permitted until 2026-07-18 01:17:08.58191107 +0000 UTC m=+2202.294022336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls") pod "maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk" (UID: "dc97d924-9f53-4534-a1df-f003a7cd324e") : secret "maas-api-e2e-shared-b-0f09f3-serving-cert" not found
Jul 18 01:17:08.082398 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:08.082371    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc97d924-9f53-4534-a1df-f003a7cd324e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:08.099420 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:08.099392    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4g64\" (UniqueName: \"kubernetes.io/projected/dc97d924-9f53-4534-a1df-f003a7cd324e-kube-api-access-d4g64\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:08.563859 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:08.563824    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:08.586977 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:08.586946    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:08.587171 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:17:08.587122    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-serving-cert: secret "maas-api-e2e-shared-b-0f09f3-serving-cert" not found
Jul 18 01:17:08.587268 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:17:08.587212    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls podName:dc97d924-9f53-4534-a1df-f003a7cd324e nodeName:}" failed. No retries permitted until 2026-07-18 01:17:09.587177461 +0000 UTC m=+2203.299288737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls") pod "maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk" (UID: "dc97d924-9f53-4534-a1df-f003a7cd324e") : secret "maas-api-e2e-shared-b-0f09f3-serving-cert" not found
Jul 18 01:17:08.661832 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:08.661801    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:08.772954 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:08.772924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:09.596724 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:09.596684    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:09.599264 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:09.599244    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls\") pod \"maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:09.674012 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:09.673971    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:09.812440 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:09.812414    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"]
Jul 18 01:17:09.814510 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:17:09.814480    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc97d924_9f53_4534_a1df_f003a7cd324e.slice/crio-f1f8cc1f7e791f0e30ed422bcb1a0ce77713a0c06067d5e33fe9cdb267ae1a23 WatchSource:0}: Error finding container f1f8cc1f7e791f0e30ed422bcb1a0ce77713a0c06067d5e33fe9cdb267ae1a23: Status 404 returned error can't find the container with id f1f8cc1f7e791f0e30ed422bcb1a0ce77713a0c06067d5e33fe9cdb267ae1a23
Jul 18 01:17:10.440650 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:10.440562    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk" event={"ID":"dc97d924-9f53-4534-a1df-f003a7cd324e","Type":"ContainerStarted","Data":"4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853"}
Jul 18 01:17:10.440650 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:10.440614    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk" event={"ID":"dc97d924-9f53-4534-a1df-f003a7cd324e","Type":"ContainerStarted","Data":"f1f8cc1f7e791f0e30ed422bcb1a0ce77713a0c06067d5e33fe9cdb267ae1a23"}
Jul 18 01:17:10.440817 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:10.440696    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:10.457017 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:10.456968    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk" podStartSLOduration=3.09127239 podStartE2EDuration="3.456953265s" totalImagesPullingTime="365.680875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:17:10.455954658 +0000 UTC m=+2204.168065953" watchObservedRunningTime="2026-07-18 01:17:10.456953265 +0000 UTC m=+2204.169064589"
Jul 18 01:17:12.178555 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:12.178518    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:16.451852 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:16.451817    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:17:20.682478 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:20.682438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:20.782985 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:20.782944    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:29.399022 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:29.398983    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:29.500418 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:29.500382    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:17:58.788076 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:17:58.788039    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:18:11.337742 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:18:11.337710    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:17.120797 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:17.120762    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:17.475689 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:17.475608    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:17.572500 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:17.572465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:17.675293 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:17.675256    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:17.799455 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:17.799369    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"]
Jul 18 01:20:17.799648 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:17.799619    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj" podUID="97309b41-bb2e-4646-9aac-143c8dddd211" containerName="maas-api" containerID="cri-o://e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f" gracePeriod=30
Jul 18 01:20:17.819948 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:17.819927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:18.065920 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.065897    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:20:18.141864 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.141828    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmqr5\" (UniqueName: \"kubernetes.io/projected/97309b41-bb2e-4646-9aac-143c8dddd211-kube-api-access-mmqr5\") pod \"97309b41-bb2e-4646-9aac-143c8dddd211\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") "
Jul 18 01:20:18.142344 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.141909    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97309b41-bb2e-4646-9aac-143c8dddd211-maas-api-tls\") pod \"97309b41-bb2e-4646-9aac-143c8dddd211\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") "
Jul 18 01:20:18.142344 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.141972    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97309b41-bb2e-4646-9aac-143c8dddd211-openshift-service-ca\") pod \"97309b41-bb2e-4646-9aac-143c8dddd211\" (UID: \"97309b41-bb2e-4646-9aac-143c8dddd211\") "
Jul 18 01:20:18.142488 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.142431    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97309b41-bb2e-4646-9aac-143c8dddd211-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "97309b41-bb2e-4646-9aac-143c8dddd211" (UID: "97309b41-bb2e-4646-9aac-143c8dddd211"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:20:18.143927 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.143904    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97309b41-bb2e-4646-9aac-143c8dddd211-kube-api-access-mmqr5" (OuterVolumeSpecName: "kube-api-access-mmqr5") pod "97309b41-bb2e-4646-9aac-143c8dddd211" (UID: "97309b41-bb2e-4646-9aac-143c8dddd211"). InnerVolumeSpecName "kube-api-access-mmqr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:20:18.144014 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.143988    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97309b41-bb2e-4646-9aac-143c8dddd211-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "97309b41-bb2e-4646-9aac-143c8dddd211" (UID: "97309b41-bb2e-4646-9aac-143c8dddd211"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:20:18.243683 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.243646    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97309b41-bb2e-4646-9aac-143c8dddd211-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:20:18.243683 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.243679    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmqr5\" (UniqueName: \"kubernetes.io/projected/97309b41-bb2e-4646-9aac-143c8dddd211-kube-api-access-mmqr5\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:20:18.243683 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.243690    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97309b41-bb2e-4646-9aac-143c8dddd211-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:20:18.395604 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.395570    2569 generic.go:356] "Generic (PLEG): container finished" podID="97309b41-bb2e-4646-9aac-143c8dddd211" containerID="e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f" exitCode=0
Jul 18 01:20:18.395822 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.395616    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"
Jul 18 01:20:18.395822 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.395629    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj" event={"ID":"97309b41-bb2e-4646-9aac-143c8dddd211","Type":"ContainerDied","Data":"e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f"}
Jul 18 01:20:18.395822 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.395686    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj" event={"ID":"97309b41-bb2e-4646-9aac-143c8dddd211","Type":"ContainerDied","Data":"95ae540e6e7f3b6ecb5b338fc9e05b22f0014292091e846d040fc3d2666e543d"}
Jul 18 01:20:18.395822 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.395716    2569 scope.go:117] "RemoveContainer" containerID="e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f"
Jul 18 01:20:18.405949 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.405932    2569 scope.go:117] "RemoveContainer" containerID="e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f"
Jul 18 01:20:18.406609 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:20:18.406524    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f\": container with ID starting with e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f not found: ID does not exist" containerID="e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f"
Jul 18 01:20:18.406609 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.406579    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f"} err="failed to get container status \"e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f\": rpc error: code = NotFound desc = could not find container \"e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f\": container with ID starting with e56d8a0802278257bb46aaa110399974b95c7c89a630311a697c2cc3d0cb430f not found: ID does not exist"
Jul 18 01:20:18.419930 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.419898    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"]
Jul 18 01:20:18.423291 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.423265    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a99f1-7d86f8c5bd-6nkrj"]
Jul 18 01:20:18.832633 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:18.832549    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97309b41-bb2e-4646-9aac-143c8dddd211" path="/var/lib/kubelet/pods/97309b41-bb2e-4646-9aac-143c8dddd211/volumes"
Jul 18 01:20:23.272428 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:23.272392    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:23.373188 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:23.373152    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:23.525238 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:23.525116    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:24.017175 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:24.017115    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:24.448863 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:24.448797    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:24.545532 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:24.545492    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:24.652822 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:24.652788    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:24.799156 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:24.799074    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"]
Jul 18 01:20:24.799398 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:24.799370    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk" podUID="dc97d924-9f53-4534-a1df-f003a7cd324e" containerName="maas-api" containerID="cri-o://4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853" gracePeriod=30
Jul 18 01:20:24.830939 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:24.830908    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:25.059114 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.059048    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:20:25.112676 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.112650    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4g64\" (UniqueName: \"kubernetes.io/projected/dc97d924-9f53-4534-a1df-f003a7cd324e-kube-api-access-d4g64\") pod \"dc97d924-9f53-4534-a1df-f003a7cd324e\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") "
Jul 18 01:20:25.112830 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.112767    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls\") pod \"dc97d924-9f53-4534-a1df-f003a7cd324e\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") "
Jul 18 01:20:25.112830 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.112811    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc97d924-9f53-4534-a1df-f003a7cd324e-openshift-service-ca\") pod \"dc97d924-9f53-4534-a1df-f003a7cd324e\" (UID: \"dc97d924-9f53-4534-a1df-f003a7cd324e\") "
Jul 18 01:20:25.113188 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.113166    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc97d924-9f53-4534-a1df-f003a7cd324e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc97d924-9f53-4534-a1df-f003a7cd324e" (UID: "dc97d924-9f53-4534-a1df-f003a7cd324e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:20:25.114735 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.114711    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc97d924-9f53-4534-a1df-f003a7cd324e-kube-api-access-d4g64" (OuterVolumeSpecName: "kube-api-access-d4g64") pod "dc97d924-9f53-4534-a1df-f003a7cd324e" (UID: "dc97d924-9f53-4534-a1df-f003a7cd324e"). InnerVolumeSpecName "kube-api-access-d4g64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:20:25.114840 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.114804    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc97d924-9f53-4534-a1df-f003a7cd324e" (UID: "dc97d924-9f53-4534-a1df-f003a7cd324e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:20:25.214478 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.214444    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4g64\" (UniqueName: \"kubernetes.io/projected/dc97d924-9f53-4534-a1df-f003a7cd324e-kube-api-access-d4g64\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:20:25.214478 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.214474    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc97d924-9f53-4534-a1df-f003a7cd324e-maas-api-tls\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:20:25.214478 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.214483    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc97d924-9f53-4534-a1df-f003a7cd324e-openshift-service-ca\") on node \"ip-10-0-142-221.ec2.internal\" DevicePath \"\""
Jul 18 01:20:25.434020 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.433984    2569 generic.go:356] "Generic (PLEG): container finished" podID="dc97d924-9f53-4534-a1df-f003a7cd324e" containerID="4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853" exitCode=0
Jul 18 01:20:25.434246 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.434025    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk" event={"ID":"dc97d924-9f53-4534-a1df-f003a7cd324e","Type":"ContainerDied","Data":"4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853"}
Jul 18 01:20:25.434246 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.434072    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk" event={"ID":"dc97d924-9f53-4534-a1df-f003a7cd324e","Type":"ContainerDied","Data":"f1f8cc1f7e791f0e30ed422bcb1a0ce77713a0c06067d5e33fe9cdb267ae1a23"}
Jul 18 01:20:25.434246 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.434100    2569 scope.go:117] "RemoveContainer" containerID="4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853"
Jul 18 01:20:25.434246 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.434029    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"
Jul 18 01:20:25.443827 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.443809    2569 scope.go:117] "RemoveContainer" containerID="4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853"
Jul 18 01:20:25.444077 ip-10-0-142-221 kubenswrapper[2569]: E0718 01:20:25.444058    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853\": container with ID starting with 4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853 not found: ID does not exist" containerID="4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853"
Jul 18 01:20:25.444143 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.444087    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853"} err="failed to get container status \"4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853\": rpc error: code = NotFound desc = could not find container \"4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853\": container with ID starting with 4eb6f231340c595133faeadbe19d371383156d9035d3a7c2bc8d16f6f05d7853 not found: ID does not exist"
Jul 18 01:20:25.456306 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.456283    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"]
Jul 18 01:20:25.459905 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:25.459884    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0f09f3-5685dc99d8-lmfkk"]
Jul 18 01:20:26.833819 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:26.833782    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc97d924-9f53-4534-a1df-f003a7cd324e" path="/var/lib/kubelet/pods/dc97d924-9f53-4534-a1df-f003a7cd324e/volumes"
Jul 18 01:20:27.057307 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:27.057281    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:20:27.060577 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:27.060556    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgtfv_10f69fbb-a959-4134-8bac-774133c880eb/ovn-acl-logging/0.log"
Jul 18 01:20:30.557503 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:30.557469    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:30.661018 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:30.660984    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:30.824650 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:30.824576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:36.235422 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:36.235380    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6xhz4_527e3d6c-781a-492e-bc44-0cce3780e4e8/manager/0.log"
Jul 18 01:20:36.356505 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:36.356461    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-27zj7_8f4bf076-dec8-435f-b3fe-0e33330de605/manager/0.log"
Jul 18 01:20:36.476692 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:36.476659    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-768c66bff7-7z6n4_a28317cd-a353-472f-a53b-2d50a1c29094/manager/0.log"
Jul 18 01:20:36.590884 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:36.590807    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q28lc_f28e7be2-6fc4-4777-bfce-d955ecac0029/server/0.log"
Jul 18 01:20:36.705534 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:36.705505    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-k27wl_257c49ef-bf57-437d-be2f-47bbb83e4236/manager/0.log"
Jul 18 01:20:36.824791 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:36.824763    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-dq64t_174dcb18-92e3-4bae-b5b0-317a764fdc47/copy-manifests/0.log"
Jul 18 01:20:36.832269 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:36.832248    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-dq64t_174dcb18-92e3-4bae-b5b0-317a764fdc47/manager/0.log"
Jul 18 01:20:38.522314 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:38.522279    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-52j82_2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28/manager/0.log"
Jul 18 01:20:39.702223 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:39.702167    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mtdqs_98c8fab2-6a4c-496a-ad99-ebab331066de/discovery/0.log"
Jul 18 01:20:39.928797 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:39.928764    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54498b876f-mc4hz_3aba05fd-4990-47f3-bae3-83d258f8a3a6/kube-auth-proxy/0.log"
Jul 18 01:20:40.166072 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:40.166044    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xqxkf_8be910a1-0957-4659-ac3b-6c7213629050/payload-pre-processing/0.log"
Jul 18 01:20:40.289569 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:40.289538    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dl6bm_8cd20c00-2b97-406c-a073-437a4ed6f8d2/payload-processing/0.log"
Jul 18 01:20:40.404086 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:40.404062    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75cf4cd9bb-ggh9t_d69ca821-3563-43fb-95c7-619da8186293/router/0.log"
Jul 18 01:20:40.854912 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:40.854882    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-rqtdx_70836de2-1b22-46ae-a301-a37ac894eb45/main/0.log"
Jul 18 01:20:40.968911 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:40.968884    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9whr7_3eac6af4-abba-4def-8df5-517be62bac26/main/0.log"
Jul 18 01:20:41.196488 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:41.196415    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cvqgk_c517d99b-3afd-424f-9437-d23f13c8ff2d/main/0.log"
Jul 18 01:20:43.168446 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:43.168410    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:45.471635 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:45.471607    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:45.607040 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:45.607010    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log" limit=1024
Jul 18 01:20:48.256120 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:48.256084    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5g8kc_e95a1c22-8d46-4a2a-992c-b256526539c5/global-pull-secret-syncer/0.log"
Jul 18 01:20:48.458034 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:48.458005    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7trqs_7be8df99-0b89-4839-8d1b-4c0b4c1d8da3/konnectivity-agent/0.log"
Jul 18 01:20:48.597690 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:48.597661    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-221.ec2.internal_3ee29b9f5c56eaea9fcbfaf63581c9a2/haproxy/0.log"
Jul 18 01:20:53.635152 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:53.635118    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-52j82_2dffcc1b-e8a5-4aca-b34d-a3d9b1a0fd28/manager/0.log"
Jul 18 01:20:55.842976 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:55.842893    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-xphp9_17e89550-7ad4-4238-8256-ce6714057522/cluster-monitoring-operator/0.log"
Jul 18 01:20:55.975761 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:55.975738    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66f78ffdd5-wnr67_8a99a7cd-2fd7-40ce-8013-6f537412032d/metrics-server/0.log"
Jul 18 01:20:56.004895 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.004870    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-dqq5r_331451d1-2832-4f76-b12d-91886eee8593/monitoring-plugin/0.log"
Jul 18 01:20:56.037908 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.037882    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8jbmt_3d469a0d-5bc0-49dd-aae2-d858b2459136/node-exporter/0.log"
Jul 18 01:20:56.059111 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.059089    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8jbmt_3d469a0d-5bc0-49dd-aae2-d858b2459136/kube-rbac-proxy/0.log"
Jul 18 01:20:56.083784 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.083764    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8jbmt_3d469a0d-5bc0-49dd-aae2-d858b2459136/init-textfile/0.log"
Jul 18 01:20:56.361547 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.361513    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_242f4bcc-90d0-4da6-af50-dbe1118177a2/prometheus/0.log"
Jul 18 01:20:56.389441 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.389415    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_242f4bcc-90d0-4da6-af50-dbe1118177a2/config-reloader/0.log"
Jul 18 01:20:56.415863 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.415835    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_242f4bcc-90d0-4da6-af50-dbe1118177a2/thanos-sidecar/0.log"
Jul 18 01:20:56.437445 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.437376    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_242f4bcc-90d0-4da6-af50-dbe1118177a2/kube-rbac-proxy-web/0.log"
Jul 18 01:20:56.461061 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.461040    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_242f4bcc-90d0-4da6-af50-dbe1118177a2/kube-rbac-proxy/0.log"
Jul 18 01:20:56.482704 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.482685    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_242f4bcc-90d0-4da6-af50-dbe1118177a2/kube-rbac-proxy-thanos/0.log"
Jul 18 01:20:56.505207 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.505177    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_242f4bcc-90d0-4da6-af50-dbe1118177a2/init-config-reloader/0.log"
Jul 18 01:20:56.618440 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.618403    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dbb8c979b-jh4c5_b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af/telemeter-client/0.log"
Jul 18 01:20:56.645647 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.645622    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dbb8c979b-jh4c5_b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af/reload/0.log"
Jul 18 01:20:56.666524 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.666499    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dbb8c979b-jh4c5_b63bf9fc-ab9e-4fd4-94b8-ccc9895fb2af/kube-rbac-proxy/0.log"
Jul 18 01:20:56.713077 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.713002    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65d9d66f8b-gf94g_c5bca30c-e637-4d44-ac2d-f77dd9621582/thanos-query/0.log"
Jul 18 01:20:56.738800 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.738773    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65d9d66f8b-gf94g_c5bca30c-e637-4d44-ac2d-f77dd9621582/kube-rbac-proxy-web/0.log"
Jul 18 01:20:56.761830 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.761803    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65d9d66f8b-gf94g_c5bca30c-e637-4d44-ac2d-f77dd9621582/kube-rbac-proxy/0.log"
Jul 18 01:20:56.780646 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.780623    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65d9d66f8b-gf94g_c5bca30c-e637-4d44-ac2d-f77dd9621582/prom-label-proxy/0.log"
Jul 18 01:20:56.804693 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.804674    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65d9d66f8b-gf94g_c5bca30c-e637-4d44-ac2d-f77dd9621582/kube-rbac-proxy-rules/0.log"
Jul 18 01:20:56.825830 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:56.825799    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65d9d66f8b-gf94g_c5bca30c-e637-4d44-ac2d-f77dd9621582/kube-rbac-proxy-metrics/0.log"
Jul 18 01:20:58.302667 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.302629    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"]
Jul 18 01:20:58.303042 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.303029    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97309b41-bb2e-4646-9aac-143c8dddd211" containerName="maas-api"
Jul 18 01:20:58.303086 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.303043    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="97309b41-bb2e-4646-9aac-143c8dddd211" containerName="maas-api"
Jul 18 01:20:58.303086 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.303065    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc97d924-9f53-4534-a1df-f003a7cd324e" containerName="maas-api"
Jul 18 01:20:58.303086 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.303071    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc97d924-9f53-4534-a1df-f003a7cd324e" containerName="maas-api"
Jul 18 01:20:58.303181 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.303139    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc97d924-9f53-4534-a1df-f003a7cd324e" containerName="maas-api"
Jul 18 01:20:58.303181 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.303152    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="97309b41-bb2e-4646-9aac-143c8dddd211" containerName="maas-api"
Jul 18 01:20:58.306730 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.306714    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.309167 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.309143    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z5qjz\"/\"kube-root-ca.crt\""
Jul 18 01:20:58.309337 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.309166    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z5qjz\"/\"default-dockercfg-k524g\""
Jul 18 01:20:58.310266 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.310241    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z5qjz\"/\"openshift-service-ca.crt\""
Jul 18 01:20:58.313361 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.313327    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"]
Jul 18 01:20:58.337351 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.337323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-lib-modules\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.337499 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.337383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-podres\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.337499 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.337485    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-proc\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.337579 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.337527    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkc85\" (UniqueName: \"kubernetes.io/projected/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-kube-api-access-vkc85\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.337614 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.337586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-sys\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.438320 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.438287    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-podres\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.438518 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.438344    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-proc\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.438518 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.438374    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkc85\" (UniqueName: \"kubernetes.io/projected/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-kube-api-access-vkc85\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.438518 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.438403    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-sys\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.438518 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.438442    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-lib-modules\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.438518 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.438464    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-podres\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.438518 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.438486    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-proc\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.438518 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.438515    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-sys\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.438865 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.438590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-lib-modules\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.446976 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.446955    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkc85\" (UniqueName: \"kubernetes.io/projected/0c7bf487-8fc2-4fde-af6f-9a0e9af83867-kube-api-access-vkc85\") pod \"perf-node-gather-daemonset-z9vxf\" (UID: \"0c7bf487-8fc2-4fde-af6f-9a0e9af83867\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.617785 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.617748    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:58.758689 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:58.758666    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"]
Jul 18 01:20:58.762070 ip-10-0-142-221 kubenswrapper[2569]: W0718 01:20:58.762038    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0c7bf487_8fc2_4fde_af6f_9a0e9af83867.slice/crio-6ddd52edb994127669d64d54de7ec81d3b8ad6f81b73dc053e4c303b2d7220c8 WatchSource:0}: Error finding container 6ddd52edb994127669d64d54de7ec81d3b8ad6f81b73dc053e4c303b2d7220c8: Status 404 returned error can't find the container with id 6ddd52edb994127669d64d54de7ec81d3b8ad6f81b73dc053e4c303b2d7220c8
Jul 18 01:20:59.601320 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:59.601278    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf" event={"ID":"0c7bf487-8fc2-4fde-af6f-9a0e9af83867","Type":"ContainerStarted","Data":"8e0ccf573efda5dc03871e003e7c35188dd4708d3831a03a588bbf55d3cfc345"}
Jul 18 01:20:59.601723 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:59.601378    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:20:59.601723 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:59.601403    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf" event={"ID":"0c7bf487-8fc2-4fde-af6f-9a0e9af83867","Type":"ContainerStarted","Data":"6ddd52edb994127669d64d54de7ec81d3b8ad6f81b73dc053e4c303b2d7220c8"}
Jul 18 01:20:59.617552 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:20:59.617500    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf" podStartSLOduration=1.617480823 podStartE2EDuration="1.617480823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:20:59.616711544 +0000 UTC m=+2433.328822828" watchObservedRunningTime="2026-07-18 01:20:59.617480823 +0000 UTC m=+2433.329592108"
Jul 18 01:21:00.880469 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:00.880444    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mn6cd_b5735c71-606c-4433-a5cb-9b4525cb785e/dns/0.log"
Jul 18 01:21:00.901782 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:00.901759    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mn6cd_b5735c71-606c-4433-a5cb-9b4525cb785e/kube-rbac-proxy/0.log"
Jul 18 01:21:01.051852 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:01.051821    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ct4gp_af22323f-0098-447d-8322-b367e7b1867a/dns-node-resolver/0.log"
Jul 18 01:21:01.602334 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:01.602307    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76d6787b48-pnklw_032155c6-e219-4674-b4d8-6fa7dace4c84/registry/0.log"
Jul 18 01:21:01.611596 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:01.611573    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76d6787b48-pnklw_032155c6-e219-4674-b4d8-6fa7dace4c84/registry/1.log"
Jul 18 01:21:01.661099 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:01.661073    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dchvn_abb79bd5-9512-4cc8-a6c4-669d891ded8c/node-ca/0.log"
Jul 18 01:21:02.761077 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:02.761046    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mtdqs_98c8fab2-6a4c-496a-ad99-ebab331066de/discovery/0.log"
Jul 18 01:21:02.882519 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:02.882493    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54498b876f-mc4hz_3aba05fd-4990-47f3-bae3-83d258f8a3a6/kube-auth-proxy/0.log"
Jul 18 01:21:02.995444 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:02.995416    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xqxkf_8be910a1-0957-4659-ac3b-6c7213629050/payload-pre-processing/0.log"
Jul 18 01:21:03.043628 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:03.043558    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dl6bm_8cd20c00-2b97-406c-a073-437a4ed6f8d2/payload-processing/0.log"
Jul 18 01:21:03.066694 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:03.066669    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75cf4cd9bb-ggh9t_d69ca821-3563-43fb-95c7-619da8186293/router/0.log"
Jul 18 01:21:03.742152 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:03.742120    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scwzp_ee41e07e-3fd4-42f2-a833-d003f921be2c/serve-healthcheck-canary/0.log"
Jul 18 01:21:04.417544 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:04.417508    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v4hrg_e0192485-c891-436a-8f5a-49d3c5a992a0/kube-rbac-proxy/0.log"
Jul 18 01:21:04.446900 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:04.446878    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v4hrg_e0192485-c891-436a-8f5a-49d3c5a992a0/exporter/0.log"
Jul 18 01:21:04.474766 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:04.474745    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v4hrg_e0192485-c891-436a-8f5a-49d3c5a992a0/extractor/0.log"
Jul 18 01:21:05.616690 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:05.616655    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-z9vxf"
Jul 18 01:21:06.720955 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:06.720910    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6xhz4_527e3d6c-781a-492e-bc44-0cce3780e4e8/manager/0.log"
Jul 18 01:21:06.832610 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:06.832573    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-27zj7_8f4bf076-dec8-435f-b3fe-0e33330de605/manager/0.log"
Jul 18 01:21:06.925267 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:06.925240    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-768c66bff7-7z6n4_a28317cd-a353-472f-a53b-2d50a1c29094/manager/0.log"
Jul 18 01:21:06.955327 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:06.955306    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q28lc_f28e7be2-6fc4-4777-bfce-d955ecac0029/server/0.log"
Jul 18 01:21:07.021556 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:07.021486    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-k27wl_257c49ef-bf57-437d-be2f-47bbb83e4236/manager/0.log"
Jul 18 01:21:07.048833 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:07.048812    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-dq64t_174dcb18-92e3-4bae-b5b0-317a764fdc47/manager/0.log"
Jul 18 01:21:07.078078 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:07.078052    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-dq64t_174dcb18-92e3-4bae-b5b0-317a764fdc47/copy-manifests/0.log"
Jul 18 01:21:09.039327 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:09.039295    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mtdqs_98c8fab2-6a4c-496a-ad99-ebab331066de/discovery/0.log"
Jul 18 01:21:09.066283 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:09.066254    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54498b876f-mc4hz_3aba05fd-4990-47f3-bae3-83d258f8a3a6/kube-auth-proxy/0.log"
Jul 18 01:21:09.158808 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:09.158765    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xqxkf_8be910a1-0957-4659-ac3b-6c7213629050/payload-pre-processing/0.log"
Jul 18 01:21:09.196291 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:09.196258    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dl6bm_8cd20c00-2b97-406c-a073-437a4ed6f8d2/payload-processing/0.log"
Jul 18 01:21:09.210585 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:09.210550    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75cf4cd9bb-ggh9t_d69ca821-3563-43fb-95c7-619da8186293/router/0.log"
Jul 18 01:21:10.510380 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:10.510351    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mtdqs_98c8fab2-6a4c-496a-ad99-ebab331066de/discovery/0.log"
Jul 18 01:21:10.543087 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:10.543060    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54498b876f-mc4hz_3aba05fd-4990-47f3-bae3-83d258f8a3a6/kube-auth-proxy/0.log"
Jul 18 01:21:10.628666 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:10.628640    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xqxkf_8be910a1-0957-4659-ac3b-6c7213629050/payload-pre-processing/0.log"
Jul 18 01:21:10.666525 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:10.666500    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dl6bm_8cd20c00-2b97-406c-a073-437a4ed6f8d2/payload-processing/0.log"
Jul 18 01:21:10.681688 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:10.681668    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75cf4cd9bb-ggh9t_d69ca821-3563-43fb-95c7-619da8186293/router/0.log"
Jul 18 01:21:14.422034 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:14.421997    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-dpctk_b776b90d-c30a-4e86-8e28-451f2ce302d8/kube-storage-version-migrator-operator/1.log"
Jul 18 01:21:14.423121 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:14.423100    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-dpctk_b776b90d-c30a-4e86-8e28-451f2ce302d8/kube-storage-version-migrator-operator/0.log"
Jul 18 01:21:15.639567 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:15.639542    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gt8rf_6d400b60-6ea5-4781-a3b8-f29316e869ec/kube-multus-additional-cni-plugins/0.log"
Jul 18 01:21:15.662895 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:15.662874    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gt8rf_6d400b60-6ea5-4781-a3b8-f29316e869ec/egress-router-binary-copy/0.log"
Jul 18 01:21:15.687627 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:15.687598    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gt8rf_6d400b60-6ea5-4781-a3b8-f29316e869ec/cni-plugins/0.log"
Jul 18 01:21:15.708623 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:15.708599    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gt8rf_6d400b60-6ea5-4781-a3b8-f29316e869ec/bond-cni-plugin/0.log"
Jul 18 01:21:15.730575 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:15.730553    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gt8rf_6d400b60-6ea5-4781-a3b8-f29316e869ec/routeoverride-cni/0.log"
Jul 18 01:21:15.756013 ip-10-0-142-221 kubenswrapper[2569]: I0718 01:21:15.755989    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gt8rf_6d400b60-6ea5-4781-a3b8-f29316e869ec/whereabouts-cni-bincopy/0.log"