Jul 14 07:47:43.998510 ip-10-0-129-164 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 14 07:47:43.998521 ip-10-0-129-164 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 14 07:47:43.998532 ip-10-0-129-164 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 14 07:47:43.998848 ip-10-0-129-164 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 14 07:47:53.295565 ip-10-0-129-164 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 14 07:47:53.295578 ip-10-0-129-164 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 119e20287d5c496186b236fefb5e6325 --
Jul 14 07:49:36.021953 ip-10-0-129-164 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 07:49:37.476099 ip-10-0-129-164 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 07:49:37.476099 ip-10-0-129-164 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 07:49:37.476099 ip-10-0-129-164 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 07:49:37.476099 ip-10-0-129-164 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 07:49:37.476099 ip-10-0-129-164 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 07:49:37.478128 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.478037    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 07:49:37.481959 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481942    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:49:37.481959 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481959    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481965    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481969    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481972    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481975    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481978    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481981    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481984    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481986    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481992    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481995    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.481998    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482014    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482017    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482020    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482023    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482026    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482028    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482031    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482033    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:49:37.482046 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482036    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482039    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482041    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482044    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482047    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482049    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482052    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482055    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482058    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482061    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482065    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482068    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482070    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482073    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482075    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482078    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482082    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482086    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482089    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482092    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:49:37.482552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482094    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482097    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482099    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482102    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482104    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482107    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482109    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482111    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482114    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482116    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482119    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482121    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482124    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482126    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482130    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482133    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482136    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482139    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482141    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482144    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:49:37.483036 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482146    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482150    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482152    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482155    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482164    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482166    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482169    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482172    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482174    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482179    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482183    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482186    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482188    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482191    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482194    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482196    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482200    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482204    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482207    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:49:37.483505 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482210    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482212    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482216    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482219    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482221    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482225    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482227    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482232    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482235    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482238    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482241    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482245    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482248    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482250    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482253    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482255    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482258    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482260    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.482269    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483043    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:49:37.483968 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483049    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483052    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483057    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483061    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483064    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483067    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483070    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483073    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483076    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483078    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483081    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483083    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483086    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483089    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483091    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483094    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483096    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483099    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483101    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483105    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:49:37.484434 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483107    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483110    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483112    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483115    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483117    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483120    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483123    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483125    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483128    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483130    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483133    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483136    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483138    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483141    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483144    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483147    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483149    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483152    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483154    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483157    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:49:37.484964 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483159    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483162    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483164    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483167    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483169    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483172    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483175    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483178    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483180    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483183    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483185    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483189    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483192    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483195    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483197    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483200    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483202    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483205    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483210    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483214    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:49:37.485471 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483217    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483222    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483225    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483228    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483232    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483235    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483238    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483241    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483243    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483246    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483248    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483251    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483254    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483256    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483258    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483261    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483264    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483266    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483268    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:49:37.485952 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483271    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483274    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483277    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483280    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483283    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483285    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483288    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483291    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483294    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483296    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483299    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483302    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483305    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483308    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483310    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483313    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483316    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483319    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483322    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:49:37.486425 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483726    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483732    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483736    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483740    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483743    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483746    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483750    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483753    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483755    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483758    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483761    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483764    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483766    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483772    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483776    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483780    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483784    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483786    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483789    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:49:37.486863 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483792    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483794    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483797    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483799    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483804    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483807    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483811    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483813    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483816    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483819    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483821    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483826    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483840    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483843    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483846    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483848    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483851    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483854    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483856    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:49:37.487328 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483859    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483861    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483864    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483866    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483869    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483872    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483874    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483877    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483881    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483883    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483886    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483888    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483891    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483894    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483896    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483899    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483901    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483905    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483907    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483910    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:49:37.487777 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483912    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483915    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483917    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483920    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483924    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483926    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483929    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483933    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483936    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483939    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483941    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483944    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483946    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483949    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483951    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483954    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483957    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483959    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483962    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:49:37.488258 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483964    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483967    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483970    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483972    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483975    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483978    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.483981    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484039    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484044    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484048    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484051    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484054    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484057    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484062    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484065    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484068    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484071    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484074    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484077    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484080    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:49:37.488698 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484083    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484086    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484170    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484182    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484193    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484199    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484203    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484206    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484211    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484215    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484219    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484222    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484225    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484229    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484232    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484235    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484238    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484241    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484244    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484247    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484254    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484257    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484260    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484263    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 07:49:37.489181 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484267    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484271    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484274    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484278    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484281    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484284    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484287    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484290    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484293    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484297    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484301    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484304    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484307    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484310    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484313    2562 flags.go:64] FLAG: --enable-server="true"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484316    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484321    2562 flags.go:64] FLAG: --event-burst="100"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484325    2562 flags.go:64] FLAG: --event-qps="50"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484328    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484331    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484334    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484338    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484341    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484344    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484347    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 14 07:49:37.489743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484350    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484352    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484359    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484362    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484366    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484368    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484371    2562 flags.go:64] FLAG: --feature-gates=""
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484375    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484378    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484381    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484384    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484387    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484390    2562 flags.go:64] FLAG: --help="false"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484393    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484397    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484399    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484402    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484406    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484410    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484413    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484416    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484419    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484421    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 07:49:37.490371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484424    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484427    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484430    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484433    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484436    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484439    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484442    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484445    2562 flags.go:64] FLAG: --lock-file=""
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484448    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484451    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484454    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484461    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484464    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484468    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484471    2562 flags.go:64] FLAG: --logging-format="text"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484474    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484477    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484480    2562 flags.go:64] FLAG: --manifest-url=""
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484483    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484488    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484491    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484496    2562 flags.go:64] FLAG: --max-pods="110"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484499    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484502    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484505    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 07:49:37.491035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484508    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484511    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484513    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484516    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484524    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484527    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484530    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484533    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484536    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484542    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484545    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484548    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484551    2562 flags.go:64] FLAG: --port="10250"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484554    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484557    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c77b20141d76d644"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484560    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484563    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484565    2562 flags.go:64] FLAG: --register-node="true"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484569    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484573    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484576    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484579    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484582    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484586    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484589    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 07:49:37.491703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484592    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484595    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484598    2562 flags.go:64] FLAG: --runonce="false"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484601    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484604    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484607    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484610    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484613    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484616    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484619    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484622    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484625    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484628    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484631    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484634    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484637    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484640    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484643    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484648    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484651    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484654    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484658    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484661    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484663    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484666    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 07:49:37.492564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484670    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484673    2562 flags.go:64] FLAG: --v="2"
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484677    2562 flags.go:64] FLAG: --version="false"
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484681    2562 flags.go:64] FLAG: --vmodule=""
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484685    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.484689    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484822    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484826    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484829    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484832    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484835    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484838    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484841    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484843    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484846    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484849    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484852    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484854    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484857    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484860    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484863    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:49:37.493233 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484865    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484868    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484870    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484874    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484878    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484881    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484883    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484886    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484889    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484891    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484894    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484896    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484899    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484903    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484905    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484908    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484910    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484914    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484918    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:49:37.493736 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484921    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484924    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484926    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484929    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484932    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484934    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484938    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484942    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484946    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484949    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484951    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484954    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484956    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484959    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484961    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484964    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484967    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484970    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484973    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:49:37.494249 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484975    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484978    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484980    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484983    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484985    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484988    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484993    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484996    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.484998    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485015    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485019    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485021    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485025    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485027    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485030    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485033    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485035    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485038    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485041    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485044    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:49:37.494717 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485046    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485049    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485052    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485054    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485057    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485059    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485062    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485064    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485067    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485069    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485072    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485074    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485077    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485080    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485083    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485085    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485088    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485091    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485096    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485099    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:49:37.495215 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485101    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485104    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485107    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485109    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485112    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.485116    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.485666    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.494306    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.494327    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.494347    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.494356    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494418    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494424    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494428    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494431    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:49:37.495716 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494434    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494436    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494439    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494441    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494444    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494447    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494450    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494452    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494455    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494458    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494461    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494463    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494466    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494468    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494471    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494473    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494477    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494479    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494482    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494484    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:49:37.496099 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494487    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494490    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494493    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494495    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494499    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494501    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494504    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494506    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494509    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494512    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494514    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494517    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494519    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494521    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494525    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494529    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494532    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494535    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494538    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:49:37.496558 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494542    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494545    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494548    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494551    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494554    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494557    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494560    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494564    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494567    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494571    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494574    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494577    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494580    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494582    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494586    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494589    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494592    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494594    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494597    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:49:37.497106 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494599    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494602    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494605    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494607    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494610    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494612    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494615    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494617    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494620    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494623    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494625    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494628    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494631    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494633    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494636    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494638    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494640    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494644    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494647    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494650    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:49:37.497552 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494652    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494655    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494657    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494660    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494662    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494665    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494667    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494670    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494672    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494675    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494677    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494680    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494682    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494684    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494687    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494689    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:49:37.498039 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494692    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.494697    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494815    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494819    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494822    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494826    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494828    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494831    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494834    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494837    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494840    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494843    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494845    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494848    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494852    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:49:37.498417 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494855    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494857    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494860    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494863    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494866    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494868    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494871    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494874    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494876    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494879    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494882    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494884    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494887    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494889    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494892    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494894    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494897    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494900    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494902    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494905    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:49:37.498784 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494907    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494910    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494913    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494916    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494918    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494921    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494925    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494929    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494931    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494934    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494936    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494939    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494945    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494948    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494950    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494953    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494955    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494958    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494960    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494963    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:49:37.499384 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494965    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494968    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494970    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494973    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494976    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494978    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494981    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494983    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494986    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494988    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494991    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494993    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494996    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.494998    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495028    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495032    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495034    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495037    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495039    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:49:37.499873 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495042    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495046    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495049    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495054    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495057    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495060    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495063    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495065    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495068    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495071    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495073    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495075    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495078    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495081    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495083    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495086    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495088    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495091    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495093    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495096    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:49:37.500358 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495098    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495101    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495103    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495106    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495109    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495112    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:37.495116    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.495121    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.495263    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.497163    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.498283    2562 server.go:1019] "Starting client certificate rotation"
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.498384    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.499094    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 07:49:37.500841 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.500285    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 07:49:37.502607 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.502585    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 07:49:37.509876 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.509857    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 14 07:49:37.511882 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.511869    2562 log.go:25] "Validated CRI v1 image API"
Jul 14 07:49:37.513264 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.513250    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 07:49:37.515333 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.515312    2562 fs.go:135] Filesystem UUIDs: map[76be9a23-ce62-462c-a7ab-9ffc717d9fe9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 84792515-0162-4c83-9bad-f0fb09aea18d:/dev/nvme0n1p3]
Jul 14 07:49:37.515398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.515331    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 07:49:37.522126 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.521994    2562 manager.go:216] Machine: {Timestamp:2026-07-14 07:49:37.520804297 +0000 UTC m=+0.262722155 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097761 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f53dffa25665c102eacda824d4761 SystemUUID:ec2f53df-fa25-665c-102e-acda824d4761 BootID:119e2028-7d5c-4961-86b2-36fefb5e6325 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:34:f0:02:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:34:f0:02:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:4e:71:b9:fa:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 07:49:37.522126 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.522110    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 07:49:37.522260 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.522200    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 07:49:37.524770 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.524732    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 07:49:37.524907 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.524772    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 07:49:37.525496 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.525486    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 07:49:37.525530 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.525499    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 07:49:37.525530 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.525506    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 07:49:37.526092 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.526079    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 07:49:37.527264 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.527252    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 07:49:37.529189 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.529169    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 07:49:37.531054 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.531038    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 07:49:37.531178 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.531168    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 07:49:37.531216 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.531198    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 07:49:37.531216 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.531208    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 07:49:37.531280 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.531223    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 07:49:37.531280 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.531232    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 14 07:49:37.531280 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.531241    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 07:49:37.531609 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.531596    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 07:49:37.531662 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.531614    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 07:49:37.533479 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.533459    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 07:49:37.535187 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535173    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 07:49:37.535232 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535204    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 07:49:37.535371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535358    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 07:49:37.535402 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535387    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 07:49:37.535434 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535401    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 07:49:37.535434 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535412    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 07:49:37.535434 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535427    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 07:49:37.535525 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535437    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 07:49:37.535802 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535791    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 07:49:37.535802 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535801    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 07:49:37.535859 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535809    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 07:49:37.535859 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535815    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 07:49:37.535859 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535823    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 07:49:37.535859 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.535831    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 07:49:37.536398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.536387    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 07:49:37.536398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.536398    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 07:49:37.539724 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.539706    2562 server.go:1268] "Started kubelet"
Jul 14 07:49:37.539814 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.539780    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 07:49:37.539904 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.539853    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 07:49:37.539952 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.539938    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 07:49:37.540862 ip-10-0-129-164 systemd[1]: Started Kubernetes Kubelet.
Jul 14 07:49:37.541148 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.541131    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 07:49:37.542186 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.542173    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 07:49:37.543424 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.543399    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 07:49:37.543533 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.543418    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 07:49:37.543533 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.543491    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 07:49:37.545421 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.545383    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 07:49:37.546227 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.545431    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-164.ec2.internal.18c21888a4163eb5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-164.ec2.internal,UID:ip-10-0-129-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-164.ec2.internal,},FirstTimestamp:2026-07-14 07:49:37.539677877 +0000 UTC m=+0.281595734,LastTimestamp:2026-07-14 07:49:37.539677877 +0000 UTC m=+0.281595734,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-164.ec2.internal,}"
Jul 14 07:49:37.548723 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.548705    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 07:49:37.548723 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.548713    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 07:49:37.548861 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.548848    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:37.549924 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.549383    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 07:49:37.549924 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.549514    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 07:49:37.549924 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.549661    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 07:49:37.549924 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.549807    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 07:49:37.549924 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.549814    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 07:49:37.550199 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.549933    2562 factory.go:55] Registering systemd factory
Jul 14 07:49:37.550199 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.549978    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 14 07:49:37.550567 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.550374    2562 factory.go:153] Registering CRI-O factory
Jul 14 07:49:37.550567 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.550391    2562 factory.go:223] Registration of the crio container factory successfully
Jul 14 07:49:37.550567 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.550440    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 07:49:37.550567 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.550462    2562 factory.go:103] Registering Raw factory
Jul 14 07:49:37.550567 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.550476    2562 manager.go:1196] Started watching for new ooms in manager
Jul 14 07:49:37.551162 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.551145    2562 manager.go:349] Starting recovery of all containers
Jul 14 07:49:37.558800 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.558603    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 07:49:37.558932 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.558821    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 07:49:37.564286 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.564266    2562 manager.go:354] Recovery completed
Jul 14 07:49:37.568985 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.568946    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:49:37.570804 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.570781    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:49:37.570866 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.570816    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:49:37.570866 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.570826    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:49:37.571358 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.571344    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 07:49:37.571358 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.571352    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:49:37.571482 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.571357    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 07:49:37.571482 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.571455    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 07:49:37.572050 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.572036    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:49:37.572114 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.572066    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:49:37.572114 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.572081    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:49:37.572640 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.572576    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-164.ec2.internal.18c21888a5f12d55  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-164.ec2.internal,UID:ip-10-0-129-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-164.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-164.ec2.internal,},FirstTimestamp:2026-07-14 07:49:37.570803029 +0000 UTC m=+0.312720888,LastTimestamp:2026-07-14 07:49:37.570803029 +0000 UTC m=+0.312720888,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-164.ec2.internal,}"
Jul 14 07:49:37.573568 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.573556    2562 policy_none.go:49] "None policy: Start"
Jul 14 07:49:37.573617 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.573572    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 07:49:37.573617 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.573584    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 07:49:37.574087 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.574074    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nrknx"
Jul 14 07:49:37.575506 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.575494    2562 policy_none.go:47] "Start"
Jul 14 07:49:37.581770 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.581754    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nrknx"
Jul 14 07:49:37.582175 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.582108    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-164.ec2.internal.18c21888a5f171ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-164.ec2.internal,UID:ip-10-0-129-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-164.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-164.ec2.internal,},FirstTimestamp:2026-07-14 07:49:37.570820591 +0000 UTC m=+0.312738449,LastTimestamp:2026-07-14 07:49:37.570820591 +0000 UTC m=+0.312738449,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-164.ec2.internal,}"
Jul 14 07:49:37.614583 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.614564    2562 manager.go:337] "Starting Device Plugin manager"
Jul 14 07:49:37.614699 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.614603    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 07:49:37.614699 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.614614    2562 server.go:87] "Starting device plugin registration server"
Jul 14 07:49:37.614888 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.614875    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 07:49:37.614951 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.614890    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 07:49:37.615043 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.615026    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 07:49:37.615118 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.615105    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 07:49:37.615118 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.615117    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 07:49:37.615658 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.615629    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 07:49:37.615722 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.615683    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:37.692749 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.692712    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 07:49:37.694735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.693910    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 07:49:37.694735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.693947    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 07:49:37.694735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.693969    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 07:49:37.694735 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.694016    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 07:49:37.696919 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.696902    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:49:37.715298 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.715274    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:49:37.716522 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.716504    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:49:37.716640 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.716539    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:49:37.716640 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.716552    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:49:37.716640 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.716583    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.726791 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.726773    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.726859 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.726796    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-164.ec2.internal\": node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:37.754720 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.754681    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:37.795494 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.794936    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal"]
Jul 14 07:49:37.795580 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.795544    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:49:37.796576 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.796560    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:49:37.796636 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.796594    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:49:37.796636 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.796605    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:49:37.798846 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.798834    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:49:37.798956 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.798940    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.799012 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.798973    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:49:37.799621 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.799604    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:49:37.799692 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.799631    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:49:37.799692 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.799644    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:49:37.800071 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.800058    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:49:37.800127 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.800075    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:49:37.800127 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.800085    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:49:37.802692 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.802675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.802764 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.802703    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:49:37.803393 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.803377    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:49:37.803483 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.803406    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:49:37.803483 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.803418    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:49:37.837925 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.837856    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-164.ec2.internal\" not found" node="ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.842256 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.842238    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-164.ec2.internal\" not found" node="ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.851531 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.851503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1545ebb4ca35d78d25cb4530928f045-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal\" (UID: \"d1545ebb4ca35d78d25cb4530928f045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.851531 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.851532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1545ebb4ca35d78d25cb4530928f045-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal\" (UID: \"d1545ebb4ca35d78d25cb4530928f045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.851664 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.851548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c6b5fe5d9bd457c16dcc8ff1a1230d6-config\") pod \"kube-apiserver-proxy-ip-10-0-129-164.ec2.internal\" (UID: \"0c6b5fe5d9bd457c16dcc8ff1a1230d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.855600 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.855584    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:37.952570 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.952534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1545ebb4ca35d78d25cb4530928f045-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal\" (UID: \"d1545ebb4ca35d78d25cb4530928f045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.952570 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.952571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1545ebb4ca35d78d25cb4530928f045-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal\" (UID: \"d1545ebb4ca35d78d25cb4530928f045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.952795 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.952586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c6b5fe5d9bd457c16dcc8ff1a1230d6-config\") pod \"kube-apiserver-proxy-ip-10-0-129-164.ec2.internal\" (UID: \"0c6b5fe5d9bd457c16dcc8ff1a1230d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.952795 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.952633    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c6b5fe5d9bd457c16dcc8ff1a1230d6-config\") pod \"kube-apiserver-proxy-ip-10-0-129-164.ec2.internal\" (UID: \"0c6b5fe5d9bd457c16dcc8ff1a1230d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.952795 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.952657    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1545ebb4ca35d78d25cb4530928f045-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal\" (UID: \"d1545ebb4ca35d78d25cb4530928f045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.952795 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:37.952673    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1545ebb4ca35d78d25cb4530928f045-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal\" (UID: \"d1545ebb4ca35d78d25cb4530928f045\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:37.956603 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:37.956589    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.057441 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.057397    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.139687 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.139604    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:38.145302 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.145284    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:38.158141 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.158120    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.258786 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.258741    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.359299 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.359268    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.459952 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.459869    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.497763 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.497736    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 07:49:38.498512 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.497854    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 07:49:38.498512 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.497873    2562 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.129.164:39498->100.59.249.151:6443: use of closed network connection"
Jul 14 07:49:38.498512 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.497939    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.129.164:39498->100.59.249.151:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 07:49:38.560398 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.560366    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.585530 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.585474    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 07:44:37 +0000 UTC" deadline="2028-03-09 21:45:49.231607394 +0000 UTC"
Jul 14 07:49:38.585530 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.585520    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14509h56m10.646092215s"
Jul 14 07:49:38.661146 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.661113    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.670577 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.670554    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:49:38.682140 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.682120    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:49:38.683134 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.683118    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:49:38.683252 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.683148    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:49:38.683252 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.683157    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:49:38.720727 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:38.720694    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1545ebb4ca35d78d25cb4530928f045.slice/crio-3ea0db7772e94603006af124b69f4f25c10524857b9164d8860932546c6f1dfb WatchSource:0}: Error finding container 3ea0db7772e94603006af124b69f4f25c10524857b9164d8860932546c6f1dfb: Status 404 returned error can't find the container with id 3ea0db7772e94603006af124b69f4f25c10524857b9164d8860932546c6f1dfb
Jul 14 07:49:38.720928 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:38.720908    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6b5fe5d9bd457c16dcc8ff1a1230d6.slice/crio-c2ca7056e0ce34df5c8376ac77a078e84e51b26314ee03b013d465dcbee9973e WatchSource:0}: Error finding container c2ca7056e0ce34df5c8376ac77a078e84e51b26314ee03b013d465dcbee9973e: Status 404 returned error can't find the container with id c2ca7056e0ce34df5c8376ac77a078e84e51b26314ee03b013d465dcbee9973e
Jul 14 07:49:38.726840 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:38.726821    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 07:49:38.762235 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.762197    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.862826 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.862784    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:38.963406 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:38.963329    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.064117 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.064087    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.154161 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:39.154131    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:49:39.164481 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.164446    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.265043 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.264942    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.365536 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.365498    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.432232 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:39.432202    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:49:39.466048 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.465999    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.566957 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.566877    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.667610 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.667577    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.700300 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:39.700240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal" event={"ID":"0c6b5fe5d9bd457c16dcc8ff1a1230d6","Type":"ContainerStarted","Data":"c2ca7056e0ce34df5c8376ac77a078e84e51b26314ee03b013d465dcbee9973e"}
Jul 14 07:49:39.701444 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:39.701413    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal" event={"ID":"d1545ebb4ca35d78d25cb4530928f045","Type":"ContainerStarted","Data":"3ea0db7772e94603006af124b69f4f25c10524857b9164d8860932546c6f1dfb"}
Jul 14 07:49:39.767975 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.767936    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.868581 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.868496    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:39.968986 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:39.968948    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.069906 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.069867    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.170515 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.170417    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.270978 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.270944    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.371554 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.371519    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.472077 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.472035    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.572452 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.572420    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.672824 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.672784    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.704625 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:40.704448    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal" event={"ID":"0c6b5fe5d9bd457c16dcc8ff1a1230d6","Type":"ContainerStarted","Data":"cc4cff8d7e62a4fd787e5524827a60a770a3d82c8b731f9910ffad8fb6a58c32"}
Jul 14 07:49:40.704761 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:40.704501    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:49:40.706254 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:40.706218    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:49:40.706254 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:40.706257    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:49:40.706420 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:40.706270    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:49:40.706461 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.706439    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-164.ec2.internal\" not found" node="ip-10-0-129-164.ec2.internal"
Jul 14 07:49:40.773790 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.773751    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.874271 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.874242    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:40.974853 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:40.974785    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:41.075675 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.075637    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:41.176171 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.176133    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:41.276782 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.276690    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:41.377219 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.377180    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-164.ec2.internal\" not found"
Jul 14 07:49:41.446131 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.446105    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:49:41.449073 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.449053    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:41.461600 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.461579    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 07:49:41.462423 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.462410    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:41.469387 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.469370    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 07:49:41.532870 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.532788    2562 apiserver.go:52] "Watching apiserver"
Jul 14 07:49:41.543739 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.543708    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 07:49:41.544075 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.544052    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-ctgjh","openshift-multus/network-metrics-daemon-fkzdh","openshift-network-diagnostics/network-check-target-8j2kw","kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp","openshift-dns/node-resolver-lclhv","openshift-multus/multus-additional-cni-plugins-tntbw","openshift-network-operator/iptables-alerter-6tstk","openshift-ovn-kubernetes/ovnkube-node-tnv2c","kube-system/global-pull-secret-syncer-csf4v","kube-system/konnectivity-agent-zh6z7","openshift-cluster-node-tuning-operator/tuned-wkhcb","openshift-image-registry/node-ca-z622s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"]
Jul 14 07:49:41.546570 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.546552    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.548641 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.548621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:41.548735 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.548713    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:41.549444 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.549425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8q749\""
Jul 14 07:49:41.549538 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.549427    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 07:49:41.549538 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.549428    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 07:49:41.549630 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.549545    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:49:41.550329 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.550314    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 07:49:41.550867 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.550851    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:41.550934 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.550916    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:49:41.553220 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.553200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.555494 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.555467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.555494 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.555490    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 07:49:41.555656 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.555637    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d8554\""
Jul 14 07:49:41.555722 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.555706    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 07:49:41.555803 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.555788    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 07:49:41.557929 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.557908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.558331 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.558312    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 07:49:41.558413 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.558314    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x7jfs\""
Jul 14 07:49:41.558413 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.558318    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 07:49:41.558413 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.558372    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 07:49:41.560203 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.560185    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 07:49:41.560301 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.560285    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:49:41.560462 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.560172    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c7bkq\""
Jul 14 07:49:41.560462 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.560338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:41.560462 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.560405    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:41.561394 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.561373    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 07:49:41.562960 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.562942    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.565055 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.565039    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 07:49:41.565785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.565410    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 07:49:41.565785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.565450    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 07:49:41.565785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.565472    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 07:49:41.565785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.565476    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.565785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.565543    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hz5rs\""
Jul 14 07:49:41.565785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.565782    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 07:49:41.567863 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.567845    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.568587 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.568566    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 07:49:41.568685 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.568656    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 07:49:41.568685 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.568668    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 07:49:41.569725 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.569709    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kwqd5\""
Jul 14 07:49:41.569805 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.569767    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 07:49:41.569805 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.569786    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 07:49:41.569915 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.569815    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 07:49:41.570168 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.570153    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:49:41.571285 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.571260    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 07:49:41.571389 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.571347    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-plbxq\""
Jul 14 07:49:41.573457 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.573245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00ef38e6-d0f9-439c-bb05-bfae19b901f6-iptables-alerter-script\") pod \"iptables-alerter-6tstk\" (UID: \"00ef38e6-d0f9-439c-bb05-bfae19b901f6\") " pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.573457 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.573291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00ef38e6-d0f9-439c-bb05-bfae19b901f6-host-slash\") pod \"iptables-alerter-6tstk\" (UID: \"00ef38e6-d0f9-439c-bb05-bfae19b901f6\") " pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.573457 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.573326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rls7q\" (UniqueName: \"kubernetes.io/projected/00ef38e6-d0f9-439c-bb05-bfae19b901f6-kube-api-access-rls7q\") pod \"iptables-alerter-6tstk\" (UID: \"00ef38e6-d0f9-439c-bb05-bfae19b901f6\") " pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.573457 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.573355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:41.573457 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.573388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:41.573457 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.573443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lzws\" (UniqueName: \"kubernetes.io/projected/7c94effb-a854-417f-98e8-0a2d4c97bc25-kube-api-access-8lzws\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:41.574036 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.573688    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9b8h2\""
Jul 14 07:49:41.574036 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.573705    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 07:49:41.574036 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.573841    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 07:49:41.574629 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.574612    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.576895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.576878    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 07:49:41.576997 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.576929    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 07:49:41.577223 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.577209    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-55zrk\""
Jul 14 07:49:41.584689 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.584672    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7h5c"
Jul 14 07:49:41.592288 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.592272    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7h5c"
Jul 14 07:49:41.650783 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.650757    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 07:49:41.673616 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40da2252-37f7-4c05-8319-acb257da6539-konnectivity-ca\") pod \"konnectivity-agent-zh6z7\" (UID: \"40da2252-37f7-4c05-8319-acb257da6539\") " pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:49:41.673616 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673615    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-node-log\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-registration-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-run\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673680    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afbbaeeb-642f-40e8-97b9-c40c37606c1c-tmp-dir\") pod \"node-resolver-lclhv\" (UID: \"afbbaeeb-642f-40e8-97b9-c40c37606c1c\") " pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-log-socket\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-socket-dir-parent\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-var-lib-kubelet\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-sysctl-d\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-lib-modules\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.673807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xksq\" (UniqueName: \"kubernetes.io/projected/afbbaeeb-642f-40e8-97b9-c40c37606c1c-kube-api-access-6xksq\") pod \"node-resolver-lclhv\" (UID: \"afbbaeeb-642f-40e8-97b9-c40c37606c1c\") " pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-system-cni-dir\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-run-netns\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-kubelet-config\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673911    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/047c7ea0-3c11-4754-a0dc-c08990ed4c09-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-run-ovn\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-system-cni-dir\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-var-lib-cni-multus\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.673976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-sysctl-conf\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6467f114-153b-4368-8289-7acf7e0f3efc-serviceca\") pod \"node-ca-z622s\" (UID: \"6467f114-153b-4368-8289-7acf7e0f3efc\") " pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/047c7ea0-3c11-4754-a0dc-c08990ed4c09-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjs7l\" (UniqueName: \"kubernetes.io/projected/047c7ea0-3c11-4754-a0dc-c08990ed4c09-kube-api-access-vjs7l\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.674200 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-run-ovn-kubernetes\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674212    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-sys-fs\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-host\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-conf-dir\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-tuned\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674327    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-kubelet\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-slash\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-var-lib-openvswitch\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-etc-openvswitch\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-sys\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-tmp\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lzws\" (UniqueName: \"kubernetes.io/projected/7c94effb-a854-417f-98e8-0a2d4c97bc25-kube-api-access-8lzws\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslrn\" (UniqueName: \"kubernetes.io/projected/6467f114-153b-4368-8289-7acf7e0f3efc-kube-api-access-cslrn\") pod \"node-ca-z622s\" (UID: \"6467f114-153b-4368-8289-7acf7e0f3efc\") " pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/237827e0-c948-4a42-93bb-ee77c3ef7e17-env-overrides\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674519    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/237827e0-c948-4a42-93bb-ee77c3ef7e17-ovn-node-metrics-cert\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.674690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4hg5\" (UniqueName: \"kubernetes.io/projected/256636ae-db77-4cae-8c5e-4d9d8fa6120b-kube-api-access-s4hg5\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00ef38e6-d0f9-439c-bb05-bfae19b901f6-host-slash\") pod \"iptables-alerter-6tstk\" (UID: \"00ef38e6-d0f9-439c-bb05-bfae19b901f6\") " pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-cni-netd\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00ef38e6-d0f9-439c-bb05-bfae19b901f6-host-slash\") pod \"iptables-alerter-6tstk\" (UID: \"00ef38e6-d0f9-439c-bb05-bfae19b901f6\") " pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674672    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shqw\" (UniqueName: \"kubernetes.io/projected/237827e0-c948-4a42-93bb-ee77c3ef7e17-kube-api-access-4shqw\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.674686    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.674742    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs podName:7c94effb-a854-417f-98e8-0a2d4c97bc25 nodeName:}" failed. No retries permitted until 2026-07-14 07:49:42.174726263 +0000 UTC m=+4.916644110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs") pod "network-metrics-daemon-fkzdh" (UID: "7c94effb-a854-417f-98e8-0a2d4c97bc25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-os-release\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-cni-bin\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-hostroot\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-run-multus-certs\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674861    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-device-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-systemd\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.675414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbpz\" (UniqueName: \"kubernetes.io/projected/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-kube-api-access-rxbpz\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-etc-kubernetes\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.674983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40da2252-37f7-4c05-8319-acb257da6539-agent-certs\") pod \"konnectivity-agent-zh6z7\" (UID: \"40da2252-37f7-4c05-8319-acb257da6539\") " pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/047c7ea0-3c11-4754-a0dc-c08990ed4c09-cni-binary-copy\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-run-systemd\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-cnibin\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-var-lib-cni-bin\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-daemon-config\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nk9l\" (UniqueName: \"kubernetes.io/projected/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-kube-api-access-2nk9l\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-dbus\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-systemd-units\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/237827e0-c948-4a42-93bb-ee77c3ef7e17-ovnkube-script-lib\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-run-k8s-cni-cncf-io\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-socket-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-modprobe-d\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.676070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-sysconfig\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-var-lib-kubelet\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/237827e0-c948-4a42-93bb-ee77c3ef7e17-ovnkube-config\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-cni-binary-copy\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675434    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-run-netns\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00ef38e6-d0f9-439c-bb05-bfae19b901f6-iptables-alerter-script\") pod \"iptables-alerter-6tstk\" (UID: \"00ef38e6-d0f9-439c-bb05-bfae19b901f6\") " pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rls7q\" (UniqueName: \"kubernetes.io/projected/00ef38e6-d0f9-439c-bb05-bfae19b901f6-kube-api-access-rls7q\") pod \"iptables-alerter-6tstk\" (UID: \"00ef38e6-d0f9-439c-bb05-bfae19b901f6\") " pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afbbaeeb-642f-40e8-97b9-c40c37606c1c-hosts-file\") pod \"node-resolver-lclhv\" (UID: \"afbbaeeb-642f-40e8-97b9-c40c37606c1c\") " pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675529    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6467f114-153b-4368-8289-7acf7e0f3efc-host\") pod \"node-ca-z622s\" (UID: \"6467f114-153b-4368-8289-7acf7e0f3efc\") " pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-run-openvswitch\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-cni-dir\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-kubernetes\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-cnibin\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.675663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-os-release\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.676503 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.676057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00ef38e6-d0f9-439c-bb05-bfae19b901f6-iptables-alerter-script\") pod \"iptables-alerter-6tstk\" (UID: \"00ef38e6-d0f9-439c-bb05-bfae19b901f6\") " pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.683530 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.683508    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:49:41.683530 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.683526    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:49:41.683530 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.683535    2562 projected.go:196] Error preparing data for projected volume kube-api-access-mtx4x for pod openshift-network-diagnostics/network-check-target-8j2kw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:41.683734 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.683578    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x podName:0ce822ae-f256-411e-ba04-046313ed265d nodeName:}" failed. No retries permitted until 2026-07-14 07:49:42.183566491 +0000 UTC m=+4.925484340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mtx4x" (UniqueName: "kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x") pod "network-check-target-8j2kw" (UID: "0ce822ae-f256-411e-ba04-046313ed265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:41.683845 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.683828    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 07:49:41.687269 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.687252    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rls7q\" (UniqueName: \"kubernetes.io/projected/00ef38e6-d0f9-439c-bb05-bfae19b901f6-kube-api-access-rls7q\") pod \"iptables-alerter-6tstk\" (UID: \"00ef38e6-d0f9-439c-bb05-bfae19b901f6\") " pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.687398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.687380    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lzws\" (UniqueName: \"kubernetes.io/projected/7c94effb-a854-417f-98e8-0a2d4c97bc25-kube-api-access-8lzws\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:41.707151 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.707122    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal" event={"ID":"d1545ebb4ca35d78d25cb4530928f045","Type":"ContainerStarted","Data":"62b797263319f2df7b1006ff18297c1ac9dea7138870b8f9e1444006af87a9be"}
Jul 14 07:49:41.707428 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.707409    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:41.707483 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.707441    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:41.716424 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.716375    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal" podStartSLOduration=0.716361782 podStartE2EDuration="716.361782ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:49:41.716261797 +0000 UTC m=+4.458179662" watchObservedRunningTime="2026-07-14 07:49:41.716361782 +0000 UTC m=+4.458279649"
Jul 14 07:49:41.719773 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.719746    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 07:49:41.719890 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.719802    2562 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-129-164.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:41.719890 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.719746    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 07:49:41.719960 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.719892    2562 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal"
Jul 14 07:49:41.776613 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-run\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afbbaeeb-642f-40e8-97b9-c40c37606c1c-tmp-dir\") pod \"node-resolver-lclhv\" (UID: \"afbbaeeb-642f-40e8-97b9-c40c37606c1c\") " pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-log-socket\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-socket-dir-parent\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776685    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-run\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776698    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-var-lib-kubelet\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776720    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-sysctl-d\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-lib-modules\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776743    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-log-socket\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xksq\" (UniqueName: \"kubernetes.io/projected/afbbaeeb-642f-40e8-97b9-c40c37606c1c-kube-api-access-6xksq\") pod \"node-resolver-lclhv\" (UID: \"afbbaeeb-642f-40e8-97b9-c40c37606c1c\") " pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776771    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-socket-dir-parent\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.776785 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-system-cni-dir\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-system-cni-dir\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-run-netns\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-kubelet-config\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776863    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-lib-modules\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/047c7ea0-3c11-4754-a0dc-c08990ed4c09-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-run-ovn\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-system-cni-dir\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776938    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-kubelet-config\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776906    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-run-netns\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-var-lib-cni-multus\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-sysctl-conf\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afbbaeeb-642f-40e8-97b9-c40c37606c1c-tmp-dir\") pod \"node-resolver-lclhv\" (UID: \"afbbaeeb-642f-40e8-97b9-c40c37606c1c\") " pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.776990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-var-lib-cni-multus\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6467f114-153b-4368-8289-7acf7e0f3efc-serviceca\") pod \"node-ca-z622s\" (UID: \"6467f114-153b-4368-8289-7acf7e0f3efc\") " pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-system-cni-dir\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-run-ovn\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.777384 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/047c7ea0-3c11-4754-a0dc-c08990ed4c09-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777148    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjs7l\" (UniqueName: \"kubernetes.io/projected/047c7ea0-3c11-4754-a0dc-c08990ed4c09-kube-api-access-vjs7l\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777155    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-sysctl-conf\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-run-ovn-kubernetes\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-sys-fs\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-host\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-run-ovn-kubernetes\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-conf-dir\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-var-lib-kubelet\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-conf-dir\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-tuned\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777320    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-host\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777324    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-sys-fs\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-kubelet\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-slash\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-var-lib-openvswitch\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.778414 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-etc-openvswitch\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-sys\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-tmp\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-kubelet\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslrn\" (UniqueName: \"kubernetes.io/projected/6467f114-153b-4368-8289-7acf7e0f3efc-kube-api-access-cslrn\") pod \"node-ca-z622s\" (UID: \"6467f114-153b-4368-8289-7acf7e0f3efc\") " pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/237827e0-c948-4a42-93bb-ee77c3ef7e17-env-overrides\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777472    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/237827e0-c948-4a42-93bb-ee77c3ef7e17-ovn-node-metrics-cert\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-slash\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4hg5\" (UniqueName: \"kubernetes.io/projected/256636ae-db77-4cae-8c5e-4d9d8fa6120b-kube-api-access-s4hg5\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-cni-netd\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-sys\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-var-lib-openvswitch\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777552    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-cni-netd\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777584    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shqw\" (UniqueName: \"kubernetes.io/projected/237827e0-c948-4a42-93bb-ee77c3ef7e17-kube-api-access-4shqw\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/047c7ea0-3c11-4754-a0dc-c08990ed4c09-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.779992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-os-release\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-cni-bin\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777197    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-sysctl-d\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777683    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-hostroot\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-run-multus-certs\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-device-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-systemd\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbpz\" (UniqueName: \"kubernetes.io/projected/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-kube-api-access-rxbpz\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777799    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-etc-kubernetes\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40da2252-37f7-4c05-8319-acb257da6539-agent-certs\") pod \"konnectivity-agent-zh6z7\" (UID: \"40da2252-37f7-4c05-8319-acb257da6539\") " pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/047c7ea0-3c11-4754-a0dc-c08990ed4c09-cni-binary-copy\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-run-systemd\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-cnibin\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-var-lib-cni-bin\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.780702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777982    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-systemd\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.777993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-daemon-config\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nk9l\" (UniqueName: \"kubernetes.io/projected/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-kube-api-access-2nk9l\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778060    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/047c7ea0-3c11-4754-a0dc-c08990ed4c09-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778106    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-dbus\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-etc-openvswitch\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-systemd-units\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/237827e0-c948-4a42-93bb-ee77c3ef7e17-ovnkube-script-lib\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-run-k8s-cni-cncf-io\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-socket-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-modprobe-d\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-sysconfig\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778335    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-etc-kubernetes\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-sysconfig\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-var-lib-kubelet\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/237827e0-c948-4a42-93bb-ee77c3ef7e17-ovnkube-config\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.781284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-os-release\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-cni-binary-copy\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778463    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-host-cni-bin\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-run-netns\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afbbaeeb-642f-40e8-97b9-c40c37606c1c-hosts-file\") pod \"node-resolver-lclhv\" (UID: \"afbbaeeb-642f-40e8-97b9-c40c37606c1c\") " pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-hostroot\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6467f114-153b-4368-8289-7acf7e0f3efc-host\") pod \"node-ca-z622s\" (UID: \"6467f114-153b-4368-8289-7acf7e0f3efc\") " pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778536    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-run-multus-certs\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-daemon-config\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-run-openvswitch\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778585    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-device-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-cni-dir\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-kubernetes\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-cnibin\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778659    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-os-release\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778658    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/047c7ea0-3c11-4754-a0dc-c08990ed4c09-cni-binary-copy\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40da2252-37f7-4c05-8319-acb257da6539-konnectivity-ca\") pod \"konnectivity-agent-zh6z7\" (UID: \"40da2252-37f7-4c05-8319-acb257da6539\") " pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:49:41.781895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778764    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-dbus\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-node-log\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-cnibin\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778819    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-systemd-units\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-registration-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778867    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-var-lib-cni-bin\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778871    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6467f114-153b-4368-8289-7acf7e0f3efc-host\") pod \"node-ca-z622s\" (UID: \"6467f114-153b-4368-8289-7acf7e0f3efc\") " pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-run-openvswitch\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778924    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-var-lib-kubelet\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778977    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-kubernetes\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-run-systemd\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/047c7ea0-3c11-4754-a0dc-c08990ed4c09-cnibin\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779054    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/237827e0-c948-4a42-93bb-ee77c3ef7e17-env-overrides\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779095    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-run-netns\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-registration-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779130    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-multus-cni-dir\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779135    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-host-run-k8s-cni-cncf-io\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.782398 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779192    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afbbaeeb-642f-40e8-97b9-c40c37606c1c-hosts-file\") pod \"node-resolver-lclhv\" (UID: \"afbbaeeb-642f-40e8-97b9-c40c37606c1c\") " pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/256636ae-db77-4cae-8c5e-4d9d8fa6120b-socket-dir\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779374    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-os-release\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.778721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6467f114-153b-4368-8289-7acf7e0f3efc-serviceca\") pod \"node-ca-z622s\" (UID: \"6467f114-153b-4368-8289-7acf7e0f3efc\") " pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/237827e0-c948-4a42-93bb-ee77c3ef7e17-node-log\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-modprobe-d\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779497    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/237827e0-c948-4a42-93bb-ee77c3ef7e17-ovnkube-config\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.779539    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:41.779618    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret podName:c400d5dd-5e2f-42d2-98e6-8efb2140df6f nodeName:}" failed. No retries permitted until 2026-07-14 07:49:42.27959863 +0000 UTC m=+5.021516488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret") pod "global-pull-secret-syncer-csf4v" (UID: "c400d5dd-5e2f-42d2-98e6-8efb2140df6f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.779708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/237827e0-c948-4a42-93bb-ee77c3ef7e17-ovnkube-script-lib\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.780066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-tmp\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.780104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-cni-binary-copy\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.780312    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40da2252-37f7-4c05-8319-acb257da6539-konnectivity-ca\") pod \"konnectivity-agent-zh6z7\" (UID: \"40da2252-37f7-4c05-8319-acb257da6539\") " pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.780785    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-etc-tuned\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.781430    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40da2252-37f7-4c05-8319-acb257da6539-agent-certs\") pod \"konnectivity-agent-zh6z7\" (UID: \"40da2252-37f7-4c05-8319-acb257da6539\") " pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:49:41.782869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.781798    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/237827e0-c948-4a42-93bb-ee77c3ef7e17-ovn-node-metrics-cert\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.790460 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.790409    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslrn\" (UniqueName: \"kubernetes.io/projected/6467f114-153b-4368-8289-7acf7e0f3efc-kube-api-access-cslrn\") pod \"node-ca-z622s\" (UID: \"6467f114-153b-4368-8289-7acf7e0f3efc\") " pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.790685 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.790663    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4hg5\" (UniqueName: \"kubernetes.io/projected/256636ae-db77-4cae-8c5e-4d9d8fa6120b-kube-api-access-s4hg5\") pod \"aws-ebs-csi-driver-node-fcvgp\" (UID: \"256636ae-db77-4cae-8c5e-4d9d8fa6120b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.791125 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.791101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xksq\" (UniqueName: \"kubernetes.io/projected/afbbaeeb-642f-40e8-97b9-c40c37606c1c-kube-api-access-6xksq\") pod \"node-resolver-lclhv\" (UID: \"afbbaeeb-642f-40e8-97b9-c40c37606c1c\") " pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.791215 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.791171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shqw\" (UniqueName: \"kubernetes.io/projected/237827e0-c948-4a42-93bb-ee77c3ef7e17-kube-api-access-4shqw\") pod \"ovnkube-node-tnv2c\" (UID: \"237827e0-c948-4a42-93bb-ee77c3ef7e17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.791345 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.791327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nk9l\" (UniqueName: \"kubernetes.io/projected/4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c-kube-api-access-2nk9l\") pod \"multus-ctgjh\" (UID: \"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c\") " pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.791399 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.791331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjs7l\" (UniqueName: \"kubernetes.io/projected/047c7ea0-3c11-4754-a0dc-c08990ed4c09-kube-api-access-vjs7l\") pod \"multus-additional-cni-plugins-tntbw\" (UID: \"047c7ea0-3c11-4754-a0dc-c08990ed4c09\") " pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.791436 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.791420    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbpz\" (UniqueName: \"kubernetes.io/projected/0d150ba2-aafc-41e1-94e3-2fcde4db6ee5-kube-api-access-rxbpz\") pod \"tuned-wkhcb\" (UID: \"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5\") " pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.856585 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.856545    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6tstk"
Jul 14 07:49:41.863686 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.863649    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z622s"
Jul 14 07:49:41.866394 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:41.866367    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ef38e6_d0f9_439c_bb05_bfae19b901f6.slice/crio-40998bc0a728538f891b6e5a85b10cfdbf1c77268a2df40bcb2e534b19724950 WatchSource:0}: Error finding container 40998bc0a728538f891b6e5a85b10cfdbf1c77268a2df40bcb2e534b19724950: Status 404 returned error can't find the container with id 40998bc0a728538f891b6e5a85b10cfdbf1c77268a2df40bcb2e534b19724950
Jul 14 07:49:41.870281 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.870262    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp"
Jul 14 07:49:41.873394 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:41.873369    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6467f114_153b_4368_8289_7acf7e0f3efc.slice/crio-58e25952e1c16e2a715ef43b5f4a52fc7d965622dc9810e4213fa263bd5fefb0 WatchSource:0}: Error finding container 58e25952e1c16e2a715ef43b5f4a52fc7d965622dc9810e4213fa263bd5fefb0: Status 404 returned error can't find the container with id 58e25952e1c16e2a715ef43b5f4a52fc7d965622dc9810e4213fa263bd5fefb0
Jul 14 07:49:41.878174 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.878156    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkhcb"
Jul 14 07:49:41.878556 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:41.878535    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256636ae_db77_4cae_8c5e_4d9d8fa6120b.slice/crio-c4831a75672669affd56f643b51d526a2f0fcd5e388c43e2bfb27abdb500c972 WatchSource:0}: Error finding container c4831a75672669affd56f643b51d526a2f0fcd5e388c43e2bfb27abdb500c972: Status 404 returned error can't find the container with id c4831a75672669affd56f643b51d526a2f0fcd5e388c43e2bfb27abdb500c972
Jul 14 07:49:41.882881 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.882852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tntbw"
Jul 14 07:49:41.886516 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:41.886496    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d150ba2_aafc_41e1_94e3_2fcde4db6ee5.slice/crio-be9e1d31b20fa004838e08d43debcb77cd6d3c5f55a13b0503da80936ba1eb1a WatchSource:0}: Error finding container be9e1d31b20fa004838e08d43debcb77cd6d3c5f55a13b0503da80936ba1eb1a: Status 404 returned error can't find the container with id be9e1d31b20fa004838e08d43debcb77cd6d3c5f55a13b0503da80936ba1eb1a
Jul 14 07:49:41.888742 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.888727    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:49:41.893618 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.893602    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ctgjh"
Jul 14 07:49:41.893713 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:41.893645    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047c7ea0_3c11_4754_a0dc_c08990ed4c09.slice/crio-99d2d9890201e1d27da7c32f785a3a4c6447c6bae004d35c93eb915d109065de WatchSource:0}: Error finding container 99d2d9890201e1d27da7c32f785a3a4c6447c6bae004d35c93eb915d109065de: Status 404 returned error can't find the container with id 99d2d9890201e1d27da7c32f785a3a4c6447c6bae004d35c93eb915d109065de
Jul 14 07:49:41.898586 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.898569    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:49:41.899131 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:41.899109    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237827e0_c948_4a42_93bb_ee77c3ef7e17.slice/crio-dfe1a11e44fced469420ca83c7b9fdfcfd9d7766c1b325c007aa91b330226fbf WatchSource:0}: Error finding container dfe1a11e44fced469420ca83c7b9fdfcfd9d7766c1b325c007aa91b330226fbf: Status 404 returned error can't find the container with id dfe1a11e44fced469420ca83c7b9fdfcfd9d7766c1b325c007aa91b330226fbf
Jul 14 07:49:41.903050 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:41.902999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lclhv"
Jul 14 07:49:41.903350 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:41.903332    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b054bd5_7ed1_4dff_bc4c_3b0e6daae13c.slice/crio-95e4a377c72db44f83214e37df19dd95f6ac3d0919ddc7bb2c10527efcbf9504 WatchSource:0}: Error finding container 95e4a377c72db44f83214e37df19dd95f6ac3d0919ddc7bb2c10527efcbf9504: Status 404 returned error can't find the container with id 95e4a377c72db44f83214e37df19dd95f6ac3d0919ddc7bb2c10527efcbf9504
Jul 14 07:49:41.907916 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:41.907893    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40da2252_37f7_4c05_8319_acb257da6539.slice/crio-8997315cd06e5d43f67e1cd986a192a457755639b242bb52e7a1610d1028f28c WatchSource:0}: Error finding container 8997315cd06e5d43f67e1cd986a192a457755639b242bb52e7a1610d1028f28c: Status 404 returned error can't find the container with id 8997315cd06e5d43f67e1cd986a192a457755639b242bb52e7a1610d1028f28c
Jul 14 07:49:41.912440 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:49:41.912422    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbbaeeb_642f_40e8_97b9_c40c37606c1c.slice/crio-e13039ccc2db80178c2ade6b8da9f8e1a2d77da681497e0a852fe75163f22e74 WatchSource:0}: Error finding container e13039ccc2db80178c2ade6b8da9f8e1a2d77da681497e0a852fe75163f22e74: Status 404 returned error can't find the container with id e13039ccc2db80178c2ade6b8da9f8e1a2d77da681497e0a852fe75163f22e74
Jul 14 07:49:42.182073 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.181959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:42.182218 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:42.182110    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:42.182218 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:42.182167    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs podName:7c94effb-a854-417f-98e8-0a2d4c97bc25 nodeName:}" failed. No retries permitted until 2026-07-14 07:49:43.18215459 +0000 UTC m=+5.924072436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs") pod "network-metrics-daemon-fkzdh" (UID: "7c94effb-a854-417f-98e8-0a2d4c97bc25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:42.282572 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.282524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:42.282739 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.282590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:42.282739 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:42.282702    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:42.282739 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:42.282717    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:49:42.282739 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:42.282736    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:49:42.282934 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:42.282749    2562 projected.go:196] Error preparing data for projected volume kube-api-access-mtx4x for pod openshift-network-diagnostics/network-check-target-8j2kw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:42.282934 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:42.282776    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret podName:c400d5dd-5e2f-42d2-98e6-8efb2140df6f nodeName:}" failed. No retries permitted until 2026-07-14 07:49:43.282757041 +0000 UTC m=+6.024674909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret") pod "global-pull-secret-syncer-csf4v" (UID: "c400d5dd-5e2f-42d2-98e6-8efb2140df6f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:42.282934 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:42.282795    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x podName:0ce822ae-f256-411e-ba04-046313ed265d nodeName:}" failed. No retries permitted until 2026-07-14 07:49:43.282785374 +0000 UTC m=+6.024703220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtx4x" (UniqueName: "kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x") pod "network-check-target-8j2kw" (UID: "0ce822ae-f256-411e-ba04-046313ed265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:42.595378 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.595332    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 07:44:41 +0000 UTC" deadline="2028-01-18 13:57:55.730355868 +0000 UTC"
Jul 14 07:49:42.595378 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.595376    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13278h8m13.134984909s"
Jul 14 07:49:42.706725 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.706693    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:42.706925 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:42.706833    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:42.716896 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.716849    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zh6z7" event={"ID":"40da2252-37f7-4c05-8319-acb257da6539","Type":"ContainerStarted","Data":"8997315cd06e5d43f67e1cd986a192a457755639b242bb52e7a1610d1028f28c"}
Jul 14 07:49:42.718875 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.718847    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkhcb" event={"ID":"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5","Type":"ContainerStarted","Data":"be9e1d31b20fa004838e08d43debcb77cd6d3c5f55a13b0503da80936ba1eb1a"}
Jul 14 07:49:42.727458 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.727420    2562 generic.go:356] "Generic (PLEG): container finished" podID="d1545ebb4ca35d78d25cb4530928f045" containerID="62b797263319f2df7b1006ff18297c1ac9dea7138870b8f9e1444006af87a9be" exitCode=0
Jul 14 07:49:42.727567 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.727508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal" event={"ID":"d1545ebb4ca35d78d25cb4530928f045","Type":"ContainerDied","Data":"62b797263319f2df7b1006ff18297c1ac9dea7138870b8f9e1444006af87a9be"}
Jul 14 07:49:42.737501 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.737398    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ctgjh" event={"ID":"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c","Type":"ContainerStarted","Data":"95e4a377c72db44f83214e37df19dd95f6ac3d0919ddc7bb2c10527efcbf9504"}
Jul 14 07:49:42.751735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.751638    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerStarted","Data":"dfe1a11e44fced469420ca83c7b9fdfcfd9d7766c1b325c007aa91b330226fbf"}
Jul 14 07:49:42.762829 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.762756    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tntbw" event={"ID":"047c7ea0-3c11-4754-a0dc-c08990ed4c09","Type":"ContainerStarted","Data":"99d2d9890201e1d27da7c32f785a3a4c6447c6bae004d35c93eb915d109065de"}
Jul 14 07:49:42.766684 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.766652    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp" event={"ID":"256636ae-db77-4cae-8c5e-4d9d8fa6120b","Type":"ContainerStarted","Data":"c4831a75672669affd56f643b51d526a2f0fcd5e388c43e2bfb27abdb500c972"}
Jul 14 07:49:42.770312 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.770230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z622s" event={"ID":"6467f114-153b-4368-8289-7acf7e0f3efc","Type":"ContainerStarted","Data":"58e25952e1c16e2a715ef43b5f4a52fc7d965622dc9810e4213fa263bd5fefb0"}
Jul 14 07:49:42.779897 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.779866    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6tstk" event={"ID":"00ef38e6-d0f9-439c-bb05-bfae19b901f6","Type":"ContainerStarted","Data":"40998bc0a728538f891b6e5a85b10cfdbf1c77268a2df40bcb2e534b19724950"}
Jul 14 07:49:42.792051 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:42.789472    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lclhv" event={"ID":"afbbaeeb-642f-40e8-97b9-c40c37606c1c","Type":"ContainerStarted","Data":"e13039ccc2db80178c2ade6b8da9f8e1a2d77da681497e0a852fe75163f22e74"}
Jul 14 07:49:43.212436 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:43.212404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:43.212596 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.212576    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:43.212670 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.212652    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs podName:7c94effb-a854-417f-98e8-0a2d4c97bc25 nodeName:}" failed. No retries permitted until 2026-07-14 07:49:45.212631481 +0000 UTC m=+7.954549330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs") pod "network-metrics-daemon-fkzdh" (UID: "7c94effb-a854-417f-98e8-0a2d4c97bc25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:43.313573 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:43.313532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:43.313759 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:43.313602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:43.313822 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.313776    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:49:43.313822 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.313797    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:49:43.313822 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.313811    2562 projected.go:196] Error preparing data for projected volume kube-api-access-mtx4x for pod openshift-network-diagnostics/network-check-target-8j2kw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:43.314040 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.313875    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:43.314040 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.313901    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x podName:0ce822ae-f256-411e-ba04-046313ed265d nodeName:}" failed. No retries permitted until 2026-07-14 07:49:45.313881204 +0000 UTC m=+8.055799073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtx4x" (UniqueName: "kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x") pod "network-check-target-8j2kw" (UID: "0ce822ae-f256-411e-ba04-046313ed265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:43.314040 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.313944    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret podName:c400d5dd-5e2f-42d2-98e6-8efb2140df6f nodeName:}" failed. No retries permitted until 2026-07-14 07:49:45.313923419 +0000 UTC m=+8.055841267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret") pod "global-pull-secret-syncer-csf4v" (UID: "c400d5dd-5e2f-42d2-98e6-8efb2140df6f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:43.595837 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:43.595724    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 07:44:41 +0000 UTC" deadline="2028-03-05 01:36:07.743781259 +0000 UTC"
Jul 14 07:49:43.595837 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:43.595788    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14393h46m24.147997566s"
Jul 14 07:49:43.704655 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:43.704587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:43.704837 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.704707    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:43.705122 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:43.705104    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:43.705218 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:43.705199    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:49:43.830163 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:43.830131    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal" event={"ID":"d1545ebb4ca35d78d25cb4530928f045","Type":"ContainerStarted","Data":"8b68a28ac73e127ebf7ff23e2f1b8e2f6798505ec5ce46cf9a096ac9d7d5151b"}
Jul 14 07:49:44.695524 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:44.694947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:44.695524 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:44.695114    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:45.230863 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:45.230820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:45.231051 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.230975    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:45.231115 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.231063    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs podName:7c94effb-a854-417f-98e8-0a2d4c97bc25 nodeName:}" failed. No retries permitted until 2026-07-14 07:49:49.231041752 +0000 UTC m=+11.972959602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs") pod "network-metrics-daemon-fkzdh" (UID: "7c94effb-a854-417f-98e8-0a2d4c97bc25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:45.331786 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:45.331738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:45.331962 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:45.331853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:45.331962 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.331909    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:49:45.331962 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.331938    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:49:45.331962 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.331952    2562 projected.go:196] Error preparing data for projected volume kube-api-access-mtx4x for pod openshift-network-diagnostics/network-check-target-8j2kw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:45.331962 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.331960    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:45.332242 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.332037    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x podName:0ce822ae-f256-411e-ba04-046313ed265d nodeName:}" failed. No retries permitted until 2026-07-14 07:49:49.331998948 +0000 UTC m=+12.073916799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtx4x" (UniqueName: "kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x") pod "network-check-target-8j2kw" (UID: "0ce822ae-f256-411e-ba04-046313ed265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:45.332242 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.332058    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret podName:c400d5dd-5e2f-42d2-98e6-8efb2140df6f nodeName:}" failed. No retries permitted until 2026-07-14 07:49:49.332047664 +0000 UTC m=+12.073965516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret") pod "global-pull-secret-syncer-csf4v" (UID: "c400d5dd-5e2f-42d2-98e6-8efb2140df6f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:45.694670 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:45.694590    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:45.694844 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.694732    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:49:45.695167 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:45.695152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:45.695279 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:45.695254    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:46.694539 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:46.694495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:46.695227 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:46.694640    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:47.695715 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:47.695075    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:47.695715 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:47.695198    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:49:47.695715 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:47.695579    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:47.695715 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:47.695670    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:48.695234 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:48.695199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:48.695429 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:48.695344    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:49.260626 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:49.260582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:49.261111 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.260736    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:49.261111 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.260810    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs podName:7c94effb-a854-417f-98e8-0a2d4c97bc25 nodeName:}" failed. No retries permitted until 2026-07-14 07:49:57.260788423 +0000 UTC m=+20.002706284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs") pod "network-metrics-daemon-fkzdh" (UID: "7c94effb-a854-417f-98e8-0a2d4c97bc25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:49.362096 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:49.361942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:49.362096 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:49.362059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:49.362326 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.362154    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:49:49.362326 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.362166    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:49.362326 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.362179    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:49:49.362326 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.362192    2562 projected.go:196] Error preparing data for projected volume kube-api-access-mtx4x for pod openshift-network-diagnostics/network-check-target-8j2kw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:49.362326 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.362228    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret podName:c400d5dd-5e2f-42d2-98e6-8efb2140df6f nodeName:}" failed. No retries permitted until 2026-07-14 07:49:57.362208733 +0000 UTC m=+20.104126583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret") pod "global-pull-secret-syncer-csf4v" (UID: "c400d5dd-5e2f-42d2-98e6-8efb2140df6f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:49.362326 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.362247    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x podName:0ce822ae-f256-411e-ba04-046313ed265d nodeName:}" failed. No retries permitted until 2026-07-14 07:49:57.36223791 +0000 UTC m=+20.104155761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtx4x" (UniqueName: "kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x") pod "network-check-target-8j2kw" (UID: "0ce822ae-f256-411e-ba04-046313ed265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:49.694507 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:49.694354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:49.694507 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.694494    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:49.694727 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:49.694354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:49.694727 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:49.694591    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:49:50.694497 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:50.694455    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:50.694961 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:50.694602    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:51.694882 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:51.694844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:51.695338 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:51.694956    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:49:51.695338 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:51.695036    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:51.695338 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:51.695148    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:52.695080 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:52.695040    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:52.695540 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:52.695198    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:53.694553 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:53.694521    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:53.694553 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:53.694555    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:53.694798 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:53.694639    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:53.694798 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:53.694753    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:49:54.694394 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:54.694355    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:54.694831 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:54.694494    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:55.694438 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:55.694401    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:55.694921 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:55.694527    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:49:55.694921 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:55.694593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:55.694921 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:55.694708    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:56.694376 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:56.694336    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:56.694543 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:56.694489    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:57.319508 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:57.319466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:57.319671 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.319633    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:57.319741 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.319715    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs podName:7c94effb-a854-417f-98e8-0a2d4c97bc25 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:13.319691882 +0000 UTC m=+36.061609762 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs") pod "network-metrics-daemon-fkzdh" (UID: "7c94effb-a854-417f-98e8-0a2d4c97bc25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:49:57.420219 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:57.420175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:57.420409 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:57.420273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:57.420409 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.420324    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:49:57.420409 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.420348    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:49:57.420409 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.420358    2562 projected.go:196] Error preparing data for projected volume kube-api-access-mtx4x for pod openshift-network-diagnostics/network-check-target-8j2kw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:57.420409 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.420359    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:57.420409 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.420408    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret podName:c400d5dd-5e2f-42d2-98e6-8efb2140df6f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:13.42039454 +0000 UTC m=+36.162312387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret") pod "global-pull-secret-syncer-csf4v" (UID: "c400d5dd-5e2f-42d2-98e6-8efb2140df6f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:49:57.420734 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.420423    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x podName:0ce822ae-f256-411e-ba04-046313ed265d nodeName:}" failed. No retries permitted until 2026-07-14 07:50:13.420416517 +0000 UTC m=+36.162334363 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtx4x" (UniqueName: "kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x") pod "network-check-target-8j2kw" (UID: "0ce822ae-f256-411e-ba04-046313ed265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:49:57.696223 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:57.696137    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:57.696650 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.696252    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:49:57.696650 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:57.696290    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:57.696650 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:57.696367    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:58.694569 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:58.694538    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:49:58.694751 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:58.694680    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:49:59.694787 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:59.694755    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:49:59.695372 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:49:59.694756    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:49:59.695372 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:59.694882    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:49:59.695372 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:49:59.694958    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:50:00.694979 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.694537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:00.694979 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:00.694864    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:50:00.863921 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.863883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lclhv" event={"ID":"afbbaeeb-642f-40e8-97b9-c40c37606c1c","Type":"ContainerStarted","Data":"4eba4f06a60943f3f4928c2d38bd517cba28caf98373cc6df2989647fb7375af"}
Jul 14 07:50:00.865849 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.865812    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zh6z7" event={"ID":"40da2252-37f7-4c05-8319-acb257da6539","Type":"ContainerStarted","Data":"8637980a803a1c7cff888117f320e15b6dafe49ec48d1ffadcc5388e8658fa9c"}
Jul 14 07:50:00.867518 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.867481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkhcb" event={"ID":"0d150ba2-aafc-41e1-94e3-2fcde4db6ee5","Type":"ContainerStarted","Data":"d901b4c25962ddc6c008b036752aa8a34046fd0c4257c24f4fc6993fe9dc086f"}
Jul 14 07:50:00.869606 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.869578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ctgjh" event={"ID":"4b054bd5-7ed1-4dff-bc4c-3b0e6daae13c","Type":"ContainerStarted","Data":"fa54baab36e9ca7ffe27f27b2394029842a27fb9e1349b9fa88aa351aa871553"}
Jul 14 07:50:00.871120 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.871070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerStarted","Data":"3fc650637ce5a3ef7393a65ebde6707f806c333da6978a365ba844eb4f9388bc"}
Jul 14 07:50:00.872560 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.872539    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tntbw" event={"ID":"047c7ea0-3c11-4754-a0dc-c08990ed4c09","Type":"ContainerStarted","Data":"49e40817efaff3578fae9b3844d86b67fdc3c07bc82b5ad038acf4894f770c7c"}
Jul 14 07:50:00.877457 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.877432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp" event={"ID":"256636ae-db77-4cae-8c5e-4d9d8fa6120b","Type":"ContainerStarted","Data":"34a1c5aab4556d15f71c6126ea18708d9134fe3b5561edb8223c319cd1b52c3f"}
Jul 14 07:50:00.878706 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.878684    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z622s" event={"ID":"6467f114-153b-4368-8289-7acf7e0f3efc","Type":"ContainerStarted","Data":"131043a4d61e5b08d1cd5678bfc25e9ee3be236512e5d54e951ca7b5057a6dcc"}
Jul 14 07:50:00.879863 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.879828    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-164.ec2.internal" podStartSLOduration=19.8798017 podStartE2EDuration="19.8798017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:49:43.85034507 +0000 UTC m=+6.592262941" watchObservedRunningTime="2026-07-14 07:50:00.8798017 +0000 UTC m=+23.621719552"
Jul 14 07:50:00.880233 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.880204    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lclhv" podStartSLOduration=4.225631948 podStartE2EDuration="22.880194841s" totalImagesPullingTime="18.654562893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:00.879982731 +0000 UTC m=+23.621900599" watchObservedRunningTime="2026-07-14 07:50:00.880194841 +0000 UTC m=+23.622112710"
Jul 14 07:50:00.897262 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.897192    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ctgjh" podStartSLOduration=4.213826464 podStartE2EDuration="22.897168398s" totalImagesPullingTime="18.683341934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:00.896969416 +0000 UTC m=+23.638887284" watchObservedRunningTime="2026-07-14 07:50:00.897168398 +0000 UTC m=+23.639086267"
Jul 14 07:50:00.911641 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.911588    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zh6z7" podStartSLOduration=4.253251918 podStartE2EDuration="22.911572111s" totalImagesPullingTime="18.658320193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:00.910971422 +0000 UTC m=+23.652889299" watchObservedRunningTime="2026-07-14 07:50:00.911572111 +0000 UTC m=+23.653490042"
Jul 14 07:50:00.929035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.928968    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z622s" podStartSLOduration=5.236647556 podStartE2EDuration="23.928952682s" totalImagesPullingTime="18.692305126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:00.928528122 +0000 UTC m=+23.670445994" watchObservedRunningTime="2026-07-14 07:50:00.928952682 +0000 UTC m=+23.670870549"
Jul 14 07:50:00.950627 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:00.950433    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wkhcb" podStartSLOduration=5.26967878 podStartE2EDuration="23.95041773s" totalImagesPullingTime="18.68073895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:00.949976571 +0000 UTC m=+23.691894440" watchObservedRunningTime="2026-07-14 07:50:00.95041773 +0000 UTC m=+23.692335598"
Jul 14 07:50:01.695112 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.695076    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:01.695112 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.695097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:01.695945 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:01.695238    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:50:01.695945 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:01.695335    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:50:01.883680 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.883653    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 07:50:01.884027 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.883992    2562 generic.go:356] "Generic (PLEG): container finished" podID="237827e0-c948-4a42-93bb-ee77c3ef7e17" containerID="0a4c70ea74e0221760e066581d6b942b896ebce0aac56860ce9fda27af04d825" exitCode=1
Jul 14 07:50:01.884082 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.884032    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerStarted","Data":"8d9dc2fa8a321c3973067a9ea9acc1977dce070547d52b4f63ea3d62b5c5df51"}
Jul 14 07:50:01.884124 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.884100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerStarted","Data":"54cebfea50bffdb927545b9753b7707891f531edeac2c37e2357d99629646904"}
Jul 14 07:50:01.884164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.884138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerStarted","Data":"ed227bed475feb6e3aea576d8a59bd156b54be8d8227e2246df540e549c2d1d2"}
Jul 14 07:50:01.884209 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.884194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerStarted","Data":"74015172c5267885920e9977b6ffdffe30faad546a24f202f7a30383b8b8d16c"}
Jul 14 07:50:01.884248 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.884232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerDied","Data":"0a4c70ea74e0221760e066581d6b942b896ebce0aac56860ce9fda27af04d825"}
Jul 14 07:50:01.885528 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.885508    2562 generic.go:356] "Generic (PLEG): container finished" podID="047c7ea0-3c11-4754-a0dc-c08990ed4c09" containerID="49e40817efaff3578fae9b3844d86b67fdc3c07bc82b5ad038acf4894f770c7c" exitCode=0
Jul 14 07:50:01.885610 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.885577    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tntbw" event={"ID":"047c7ea0-3c11-4754-a0dc-c08990ed4c09","Type":"ContainerDied","Data":"49e40817efaff3578fae9b3844d86b67fdc3c07bc82b5ad038acf4894f770c7c"}
Jul 14 07:50:01.886895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.886872    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6tstk" event={"ID":"00ef38e6-d0f9-439c-bb05-bfae19b901f6","Type":"ContainerStarted","Data":"53c60d4fbda8e184645d89fbe92830b88e92ca49ef3f5f4fc5e3b225b1b560b9"}
Jul 14 07:50:01.924460 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:01.924400    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6tstk" podStartSLOduration=6.225138309 podStartE2EDuration="24.924377886s" totalImagesPullingTime="18.699239577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:01.923729303 +0000 UTC m=+24.665647171" watchObservedRunningTime="2026-07-14 07:50:01.924377886 +0000 UTC m=+24.666295755"
Jul 14 07:50:02.025660 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:02.025628    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 07:50:02.629034 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:02.628669    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T07:50:02.025649057Z","UUID":"ab0e95e6-8b2c-48f6-be15-741a1c9fd69e","Handler":null,"Name":"","Endpoint":""}
Jul 14 07:50:02.630840 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:02.630755    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 07:50:02.630840 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:02.630796    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 07:50:02.694629 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:02.694597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:02.694791 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:02.694741    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:50:02.891030 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:02.890928    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp" event={"ID":"256636ae-db77-4cae-8c5e-4d9d8fa6120b","Type":"ContainerStarted","Data":"ea606a9a6edd190719d04765abcda71cbf0b6caf574c20442ecf3ecbd103bbe2"}
Jul 14 07:50:03.051524 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.051489    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:50:03.052190 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.052170    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:50:03.694264 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.694178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:03.694415 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:03.694292    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:50:03.694415 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.694348    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:03.694501 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:03.694461    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:50:03.900199 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.900169    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 07:50:03.900800 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.900591    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerStarted","Data":"bbf894278d1bdc31ae8efe5df47f4140716e7c4115a4fd5499e337c7e1024a97"}
Jul 14 07:50:03.902885 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.902862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp" event={"ID":"256636ae-db77-4cae-8c5e-4d9d8fa6120b","Type":"ContainerStarted","Data":"c77ed8f7a78bd2427a028228ff0e6e6ee398417aab9c9042f8cd82d4454aa8e8"}
Jul 14 07:50:03.903359 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.903210    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:50:03.903723 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.903701    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zh6z7"
Jul 14 07:50:03.920163 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:03.920107    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcvgp" podStartSLOduration=6.145178661 podStartE2EDuration="26.920088741s" totalImagesPullingTime="20.77491008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:03.920073654 +0000 UTC m=+26.661991522" watchObservedRunningTime="2026-07-14 07:50:03.920088741 +0000 UTC m=+26.662006609"
Jul 14 07:50:04.694528 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:04.694497    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:04.694685 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:04.694603    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:50:05.694926 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:05.694840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:05.695629 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:05.694966    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:50:05.695629 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:05.695029    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:05.695629 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:05.695141    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:50:06.694386 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:06.694216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:06.694517 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:06.694490    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:50:06.913173 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:06.913104    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 07:50:06.913623 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:06.913501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerStarted","Data":"a131c0ad208f6ecc9421c68c6f42eb50ed41b61aeb0fcf8cc466c9ba022faf8e"}
Jul 14 07:50:06.913736 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:06.913720    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:50:06.913947 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:06.913930    2562 scope.go:117] "RemoveContainer" containerID="0a4c70ea74e0221760e066581d6b942b896ebce0aac56860ce9fda27af04d825"
Jul 14 07:50:06.915540 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:06.915515    2562 generic.go:356] "Generic (PLEG): container finished" podID="047c7ea0-3c11-4754-a0dc-c08990ed4c09" containerID="80a9a9e2cdcf4dfb942f10a51503daf64d4a91d8b68fc8fe0eb312ecd1f3cf2e" exitCode=0
Jul 14 07:50:06.915643 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:06.915566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tntbw" event={"ID":"047c7ea0-3c11-4754-a0dc-c08990ed4c09","Type":"ContainerDied","Data":"80a9a9e2cdcf4dfb942f10a51503daf64d4a91d8b68fc8fe0eb312ecd1f3cf2e"}
Jul 14 07:50:06.930810 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:06.930779    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:50:07.695189 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.695155    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:07.695415 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.695201    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:07.695415 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:07.695284    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:50:07.695415 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:07.695365    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:50:07.920565 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.920540    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 07:50:07.920883 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.920820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" event={"ID":"237827e0-c948-4a42-93bb-ee77c3ef7e17","Type":"ContainerStarted","Data":"cd1b16fe8fa66e225bc0a93827129b773b6e7a70b1756f10f7c14de7b7363ca0"}
Jul 14 07:50:07.921746 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.921724    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:50:07.921870 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.921794    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:50:07.923954 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.923923    2562 generic.go:356] "Generic (PLEG): container finished" podID="047c7ea0-3c11-4754-a0dc-c08990ed4c09" containerID="dff8b6b980898be915eac44f2e7b938f3fe867efae6bea1a7f7d868e8ddc260d" exitCode=0
Jul 14 07:50:07.924078 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.923977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tntbw" event={"ID":"047c7ea0-3c11-4754-a0dc-c08990ed4c09","Type":"ContainerDied","Data":"dff8b6b980898be915eac44f2e7b938f3fe867efae6bea1a7f7d868e8ddc260d"}
Jul 14 07:50:07.936563 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.936543    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:50:07.953341 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:07.953243    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c" podStartSLOduration=11.230434402 podStartE2EDuration="29.953226878s" totalImagesPullingTime="18.722792476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:07.952970293 +0000 UTC m=+30.694888175" watchObservedRunningTime="2026-07-14 07:50:07.953226878 +0000 UTC m=+30.695144747"
Jul 14 07:50:08.694581 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:08.694362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:08.694655 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:08.694634    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:50:08.833739 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:08.833709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8j2kw"]
Jul 14 07:50:08.833912 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:08.833818    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:08.833912 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:08.833894    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:50:08.836843 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:08.836814    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-csf4v"]
Jul 14 07:50:08.836972 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:08.836923    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:08.837059 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:08.837035    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:50:08.837393 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:08.837373    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fkzdh"]
Jul 14 07:50:08.931927 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:08.929304    2562 generic.go:356] "Generic (PLEG): container finished" podID="047c7ea0-3c11-4754-a0dc-c08990ed4c09" containerID="daa3fd386212a8bff55a22abbde3614cc9a8eba175c14a7427be5ce9875af090" exitCode=0
Jul 14 07:50:08.931927 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:08.929461    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:08.931927 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:08.929573    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tntbw" event={"ID":"047c7ea0-3c11-4754-a0dc-c08990ed4c09","Type":"ContainerDied","Data":"daa3fd386212a8bff55a22abbde3614cc9a8eba175c14a7427be5ce9875af090"}
Jul 14 07:50:08.931927 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:08.929636    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:50:10.694735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:10.694648    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:10.694735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:10.694697    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:10.694735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:10.694696    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:10.695554 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:10.694781    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:50:10.695554 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:10.694931    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:50:10.695554 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:10.694989    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:50:12.694764 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:12.694733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:12.695306 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:12.694740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:12.695306 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:12.694864    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8j2kw" podUID="0ce822ae-f256-411e-ba04-046313ed265d"
Jul 14 07:50:12.695306 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:12.694889    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:12.695306 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:12.694994    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csf4v" podUID="c400d5dd-5e2f-42d2-98e6-8efb2140df6f"
Jul 14 07:50:12.695306 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:12.695123    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkzdh" podUID="7c94effb-a854-417f-98e8-0a2d4c97bc25"
Jul 14 07:50:13.336308 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.336283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:13.336455 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.336438    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:13.336516 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.336506    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs podName:7c94effb-a854-417f-98e8-0a2d4c97bc25 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:45.336490649 +0000 UTC m=+68.078408495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs") pod "network-metrics-daemon-fkzdh" (UID: "7c94effb-a854-417f-98e8-0a2d4c97bc25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:13.436795 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.436769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:13.436958 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.436835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:13.436958 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.436936    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:13.436958 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.436950    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:50:13.437124 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.436972    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:50:13.437124 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.436985    2562 projected.go:196] Error preparing data for projected volume kube-api-access-mtx4x for pod openshift-network-diagnostics/network-check-target-8j2kw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:13.437124 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.436989    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret podName:c400d5dd-5e2f-42d2-98e6-8efb2140df6f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:45.43697145 +0000 UTC m=+68.178889305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret") pod "global-pull-secret-syncer-csf4v" (UID: "c400d5dd-5e2f-42d2-98e6-8efb2140df6f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:13.437124 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.437054    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x podName:0ce822ae-f256-411e-ba04-046313ed265d nodeName:}" failed. No retries permitted until 2026-07-14 07:50:45.437037411 +0000 UTC m=+68.178955271 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtx4x" (UniqueName: "kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x") pod "network-check-target-8j2kw" (UID: "0ce822ae-f256-411e-ba04-046313ed265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:13.529586 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.529559    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-164.ec2.internal" event="NodeReady"
Jul 14 07:50:13.529779 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.529720    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 07:50:13.564667 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.564640    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq"]
Jul 14 07:50:13.585941 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.585913    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-szw28"]
Jul 14 07:50:13.586080 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.586061    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq"
Jul 14 07:50:13.591586 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.590657    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.591586 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.591135    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.591586 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.591459    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4dkn4\""
Jul 14 07:50:13.601247 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.601224    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-665c7578c7-z8t55"]
Jul 14 07:50:13.601380 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.601366    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.604083 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.604066    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gmcvg\""
Jul 14 07:50:13.604262 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.604247    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 14 07:50:13.604682 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.604661    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 14 07:50:13.606314 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.606289    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.606413 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.606341    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.614338 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.614247    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"]
Jul 14 07:50:13.616119 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.614547    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.616529 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.616256    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 14 07:50:13.617811 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.617786    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 07:50:13.618920 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.618725    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 07:50:13.619033 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.618911    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtm4v\""
Jul 14 07:50:13.619589 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.619572    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 07:50:13.623081 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.623063    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 07:50:13.634068 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.634050    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"]
Jul 14 07:50:13.634167 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.634153    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:13.636772 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.636756    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 14 07:50:13.636864 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.636812    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.637820 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.637804    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 14 07:50:13.637979 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.637966    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.638129 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.638116    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ps5qh\""
Jul 14 07:50:13.650433 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.650411    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-nzn8l"]
Jul 14 07:50:13.650525 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.650513    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:13.652979 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.652955    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.653142 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.652958    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 14 07:50:13.653142 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.652997    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xwxjm\""
Jul 14 07:50:13.653142 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.653060    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.668648 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.668622    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c79d46876-mj7tx"]
Jul 14 07:50:13.668790 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.668754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.671663 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.671633    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 14 07:50:13.671663 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.671655    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.671663 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.671662    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xg7n8\""
Jul 14 07:50:13.671874 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.671753    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 14 07:50:13.671874 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.671774    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.677756 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.677740    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 14 07:50:13.689080 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.689057    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-szw28"]
Jul 14 07:50:13.689182 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.689088    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"]
Jul 14 07:50:13.689182 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.689097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.689182 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.689132    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"]
Jul 14 07:50:13.692940 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.692925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 14 07:50:13.693172 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.693156    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 14 07:50:13.693258 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.693237    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 14 07:50:13.693795 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.693761    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 14 07:50:13.693795 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.693790    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.693965 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.693945    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pvb26\""
Jul 14 07:50:13.694153 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.694136    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.711167 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.711142    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"]
Jul 14 07:50:13.711543 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.711286    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.713689 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.713672    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 14 07:50:13.714658 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.714635    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 14 07:50:13.714771 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.714723    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.714771 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.714738    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xhbqj\""
Jul 14 07:50:13.715240 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.715227    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.732476 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.732452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.734908 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.734889    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 14 07:50:13.735131 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.735116    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.735468 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.735446    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 14 07:50:13.735581 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.735536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-r6tht\""
Jul 14 07:50:13.735664 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.735650    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.735838 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.735824    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-nzn8l"]
Jul 14 07:50:13.735877 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.735852    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dbsxm"]
Jul 14 07:50:13.735943 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.735930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:13.738416 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738401    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 07:50:13.738605 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.738709 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-installation-pull-secrets\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.738709 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc5m2\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-kube-api-access-bc5m2\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.738709 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:13.738825 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-bound-sa-token\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.738825 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c00ad41c-67de-4cc6-951a-78f04f46bc7a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:13.738825 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2bw8\" (UniqueName: \"kubernetes.io/projected/c00ad41c-67de-4cc6-951a-78f04f46bc7a-kube-api-access-v2bw8\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:13.738913 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr94s\" (UniqueName: \"kubernetes.io/projected/5b43906e-04b3-41e6-8cef-0c3e9c27d9ba-kube-api-access-cr94s\") pod \"volume-data-source-validator-78495597f6-s6pzq\" (UID: \"5b43906e-04b3-41e6-8cef-0c3e9c27d9ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq"
Jul 14 07:50:13.738913 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-ca-trust-extracted\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.738972 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-tmp\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.739026 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.738974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-image-registry-private-configuration\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.739026 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.739019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-snapshots\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.739101 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.739062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g97qm\" (UniqueName: \"kubernetes.io/projected/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-kube-api-access-g97qm\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.739101 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.739091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-serving-cert\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.739183 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.739114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.739183 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.739138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-certificates\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.739246 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.739225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.739291 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.739275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-trusted-ca\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.748670 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.748652    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vgdqw"]
Jul 14 07:50:13.748783 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.748768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dbsxm"
Jul 14 07:50:13.751517 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.751501    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 07:50:13.751619 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.751507    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5nzm8\""
Jul 14 07:50:13.751619 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.751608    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.751730 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.751622    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.764762 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.764741    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5"]
Jul 14 07:50:13.764860 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.764844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:13.767330 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.767314    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 07:50:13.767330 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.767324    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8lxlt\""
Jul 14 07:50:13.767473 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.767332    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 07:50:13.785208 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785181    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5"
Jul 14 07:50:13.785208 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785197    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq"]
Jul 14 07:50:13.785359 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785236    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-665c7578c7-z8t55"]
Jul 14 07:50:13.785359 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785272    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"]
Jul 14 07:50:13.785359 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785295    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5"]
Jul 14 07:50:13.785359 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785310    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"]
Jul 14 07:50:13.785359 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785329    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dbsxm"]
Jul 14 07:50:13.785359 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785348    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"]
Jul 14 07:50:13.785565 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785372    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgdqw"]
Jul 14 07:50:13.785565 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.785396    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c79d46876-mj7tx"]
Jul 14 07:50:13.788257 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.788140    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 07:50:13.788512 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.788495    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dwpv8\""
Jul 14 07:50:13.788599 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.788514    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 07:50:13.839880 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.839841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-trusted-ca\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.839880 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.839884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-4jbz9\" (UID: \"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.839913    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/090f2367-54a2-401a-8686-e99d1a738379-config\") pod \"service-ca-operator-7695fc6c8c-hpq4p\" (UID: \"090f2367-54a2-401a-8686-e99d1a738379\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.839942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.839962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/090f2367-54a2-401a-8686-e99d1a738379-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hpq4p\" (UID: \"090f2367-54a2-401a-8686-e99d1a738379\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.839988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-installation-pull-secrets\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr94s\" (UniqueName: \"kubernetes.io/projected/5b43906e-04b3-41e6-8cef-0c3e9c27d9ba-kube-api-access-cr94s\") pod \"volume-data-source-validator-78495597f6-s6pzq\" (UID: \"5b43906e-04b3-41e6-8cef-0c3e9c27d9ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq"
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2bw8\" (UniqueName: \"kubernetes.io/projected/c00ad41c-67de-4cc6-951a-78f04f46bc7a-kube-api-access-v2bw8\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-bound-sa-token\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.840119    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:13.840164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c00ad41c-67de-4cc6-951a-78f04f46bc7a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840172    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rp8b\" (UniqueName: \"kubernetes.io/projected/090f2367-54a2-401a-8686-e99d1a738379-kube-api-access-6rp8b\") pod \"service-ca-operator-7695fc6c8c-hpq4p\" (UID: \"090f2367-54a2-401a-8686-e99d1a738379\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28ctm\" (UniqueName: \"kubernetes.io/projected/8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2-kube-api-access-28ctm\") pod \"kube-storage-version-migrator-operator-799cb7f958-4jbz9\" (UID: \"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.840245    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls podName:c00ad41c-67de-4cc6-951a-78f04f46bc7a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:14.340222715 +0000 UTC m=+37.082140564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wpgfz" (UID: "c00ad41c-67de-4cc6-951a-78f04f46bc7a") : secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-image-registry-private-configuration\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-4jbz9\" (UID: \"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsqbr\" (UniqueName: \"kubernetes.io/projected/d65da55a-a502-464f-8c67-f626a5b8cb04-kube-api-access-tsqbr\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g97qm\" (UniqueName: \"kubernetes.io/projected/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-kube-api-access-g97qm\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xnqq\" (UniqueName: \"kubernetes.io/projected/de40039d-c78f-4b39-81f1-ab14ef33de8e-kube-api-access-2xnqq\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc5m2\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-kube-api-access-bc5m2\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-serving-cert\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.840728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d65da55a-a502-464f-8c67-f626a5b8cb04-config\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65da55a-a502-464f-8c67-f626a5b8cb04-serving-cert\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65da55a-a502-464f-8c67-f626a5b8cb04-trusted-ca\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840920    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-ca-trust-extracted\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-default-certificate\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c00ad41c-67de-4cc6-951a-78f04f46bc7a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.840978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-stats-auth\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.841035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4sfg\" (UniqueName: \"kubernetes.io/projected/ee5e97bf-4810-415c-881a-0ab22e7d22b3-kube-api-access-n4sfg\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.841046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-trusted-ca\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.841068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.841101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-tmp\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.841134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-snapshots\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.841190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-ca-trust-extracted\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.841209    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.841340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.841234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-certificates\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.841962 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.841302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.842037 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.841974    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 07:50:13.842037 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.841994    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665c7578c7-z8t55: secret "image-registry-tls" not found
Jul 14 07:50:13.842204 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.842187    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls podName:f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:14.342162978 +0000 UTC m=+37.084080827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls") pod "image-registry-665c7578c7-z8t55" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6") : secret "image-registry-tls" not found
Jul 14 07:50:13.842204 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.842190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-certificates\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.842412 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.842389    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-tmp\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.842563 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.842532    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-snapshots\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.844936 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.843568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.847107 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.845273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-serving-cert\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.847107 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.845565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-installation-pull-secrets\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.847107 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.845789    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-image-registry-private-configuration\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.850401 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.850368    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr94s\" (UniqueName: \"kubernetes.io/projected/5b43906e-04b3-41e6-8cef-0c3e9c27d9ba-kube-api-access-cr94s\") pod \"volume-data-source-validator-78495597f6-s6pzq\" (UID: \"5b43906e-04b3-41e6-8cef-0c3e9c27d9ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq"
Jul 14 07:50:13.850595 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.850570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2bw8\" (UniqueName: \"kubernetes.io/projected/c00ad41c-67de-4cc6-951a-78f04f46bc7a-kube-api-access-v2bw8\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:13.850732 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.850712    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-bound-sa-token\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.850780 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.850759    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc5m2\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-kube-api-access-bc5m2\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:13.850817 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.850760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g97qm\" (UniqueName: \"kubernetes.io/projected/3d69459a-868a-4c7f-b665-9ce0d8a7d6b6-kube-api-access-g97qm\") pod \"insights-operator-68d9dd94cf-szw28\" (UID: \"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6\") " pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.925416 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.925295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq"
Jul 14 07:50:13.930403 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.930382    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-szw28"
Jul 14 07:50:13.941937 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.941908    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54c6beae-ce14-49ed-b191-b072a7ab5c67-config-volume\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:13.942094 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.941973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-4jbz9\" (UID: \"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.942094 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/090f2367-54a2-401a-8686-e99d1a738379-config\") pod \"service-ca-operator-7695fc6c8c-hpq4p\" (UID: \"090f2367-54a2-401a-8686-e99d1a738379\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.942094 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/090f2367-54a2-401a-8686-e99d1a738379-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hpq4p\" (UID: \"090f2367-54a2-401a-8686-e99d1a738379\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.942263 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d72dd8-efdb-4c85-b6cc-ffd58a507662-cert\") pod \"ingress-canary-dbsxm\" (UID: \"b8d72dd8-efdb-4c85-b6cc-ffd58a507662\") " pod="openshift-ingress-canary/ingress-canary-dbsxm"
Jul 14 07:50:13.942263 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:13.942263 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rp8b\" (UniqueName: \"kubernetes.io/projected/090f2367-54a2-401a-8686-e99d1a738379-kube-api-access-6rp8b\") pod \"service-ca-operator-7695fc6c8c-hpq4p\" (UID: \"090f2367-54a2-401a-8686-e99d1a738379\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.942263 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x299k\" (UniqueName: \"kubernetes.io/projected/e94aceb8-eb1b-41aa-8626-6d9fe346c17c-kube-api-access-x299k\") pod \"network-check-source-869dcfcdcd-hd9p5\" (UID: \"e94aceb8-eb1b-41aa-8626-6d9fe346c17c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5"
Jul 14 07:50:13.942263 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28ctm\" (UniqueName: \"kubernetes.io/projected/8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2-kube-api-access-28ctm\") pod \"kube-storage-version-migrator-operator-799cb7f958-4jbz9\" (UID: \"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.942496 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.942496 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-4jbz9\" (UID: \"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.942496 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsqbr\" (UniqueName: \"kubernetes.io/projected/d65da55a-a502-464f-8c67-f626a5b8cb04-kube-api-access-tsqbr\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.942496 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xnqq\" (UniqueName: \"kubernetes.io/projected/de40039d-c78f-4b39-81f1-ab14ef33de8e-kube-api-access-2xnqq\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:13.942496 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftgrv\" (UniqueName: \"kubernetes.io/projected/b8d72dd8-efdb-4c85-b6cc-ffd58a507662-kube-api-access-ftgrv\") pod \"ingress-canary-dbsxm\" (UID: \"b8d72dd8-efdb-4c85-b6cc-ffd58a507662\") " pod="openshift-ingress-canary/ingress-canary-dbsxm"
Jul 14 07:50:13.942496 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d65da55a-a502-464f-8c67-f626a5b8cb04-config\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65da55a-a502-464f-8c67-f626a5b8cb04-serving-cert\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65da55a-a502-464f-8c67-f626a5b8cb04-trusted-ca\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.942580    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-default-certificate\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-stats-auth\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-4jbz9\" (UID: \"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/090f2367-54a2-401a-8686-e99d1a738379-config\") pod \"service-ca-operator-7695fc6c8c-hpq4p\" (UID: \"090f2367-54a2-401a-8686-e99d1a738379\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4sfg\" (UniqueName: \"kubernetes.io/projected/ee5e97bf-4810-415c-881a-0ab22e7d22b3-kube-api-access-n4sfg\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.942767 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.942669    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:14.442652285 +0000 UTC m=+37.184570135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : secret "router-metrics-certs-default" not found
Jul 14 07:50:13.943391 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.942930    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:14.442914268 +0000 UTC m=+37.184832140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : configmap references non-existent config key: service-ca.crt
Jul 14 07:50:13.943391 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.942971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c6beae-ce14-49ed-b191-b072a7ab5c67-tmp-dir\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:13.943391 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.943046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:13.943391 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.943092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw24b\" (UniqueName: \"kubernetes.io/projected/54c6beae-ce14-49ed-b191-b072a7ab5c67-kube-api-access-fw24b\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:13.943391 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.943212    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 07:50:13.943391 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:13.943268    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls podName:de40039d-c78f-4b39-81f1-ab14ef33de8e nodeName:}" failed. No retries permitted until 2026-07-14 07:50:14.443252856 +0000 UTC m=+37.185170721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls") pod "cluster-samples-operator-65db858894-p8dg2" (UID: "de40039d-c78f-4b39-81f1-ab14ef33de8e") : secret "samples-operator-tls" not found
Jul 14 07:50:13.943713 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.943640    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65da55a-a502-464f-8c67-f626a5b8cb04-trusted-ca\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.944234 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.944207    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d65da55a-a502-464f-8c67-f626a5b8cb04-config\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.946951 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.945860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-default-certificate\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.946951 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.945983    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65da55a-a502-464f-8c67-f626a5b8cb04-serving-cert\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.946951 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.946070    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-4jbz9\" (UID: \"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.946951 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.946172    2562 generic.go:356] "Generic (PLEG): container finished" podID="047c7ea0-3c11-4754-a0dc-c08990ed4c09" containerID="5c133395ffe679f901158766a64c779136415013771b55e0a4b64d0e2c3a5086" exitCode=0
Jul 14 07:50:13.946951 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.946222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tntbw" event={"ID":"047c7ea0-3c11-4754-a0dc-c08990ed4c09","Type":"ContainerDied","Data":"5c133395ffe679f901158766a64c779136415013771b55e0a4b64d0e2c3a5086"}
Jul 14 07:50:13.947268 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.947249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-stats-auth\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.947754 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.947734    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/090f2367-54a2-401a-8686-e99d1a738379-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hpq4p\" (UID: \"090f2367-54a2-401a-8686-e99d1a738379\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.954863 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.954715    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28ctm\" (UniqueName: \"kubernetes.io/projected/8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2-kube-api-access-28ctm\") pod \"kube-storage-version-migrator-operator-799cb7f958-4jbz9\" (UID: \"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:13.955229 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.955198    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsqbr\" (UniqueName: \"kubernetes.io/projected/d65da55a-a502-464f-8c67-f626a5b8cb04-kube-api-access-tsqbr\") pod \"console-operator-7866497494-nzn8l\" (UID: \"d65da55a-a502-464f-8c67-f626a5b8cb04\") " pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:13.955331 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.955242    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xnqq\" (UniqueName: \"kubernetes.io/projected/de40039d-c78f-4b39-81f1-ab14ef33de8e-kube-api-access-2xnqq\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:13.955331 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.955261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rp8b\" (UniqueName: \"kubernetes.io/projected/090f2367-54a2-401a-8686-e99d1a738379-kube-api-access-6rp8b\") pod \"service-ca-operator-7695fc6c8c-hpq4p\" (UID: \"090f2367-54a2-401a-8686-e99d1a738379\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:13.955903 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.955886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4sfg\" (UniqueName: \"kubernetes.io/projected/ee5e97bf-4810-415c-881a-0ab22e7d22b3-kube-api-access-n4sfg\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:13.978111 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:13.978083    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:14.019291 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.019263    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"
Jul 14 07:50:14.042950 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.042920    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"
Jul 14 07:50:14.044558 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.044531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54c6beae-ce14-49ed-b191-b072a7ab5c67-config-volume\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:14.044686 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.044605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d72dd8-efdb-4c85-b6cc-ffd58a507662-cert\") pod \"ingress-canary-dbsxm\" (UID: \"b8d72dd8-efdb-4c85-b6cc-ffd58a507662\") " pod="openshift-ingress-canary/ingress-canary-dbsxm"
Jul 14 07:50:14.044686 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.044630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:14.044686 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.044653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x299k\" (UniqueName: \"kubernetes.io/projected/e94aceb8-eb1b-41aa-8626-6d9fe346c17c-kube-api-access-x299k\") pod \"network-check-source-869dcfcdcd-hd9p5\" (UID: \"e94aceb8-eb1b-41aa-8626-6d9fe346c17c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5"
Jul 14 07:50:14.044943 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.044747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftgrv\" (UniqueName: \"kubernetes.io/projected/b8d72dd8-efdb-4c85-b6cc-ffd58a507662-kube-api-access-ftgrv\") pod \"ingress-canary-dbsxm\" (UID: \"b8d72dd8-efdb-4c85-b6cc-ffd58a507662\") " pod="openshift-ingress-canary/ingress-canary-dbsxm"
Jul 14 07:50:14.044943 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.044814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c6beae-ce14-49ed-b191-b072a7ab5c67-tmp-dir\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:14.044943 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.044848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw24b\" (UniqueName: \"kubernetes.io/projected/54c6beae-ce14-49ed-b191-b072a7ab5c67-kube-api-access-fw24b\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:14.051263 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.049786    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 07:50:14.051263 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.049851    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls podName:54c6beae-ce14-49ed-b191-b072a7ab5c67 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:14.549830663 +0000 UTC m=+37.291748526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls") pod "dns-default-vgdqw" (UID: "54c6beae-ce14-49ed-b191-b072a7ab5c67") : secret "dns-default-metrics-tls" not found
Jul 14 07:50:14.052187 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.052130    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54c6beae-ce14-49ed-b191-b072a7ab5c67-config-volume\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:14.052597 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.052544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c6beae-ce14-49ed-b191-b072a7ab5c67-tmp-dir\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:14.078077 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.077994    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw24b\" (UniqueName: \"kubernetes.io/projected/54c6beae-ce14-49ed-b191-b072a7ab5c67-kube-api-access-fw24b\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:14.078923 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.078831    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftgrv\" (UniqueName: \"kubernetes.io/projected/b8d72dd8-efdb-4c85-b6cc-ffd58a507662-kube-api-access-ftgrv\") pod \"ingress-canary-dbsxm\" (UID: \"b8d72dd8-efdb-4c85-b6cc-ffd58a507662\") " pod="openshift-ingress-canary/ingress-canary-dbsxm"
Jul 14 07:50:14.084458 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.084405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x299k\" (UniqueName: \"kubernetes.io/projected/e94aceb8-eb1b-41aa-8626-6d9fe346c17c-kube-api-access-x299k\") pod \"network-check-source-869dcfcdcd-hd9p5\" (UID: \"e94aceb8-eb1b-41aa-8626-6d9fe346c17c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5"
Jul 14 07:50:14.085093 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.084984    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d72dd8-efdb-4c85-b6cc-ffd58a507662-cert\") pod \"ingress-canary-dbsxm\" (UID: \"b8d72dd8-efdb-4c85-b6cc-ffd58a507662\") " pod="openshift-ingress-canary/ingress-canary-dbsxm"
Jul 14 07:50:14.094272 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.093893    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5"
Jul 14 07:50:14.173371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.169345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq"]
Jul 14 07:50:14.211423 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.211327    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-szw28"]
Jul 14 07:50:14.215994 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.215970    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-nzn8l"]
Jul 14 07:50:14.256266 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.256170    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9"]
Jul 14 07:50:14.267661 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.267634    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p"]
Jul 14 07:50:14.279826 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.279798    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5"]
Jul 14 07:50:14.283193 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:14.283162    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b43906e_04b3_41e6_8cef_0c3e9c27d9ba.slice/crio-972ba498173ebdfd666d9d2474818cba96aa92ee43e86590298617960b44431f WatchSource:0}: Error finding container 972ba498173ebdfd666d9d2474818cba96aa92ee43e86590298617960b44431f: Status 404 returned error can't find the container with id 972ba498173ebdfd666d9d2474818cba96aa92ee43e86590298617960b44431f
Jul 14 07:50:14.283829 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:14.283769    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d69459a_868a_4c7f_b665_9ce0d8a7d6b6.slice/crio-de797c05ad6b8944dc17eb1f2684a68648dd2b21f016f3a5e82151ff10f0b4aa WatchSource:0}: Error finding container de797c05ad6b8944dc17eb1f2684a68648dd2b21f016f3a5e82151ff10f0b4aa: Status 404 returned error can't find the container with id de797c05ad6b8944dc17eb1f2684a68648dd2b21f016f3a5e82151ff10f0b4aa
Jul 14 07:50:14.284456 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:14.284433    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94aceb8_eb1b_41aa_8626_6d9fe346c17c.slice/crio-31944708e665e222a9c6b570d6e8c027318d68ae07df40f236064b61c18ddfa6 WatchSource:0}: Error finding container 31944708e665e222a9c6b570d6e8c027318d68ae07df40f236064b61c18ddfa6: Status 404 returned error can't find the container with id 31944708e665e222a9c6b570d6e8c027318d68ae07df40f236064b61c18ddfa6
Jul 14 07:50:14.286135 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:14.286085    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65da55a_a502_464f_8c67_f626a5b8cb04.slice/crio-5a34a9d1ad3b110200f5fba7bcb6df1bcec1dc83e92094d1c51f31d41c05eae5 WatchSource:0}: Error finding container 5a34a9d1ad3b110200f5fba7bcb6df1bcec1dc83e92094d1c51f31d41c05eae5: Status 404 returned error can't find the container with id 5a34a9d1ad3b110200f5fba7bcb6df1bcec1dc83e92094d1c51f31d41c05eae5
Jul 14 07:50:14.288940 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:14.288633    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac33f3d_1fe0_4ad5_84ad_1d16f8a6abf2.slice/crio-a772d816b269010b0f8fd7467d165dcb187475b68ba0f414a7bbcdadc6ef578b WatchSource:0}: Error finding container a772d816b269010b0f8fd7467d165dcb187475b68ba0f414a7bbcdadc6ef578b: Status 404 returned error can't find the container with id a772d816b269010b0f8fd7467d165dcb187475b68ba0f414a7bbcdadc6ef578b
Jul 14 07:50:14.289202 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:14.289112    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090f2367_54a2_401a_8686_e99d1a738379.slice/crio-117d6a4b805323596c4763cd60006cf6849281db223fbce3037d52e8f9627fa5 WatchSource:0}: Error finding container 117d6a4b805323596c4763cd60006cf6849281db223fbce3037d52e8f9627fa5: Status 404 returned error can't find the container with id 117d6a4b805323596c4763cd60006cf6849281db223fbce3037d52e8f9627fa5
Jul 14 07:50:14.347425 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.347392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:14.347605 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.347438    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:14.347605 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.347542    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 07:50:14.347605 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.347559    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665c7578c7-z8t55: secret "image-registry-tls" not found
Jul 14 07:50:14.347605 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.347559    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:14.347605 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.347608    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls podName:f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:15.347593874 +0000 UTC m=+38.089511720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls") pod "image-registry-665c7578c7-z8t55" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6") : secret "image-registry-tls" not found
Jul 14 07:50:14.347850 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.347622    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls podName:c00ad41c-67de-4cc6-951a-78f04f46bc7a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:15.347616485 +0000 UTC m=+38.089534330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wpgfz" (UID: "c00ad41c-67de-4cc6-951a-78f04f46bc7a") : secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:14.356118 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.356097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dbsxm"
Jul 14 07:50:14.448554 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.448488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:14.448554 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.448542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:14.448728 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.448585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:14.448728 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.448645    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 07:50:14.448728 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.448706    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:15.448690188 +0000 UTC m=+38.190608038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : secret "router-metrics-certs-default" not found
Jul 14 07:50:14.448728 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.448723    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:15.448714028 +0000 UTC m=+38.190631877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : configmap references non-existent config key: service-ca.crt
Jul 14 07:50:14.448728 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.448725    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 07:50:14.448909 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.448758    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls podName:de40039d-c78f-4b39-81f1-ab14ef33de8e nodeName:}" failed. No retries permitted until 2026-07-14 07:50:15.448748341 +0000 UTC m=+38.190666187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls") pod "cluster-samples-operator-65db858894-p8dg2" (UID: "de40039d-c78f-4b39-81f1-ab14ef33de8e") : secret "samples-operator-tls" not found
Jul 14 07:50:14.495295 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.495261    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dbsxm"]
Jul 14 07:50:14.498488 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:14.498464    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d72dd8_efdb_4c85_b6cc_ffd58a507662.slice/crio-7cc3555d5dd8e093812a15bd37a14edc5b98c0087d60aa25362d780653aea800 WatchSource:0}: Error finding container 7cc3555d5dd8e093812a15bd37a14edc5b98c0087d60aa25362d780653aea800: Status 404 returned error can't find the container with id 7cc3555d5dd8e093812a15bd37a14edc5b98c0087d60aa25362d780653aea800
Jul 14 07:50:14.650228 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.650191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:14.650418 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.650364    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 07:50:14.650493 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:14.650440    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls podName:54c6beae-ce14-49ed-b191-b072a7ab5c67 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:15.650420331 +0000 UTC m=+38.392338177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls") pod "dns-default-vgdqw" (UID: "54c6beae-ce14-49ed-b191-b072a7ab5c67") : secret "dns-default-metrics-tls" not found
Jul 14 07:50:14.694539 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.694509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:14.694676 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.694510    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:14.700166 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.700111    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjcpw\""
Jul 14 07:50:14.700278 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.700123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skvf2\""
Jul 14 07:50:14.700421 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.700408    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 07:50:14.953998 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.953911    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9" event={"ID":"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2","Type":"ContainerStarted","Data":"a772d816b269010b0f8fd7467d165dcb187475b68ba0f414a7bbcdadc6ef578b"}
Jul 14 07:50:14.964097 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.958084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nzn8l" event={"ID":"d65da55a-a502-464f-8c67-f626a5b8cb04","Type":"ContainerStarted","Data":"5a34a9d1ad3b110200f5fba7bcb6df1bcec1dc83e92094d1c51f31d41c05eae5"}
Jul 14 07:50:14.964097 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.962083    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5" event={"ID":"e94aceb8-eb1b-41aa-8626-6d9fe346c17c","Type":"ContainerStarted","Data":"31944708e665e222a9c6b570d6e8c027318d68ae07df40f236064b61c18ddfa6"}
Jul 14 07:50:14.966310 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.966281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-szw28" event={"ID":"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6","Type":"ContainerStarted","Data":"de797c05ad6b8944dc17eb1f2684a68648dd2b21f016f3a5e82151ff10f0b4aa"}
Jul 14 07:50:14.972274 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.972245    2562 generic.go:356] "Generic (PLEG): container finished" podID="047c7ea0-3c11-4754-a0dc-c08990ed4c09" containerID="8a41763c19925df354be68c4d651d778fd68db648052e3f2d9499b524534f7ff" exitCode=0
Jul 14 07:50:14.972401 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.972324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tntbw" event={"ID":"047c7ea0-3c11-4754-a0dc-c08990ed4c09","Type":"ContainerDied","Data":"8a41763c19925df354be68c4d651d778fd68db648052e3f2d9499b524534f7ff"}
Jul 14 07:50:14.974765 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.974739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dbsxm" event={"ID":"b8d72dd8-efdb-4c85-b6cc-ffd58a507662","Type":"ContainerStarted","Data":"7cc3555d5dd8e093812a15bd37a14edc5b98c0087d60aa25362d780653aea800"}
Jul 14 07:50:14.976387 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.976312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p" event={"ID":"090f2367-54a2-401a-8686-e99d1a738379","Type":"ContainerStarted","Data":"117d6a4b805323596c4763cd60006cf6849281db223fbce3037d52e8f9627fa5"}
Jul 14 07:50:14.978708 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:14.978683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq" event={"ID":"5b43906e-04b3-41e6-8cef-0c3e9c27d9ba","Type":"ContainerStarted","Data":"972ba498173ebdfd666d9d2474818cba96aa92ee43e86590298617960b44431f"}
Jul 14 07:50:15.356713 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:15.356672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:15.356938 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.356846    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:15.356938 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:15.356870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:15.356938 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.356926    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls podName:c00ad41c-67de-4cc6-951a-78f04f46bc7a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:17.356904209 +0000 UTC m=+40.098822070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wpgfz" (UID: "c00ad41c-67de-4cc6-951a-78f04f46bc7a") : secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:15.357134 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.357032    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 07:50:15.357134 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.357048    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665c7578c7-z8t55: secret "image-registry-tls" not found
Jul 14 07:50:15.357134 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.357102    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls podName:f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:17.357085151 +0000 UTC m=+40.099003030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls") pod "image-registry-665c7578c7-z8t55" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6") : secret "image-registry-tls" not found
Jul 14 07:50:15.457432 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:15.457373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:15.457612 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:15.457453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:15.457612 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:15.457499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:15.457725 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.457624    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 07:50:15.457725 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.457669    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 07:50:15.457725 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.457689    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls podName:de40039d-c78f-4b39-81f1-ab14ef33de8e nodeName:}" failed. No retries permitted until 2026-07-14 07:50:17.457667909 +0000 UTC m=+40.199585762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls") pod "cluster-samples-operator-65db858894-p8dg2" (UID: "de40039d-c78f-4b39-81f1-ab14ef33de8e") : secret "samples-operator-tls" not found
Jul 14 07:50:15.457879 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.457732    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:17.457713453 +0000 UTC m=+40.199631303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : secret "router-metrics-certs-default" not found
Jul 14 07:50:15.457879 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.457800    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:17.45778959 +0000 UTC m=+40.199707441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : configmap references non-existent config key: service-ca.crt
Jul 14 07:50:15.659409 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:15.658659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:15.659409 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.658943    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 07:50:15.659409 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:15.659018    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls podName:54c6beae-ce14-49ed-b191-b072a7ab5c67 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:17.658984205 +0000 UTC m=+40.400902054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls") pod "dns-default-vgdqw" (UID: "54c6beae-ce14-49ed-b191-b072a7ab5c67") : secret "dns-default-metrics-tls" not found
Jul 14 07:50:15.993920 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:15.993266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tntbw" event={"ID":"047c7ea0-3c11-4754-a0dc-c08990ed4c09","Type":"ContainerStarted","Data":"bbcdcd5170b544578704382803d236d347b21cd28a0cf03ff0662941f1ca784e"}
Jul 14 07:50:16.019172 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:16.018468    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tntbw" podStartSLOduration=8.592086916 podStartE2EDuration="38.018445531s" totalImagesPullingTime="29.426358615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:16.016792291 +0000 UTC m=+38.758710160" watchObservedRunningTime="2026-07-14 07:50:16.018445531 +0000 UTC m=+38.760363605"
Jul 14 07:50:16.180828 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:16.180603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:16.272611 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:16.272475    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:16.483272 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:16.483132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:16.585672 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:16.585518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:17.379671 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:17.379629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:17.380263 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:17.379683    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:17.380263 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.379825    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 07:50:17.380263 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.379850    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665c7578c7-z8t55: secret "image-registry-tls" not found
Jul 14 07:50:17.380263 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.379877    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:17.380263 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.379920    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls podName:f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:21.379898553 +0000 UTC m=+44.121816399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls") pod "image-registry-665c7578c7-z8t55" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6") : secret "image-registry-tls" not found
Jul 14 07:50:17.380263 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.379940    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls podName:c00ad41c-67de-4cc6-951a-78f04f46bc7a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:21.379928303 +0000 UTC m=+44.121846155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wpgfz" (UID: "c00ad41c-67de-4cc6-951a-78f04f46bc7a") : secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:17.480596 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:17.480554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:17.480766 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:17.480617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:17.480766 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:17.480699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:17.480766 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.480745    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:21.480720242 +0000 UTC m=+44.222638102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : configmap references non-existent config key: service-ca.crt
Jul 14 07:50:17.480955 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.480791    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 07:50:17.480955 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.480842    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls podName:de40039d-c78f-4b39-81f1-ab14ef33de8e nodeName:}" failed. No retries permitted until 2026-07-14 07:50:21.480826084 +0000 UTC m=+44.222743930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls") pod "cluster-samples-operator-65db858894-p8dg2" (UID: "de40039d-c78f-4b39-81f1-ab14ef33de8e") : secret "samples-operator-tls" not found
Jul 14 07:50:17.480955 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.480791    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 07:50:17.480955 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.480894    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:21.480883869 +0000 UTC m=+44.222801715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : secret "router-metrics-certs-default" not found
Jul 14 07:50:17.682353 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:17.682269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:17.682507 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.682448    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 07:50:17.682560 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:17.682517    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls podName:54c6beae-ce14-49ed-b191-b072a7ab5c67 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:21.682494214 +0000 UTC m=+44.424412063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls") pod "dns-default-vgdqw" (UID: "54c6beae-ce14-49ed-b191-b072a7ab5c67") : secret "dns-default-metrics-tls" not found
Jul 14 07:50:19.448060 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:19.448019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:19.509105 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:19.509073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:19.865310 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:19.865281    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"]
Jul 14 07:50:19.893298 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:19.893263    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"]
Jul 14 07:50:19.893463 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:19.893414    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:19.896201 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:19.896175    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j5tqg\""
Jul 14 07:50:19.896330 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:19.896201    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 14 07:50:19.896330 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:19.896202    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 14 07:50:19.996211 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:19.996174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:20.002804 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:20.002771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:20.002975 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:20.002945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e050bbe6-b0f6-4b14-b96c-15408e08fb00-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:20.074404 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:20.074366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:20.104070 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:20.104030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:20.104256 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:20.104215    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e050bbe6-b0f6-4b14-b96c-15408e08fb00-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:20.104323 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:20.104219    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 07:50:20.104377 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:20.104354    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert podName:e050bbe6-b0f6-4b14-b96c-15408e08fb00 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:20.604338214 +0000 UTC m=+43.346256063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fpvtl" (UID: "e050bbe6-b0f6-4b14-b96c-15408e08fb00") : secret "networking-console-plugin-cert" not found
Jul 14 07:50:20.105078 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:20.105052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e050bbe6-b0f6-4b14-b96c-15408e08fb00-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:20.137546 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:20.137454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:20.608136 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:20.608094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:20.608603 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:20.608279    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 07:50:20.608603 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:20.608366    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert podName:e050bbe6-b0f6-4b14-b96c-15408e08fb00 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:21.608347035 +0000 UTC m=+44.350264881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fpvtl" (UID: "e050bbe6-b0f6-4b14-b96c-15408e08fb00") : secret "networking-console-plugin-cert" not found
Jul 14 07:50:21.414350 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:21.414309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:21.414629 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:21.414361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:21.414629 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.414484    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:21.414629 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.414493    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 07:50:21.414629 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.414513    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665c7578c7-z8t55: secret "image-registry-tls" not found
Jul 14 07:50:21.414629 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.414560    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls podName:c00ad41c-67de-4cc6-951a-78f04f46bc7a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:29.414539075 +0000 UTC m=+52.156456927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wpgfz" (UID: "c00ad41c-67de-4cc6-951a-78f04f46bc7a") : secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:21.414629 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.414577    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls podName:f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:29.414569658 +0000 UTC m=+52.156487503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls") pod "image-registry-665c7578c7-z8t55" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6") : secret "image-registry-tls" not found
Jul 14 07:50:21.515401 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:21.515366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:21.515618 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.515511    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 07:50:21.515618 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:21.515557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:21.515618 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.515580    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:29.515565645 +0000 UTC m=+52.257483490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : secret "router-metrics-certs-default" not found
Jul 14 07:50:21.515781 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:21.515622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:21.515781 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.515645    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:29.515633302 +0000 UTC m=+52.257551148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : configmap references non-existent config key: service-ca.crt
Jul 14 07:50:21.515781 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.515676    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 07:50:21.515781 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.515704    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls podName:de40039d-c78f-4b39-81f1-ab14ef33de8e nodeName:}" failed. No retries permitted until 2026-07-14 07:50:29.515694713 +0000 UTC m=+52.257612558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls") pod "cluster-samples-operator-65db858894-p8dg2" (UID: "de40039d-c78f-4b39-81f1-ab14ef33de8e") : secret "samples-operator-tls" not found
Jul 14 07:50:21.617079 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:21.617054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:21.617445 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.617209    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 07:50:21.617445 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.617310    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert podName:e050bbe6-b0f6-4b14-b96c-15408e08fb00 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:23.617286678 +0000 UTC m=+46.359204541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fpvtl" (UID: "e050bbe6-b0f6-4b14-b96c-15408e08fb00") : secret "networking-console-plugin-cert" not found
Jul 14 07:50:21.717940 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:21.717913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:21.718084 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.718068    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 07:50:21.718142 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:21.718132    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls podName:54c6beae-ce14-49ed-b191-b072a7ab5c67 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:29.718116277 +0000 UTC m=+52.460034122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls") pod "dns-default-vgdqw" (UID: "54c6beae-ce14-49ed-b191-b072a7ab5c67") : secret "dns-default-metrics-tls" not found
Jul 14 07:50:22.013777 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.012912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p" event={"ID":"090f2367-54a2-401a-8686-e99d1a738379","Type":"ContainerStarted","Data":"d7607400d9a48f49c20414f669141ee652a47daaace3ccad3990c013faa684b5"}
Jul 14 07:50:22.016088 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.015617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq" event={"ID":"5b43906e-04b3-41e6-8cef-0c3e9c27d9ba","Type":"ContainerStarted","Data":"470ef28a95dfc06370d0a985a9d48f77016a8f07c602831516c107d4d430cec8"}
Jul 14 07:50:22.018444 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.018170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9" event={"ID":"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2","Type":"ContainerStarted","Data":"aea07b27cfb8d2b3b9c0e455ba07a1f1e9318c189df7c5b59b66327bdd01af21"}
Jul 14 07:50:22.025263 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.025196    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/0.log"
Jul 14 07:50:22.025488 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.025421    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nzn8l" event={"ID":"d65da55a-a502-464f-8c67-f626a5b8cb04","Type":"ContainerDied","Data":"9d5399d086d46a8c1182c6512139c526b941f3b173b8a18f6dc6db4b29de7b36"}
Jul 14 07:50:22.025569 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.025534    2562 scope.go:117] "RemoveContainer" containerID="9d5399d086d46a8c1182c6512139c526b941f3b173b8a18f6dc6db4b29de7b36"
Jul 14 07:50:22.025712 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.025240    2562 generic.go:356] "Generic (PLEG): container finished" podID="d65da55a-a502-464f-8c67-f626a5b8cb04" containerID="9d5399d086d46a8c1182c6512139c526b941f3b173b8a18f6dc6db4b29de7b36" exitCode=255
Jul 14 07:50:22.028212 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.028061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5" event={"ID":"e94aceb8-eb1b-41aa-8626-6d9fe346c17c","Type":"ContainerStarted","Data":"2560bfc5c767e60b03afdc2841f198cb6a39ca11d080205cadabfc01df2010af"}
Jul 14 07:50:22.030179 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.030124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-szw28" event={"ID":"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6","Type":"ContainerStarted","Data":"dce2e62cb4bf75bafcacc0eed55de0df1cd87cd8f34f7c47bb1da6a4eb36ebcc"}
Jul 14 07:50:22.032320 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.032183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dbsxm" event={"ID":"b8d72dd8-efdb-4c85-b6cc-ffd58a507662","Type":"ContainerStarted","Data":"3b0e8c06faf485ef7c5ce447ae94c5118c305baec2c082aaa1e3edc28d6b9014"}
Jul 14 07:50:22.033496 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.033454    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p" podStartSLOduration=18.665349556 podStartE2EDuration="26.033437213s" totalImagesPullingTime="7.368087657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:22.031607271 +0000 UTC m=+44.773525132" watchObservedRunningTime="2026-07-14 07:50:22.033437213 +0000 UTC m=+44.775355080"
Jul 14 07:50:22.083276 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.081767    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-szw28" podStartSLOduration=26.709769466 podStartE2EDuration="34.081742343s" totalImagesPullingTime="7.371972877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:22.054440824 +0000 UTC m=+44.796358693" watchObservedRunningTime="2026-07-14 07:50:22.081742343 +0000 UTC m=+44.823660213"
Jul 14 07:50:22.112026 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.106766    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9" podStartSLOduration=21.737029542 podStartE2EDuration="29.106743172s" totalImagesPullingTime="7.36971363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:22.083124431 +0000 UTC m=+44.825042295" watchObservedRunningTime="2026-07-14 07:50:22.106743172 +0000 UTC m=+44.848661057"
Jul 14 07:50:22.135658 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.135600    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6pzq" podStartSLOduration=26.82327574 podStartE2EDuration="34.13557899s" totalImagesPullingTime="7.31230325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:22.134901448 +0000 UTC m=+44.876819319" watchObservedRunningTime="2026-07-14 07:50:22.13557899 +0000 UTC m=+44.877496854"
Jul 14 07:50:22.135821 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.135777    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hd9p5" podStartSLOduration=20.765573689 podStartE2EDuration="28.135767425s" totalImagesPullingTime="7.370193736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:22.120197048 +0000 UTC m=+44.862114919" watchObservedRunningTime="2026-07-14 07:50:22.135767425 +0000 UTC m=+44.877685294"
Jul 14 07:50:22.155210 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.155144    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dbsxm" podStartSLOduration=1.987237618 podStartE2EDuration="9.155121745s" totalImagesPullingTime="7.167884127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:22.152988226 +0000 UTC m=+44.894906095" watchObservedRunningTime="2026-07-14 07:50:22.155121745 +0000 UTC m=+44.897039614"
Jul 14 07:50:22.212964 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.212935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:22.313647 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.313612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:22.753584 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:22.753549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:23.037577 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.037547    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 07:50:23.038065 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.038048    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/0.log"
Jul 14 07:50:23.038144 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.038089    2562 generic.go:356] "Generic (PLEG): container finished" podID="d65da55a-a502-464f-8c67-f626a5b8cb04" containerID="06e5199b5075b3ad125f6276132d47065a50bd0520815c73f223f5662e157c2b" exitCode=255
Jul 14 07:50:23.038218 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.038192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nzn8l" event={"ID":"d65da55a-a502-464f-8c67-f626a5b8cb04","Type":"ContainerDied","Data":"06e5199b5075b3ad125f6276132d47065a50bd0520815c73f223f5662e157c2b"}
Jul 14 07:50:23.038302 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.038288    2562 scope.go:117] "RemoveContainer" containerID="9d5399d086d46a8c1182c6512139c526b941f3b173b8a18f6dc6db4b29de7b36"
Jul 14 07:50:23.039383 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.039364    2562 scope.go:117] "RemoveContainer" containerID="06e5199b5075b3ad125f6276132d47065a50bd0520815c73f223f5662e157c2b"
Jul 14 07:50:23.040056 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:23.039647    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-nzn8l_openshift-console-operator(d65da55a-a502-464f-8c67-f626a5b8cb04)\"" pod="openshift-console-operator/console-operator-7866497494-nzn8l" podUID="d65da55a-a502-464f-8c67-f626a5b8cb04"
Jul 14 07:50:23.189036 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.188991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:23.433065 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.432961    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cjvtp"]
Jul 14 07:50:23.457726 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.457694    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjvtp"]
Jul 14 07:50:23.457904 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.457833    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.460389 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.460369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 07:50:23.460389 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.460389    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zq59h\""
Jul 14 07:50:23.460587 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.460473    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 07:50:23.482101 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.482073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:23.540833 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.540798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.540973 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.540879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e14ecd3-766a-45a3-9615-e881f7dac04f-data-volume\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.540973 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.540928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.541073 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.541039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-528zk\" (UniqueName: \"kubernetes.io/projected/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-api-access-528zk\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.541119 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.541092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e14ecd3-766a-45a3-9615-e881f7dac04f-crio-socket\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.548451 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.548416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.642247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e14ecd3-766a-45a3-9615-e881f7dac04f-crio-socket\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.642327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.642401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e14ecd3-766a-45a3-9615-e881f7dac04f-data-volume\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.642476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.642541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.642579    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-528zk\" (UniqueName: \"kubernetes.io/projected/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-api-access-528zk\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.642590    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e14ecd3-766a-45a3-9615-e881f7dac04f-crio-socket\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:23.642594    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:23.642636    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:23.642695    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls podName:2e14ecd3-766a-45a3-9615-e881f7dac04f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:24.14267137 +0000 UTC m=+46.884589237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjvtp" (UID: "2e14ecd3-766a-45a3-9615-e881f7dac04f") : secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:23.642715    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm podName:2e14ecd3-766a-45a3-9615-e881f7dac04f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:24.142704873 +0000 UTC m=+46.884622724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjvtp" (UID: "2e14ecd3-766a-45a3-9615-e881f7dac04f") : configmap "kube-rbac-proxy" not found
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:23.642729    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:23.642772    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert podName:e050bbe6-b0f6-4b14-b96c-15408e08fb00 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:27.642753841 +0000 UTC m=+50.384671700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fpvtl" (UID: "e050bbe6-b0f6-4b14-b96c-15408e08fb00") : secret "networking-console-plugin-cert" not found
Jul 14 07:50:23.642933 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.642843    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e14ecd3-766a-45a3-9615-e881f7dac04f-data-volume\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.654859 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.654822    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-528zk\" (UniqueName: \"kubernetes.io/projected/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-api-access-528zk\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:23.824323 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.824286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:23.833489 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.833460    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5"]
Jul 14 07:50:23.855468 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.855442    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5"]
Jul 14 07:50:23.855631 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.855562    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5"
Jul 14 07:50:23.858166 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.858140    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 14 07:50:23.858306 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.858150    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-49xx4\""
Jul 14 07:50:23.858306 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.858175    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 14 07:50:23.888208 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.888175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:23.940672 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.940636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:23.944799 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.944779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qls\" (UniqueName: \"kubernetes.io/projected/7335ac85-9560-499e-b6fa-7421068724bc-kube-api-access-42qls\") pod \"migrator-7f59b54f6c-prtg5\" (UID: \"7335ac85-9560-499e-b6fa-7421068724bc\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5"
Jul 14 07:50:23.978967 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.978929    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:23.979129 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:23.978996    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:24.045513 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:24.045475    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42qls\" (UniqueName: \"kubernetes.io/projected/7335ac85-9560-499e-b6fa-7421068724bc-kube-api-access-42qls\") pod \"migrator-7f59b54f6c-prtg5\" (UID: \"7335ac85-9560-499e-b6fa-7421068724bc\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5"
Jul 14 07:50:24.046607 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:24.046586    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 07:50:24.046897 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:24.046883    2562 scope.go:117] "RemoveContainer" containerID="06e5199b5075b3ad125f6276132d47065a50bd0520815c73f223f5662e157c2b"
Jul 14 07:50:24.047049 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:24.047030    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-nzn8l_openshift-console-operator(d65da55a-a502-464f-8c67-f626a5b8cb04)\"" pod="openshift-console-operator/console-operator-7866497494-nzn8l" podUID="d65da55a-a502-464f-8c67-f626a5b8cb04"
Jul 14 07:50:24.054782 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:24.054756    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qls\" (UniqueName: \"kubernetes.io/projected/7335ac85-9560-499e-b6fa-7421068724bc-kube-api-access-42qls\") pod \"migrator-7f59b54f6c-prtg5\" (UID: \"7335ac85-9560-499e-b6fa-7421068724bc\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5"
Jul 14 07:50:24.146304 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:24.146214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:24.146494 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:24.146320    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:24.146494 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:24.146383    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls podName:2e14ecd3-766a-45a3-9615-e881f7dac04f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:25.146364996 +0000 UTC m=+47.888282849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjvtp" (UID: "2e14ecd3-766a-45a3-9615-e881f7dac04f") : secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:24.146494 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:24.146473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:24.146657 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:24.146516    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 07:50:24.146657 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:24.146570    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm podName:2e14ecd3-766a-45a3-9615-e881f7dac04f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:25.146552946 +0000 UTC m=+47.888470805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjvtp" (UID: "2e14ecd3-766a-45a3-9615-e881f7dac04f") : configmap "kube-rbac-proxy" not found
Jul 14 07:50:24.166051 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:24.166023    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5"
Jul 14 07:50:24.307055 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:24.307025    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5"]
Jul 14 07:50:24.309969 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:24.309943    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7335ac85_9560_499e_b6fa_7421068724bc.slice/crio-8e716730a04a9043e72a03e75f596e9d6b6963a31aa26bcdd3cbd84111708f64 WatchSource:0}: Error finding container 8e716730a04a9043e72a03e75f596e9d6b6963a31aa26bcdd3cbd84111708f64: Status 404 returned error can't find the container with id 8e716730a04a9043e72a03e75f596e9d6b6963a31aa26bcdd3cbd84111708f64
Jul 14 07:50:24.627375 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:24.627350    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lclhv_afbbaeeb-642f-40e8-97b9-c40c37606c1c/dns-node-resolver/0.log"
Jul 14 07:50:25.051276 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.051235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5" event={"ID":"7335ac85-9560-499e-b6fa-7421068724bc","Type":"ContainerStarted","Data":"8e716730a04a9043e72a03e75f596e9d6b6963a31aa26bcdd3cbd84111708f64"}
Jul 14 07:50:25.051691 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.051621    2562 scope.go:117] "RemoveContainer" containerID="06e5199b5075b3ad125f6276132d47065a50bd0520815c73f223f5662e157c2b"
Jul 14 07:50:25.051788 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:25.051771    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-nzn8l_openshift-console-operator(d65da55a-a502-464f-8c67-f626a5b8cb04)\"" pod="openshift-console-operator/console-operator-7866497494-nzn8l" podUID="d65da55a-a502-464f-8c67-f626a5b8cb04"
Jul 14 07:50:25.058402 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.058379    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-jlq9p"]
Jul 14 07:50:25.089442 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.089411    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-jlq9p"]
Jul 14 07:50:25.089602 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.089525    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.092481 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.092453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 14 07:50:25.093707 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.093688    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 14 07:50:25.093825 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.093729    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-crmq6\""
Jul 14 07:50:25.093825 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.093691    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 14 07:50:25.093825 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.093775    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 14 07:50:25.095869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.095818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:25.152843 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.152805    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:25.156930 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.156911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:25.157042 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.156958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/59515ef1-e10f-49d1-b057-3efa62174779-signing-key\") pod \"service-ca-79f68b9f4f-jlq9p\" (UID: \"59515ef1-e10f-49d1-b057-3efa62174779\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.157042 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.157030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/59515ef1-e10f-49d1-b057-3efa62174779-signing-cabundle\") pod \"service-ca-79f68b9f4f-jlq9p\" (UID: \"59515ef1-e10f-49d1-b057-3efa62174779\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.157143 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:25.157045    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 07:50:25.157143 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:25.157105    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm podName:2e14ecd3-766a-45a3-9615-e881f7dac04f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:27.157085054 +0000 UTC m=+49.899002900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjvtp" (UID: "2e14ecd3-766a-45a3-9615-e881f7dac04f") : configmap "kube-rbac-proxy" not found
Jul 14 07:50:25.157143 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.157128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjfq\" (UniqueName: \"kubernetes.io/projected/59515ef1-e10f-49d1-b057-3efa62174779-kube-api-access-xfjfq\") pod \"service-ca-79f68b9f4f-jlq9p\" (UID: \"59515ef1-e10f-49d1-b057-3efa62174779\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.157298 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.157225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:25.157357 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:25.157342    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:25.157399 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:25.157390    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls podName:2e14ecd3-766a-45a3-9615-e881f7dac04f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:27.157376207 +0000 UTC m=+49.899294055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjvtp" (UID: "2e14ecd3-766a-45a3-9615-e881f7dac04f") : secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:25.258788 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.258754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/59515ef1-e10f-49d1-b057-3efa62174779-signing-key\") pod \"service-ca-79f68b9f4f-jlq9p\" (UID: \"59515ef1-e10f-49d1-b057-3efa62174779\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.258986 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.258907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/59515ef1-e10f-49d1-b057-3efa62174779-signing-cabundle\") pod \"service-ca-79f68b9f4f-jlq9p\" (UID: \"59515ef1-e10f-49d1-b057-3efa62174779\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.258986 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.258964    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjfq\" (UniqueName: \"kubernetes.io/projected/59515ef1-e10f-49d1-b057-3efa62174779-kube-api-access-xfjfq\") pod \"service-ca-79f68b9f4f-jlq9p\" (UID: \"59515ef1-e10f-49d1-b057-3efa62174779\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.259793 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.259755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/59515ef1-e10f-49d1-b057-3efa62174779-signing-cabundle\") pod \"service-ca-79f68b9f4f-jlq9p\" (UID: \"59515ef1-e10f-49d1-b057-3efa62174779\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.261630 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.261603    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/59515ef1-e10f-49d1-b057-3efa62174779-signing-key\") pod \"service-ca-79f68b9f4f-jlq9p\" (UID: \"59515ef1-e10f-49d1-b057-3efa62174779\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.267937 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.267912    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjfq\" (UniqueName: \"kubernetes.io/projected/59515ef1-e10f-49d1-b057-3efa62174779-kube-api-access-xfjfq\") pod \"service-ca-79f68b9f4f-jlq9p\" (UID: \"59515ef1-e10f-49d1-b057-3efa62174779\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.398411 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.398342    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p"
Jul 14 07:50:25.603111 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.603085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-jlq9p"]
Jul 14 07:50:25.605459 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:25.605430    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59515ef1_e10f_49d1_b057_3efa62174779.slice/crio-7b1ae1383a2604d5a0fe5624669c7167ca83afded5267434492f5130039fe707 WatchSource:0}: Error finding container 7b1ae1383a2604d5a0fe5624669c7167ca83afded5267434492f5130039fe707: Status 404 returned error can't find the container with id 7b1ae1383a2604d5a0fe5624669c7167ca83afded5267434492f5130039fe707
Jul 14 07:50:25.827243 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:25.827218    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z622s_6467f114-153b-4368-8289-7acf7e0f3efc/node-ca/0.log"
Jul 14 07:50:26.056515 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:26.056484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5" event={"ID":"7335ac85-9560-499e-b6fa-7421068724bc","Type":"ContainerStarted","Data":"910cedd889902e5278d980a9ca0d9529c3a98c0e6859f172fa3e9afe0e973d3b"}
Jul 14 07:50:26.058119 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:26.058090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p" event={"ID":"59515ef1-e10f-49d1-b057-3efa62174779","Type":"ContainerStarted","Data":"8758321c96a857a4e7ae12e50c248526c97cbed5e100fb32657429893d71180c"}
Jul 14 07:50:26.058239 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:26.058129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p" event={"ID":"59515ef1-e10f-49d1-b057-3efa62174779","Type":"ContainerStarted","Data":"7b1ae1383a2604d5a0fe5624669c7167ca83afded5267434492f5130039fe707"}
Jul 14 07:50:26.063094 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:26.063063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:26.077020 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:26.076962    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-jlq9p" podStartSLOduration=1.076945226 podStartE2EDuration="1.076945226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:26.075511891 +0000 UTC m=+48.817429760" watchObservedRunningTime="2026-07-14 07:50:26.076945226 +0000 UTC m=+48.818863094"
Jul 14 07:50:26.228999 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:26.228967    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dbsxm_b8d72dd8-efdb-4c85-b6cc-ffd58a507662/serve-healthcheck-canary/0.log"
Jul 14 07:50:26.615079 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:26.614859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:26.716515 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:26.716479    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:26.951527 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:26.951429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:27.060165 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:27.060130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:27.063680 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:27.063651    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5" event={"ID":"7335ac85-9560-499e-b6fa-7421068724bc","Type":"ContainerStarted","Data":"3033548294d0848ad4477d50019018e5e428fcb78210e269d271cff58b6f7dad"}
Jul 14 07:50:27.081590 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:27.081540    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-prtg5" podStartSLOduration=2.50494687 podStartE2EDuration="4.081525969s" totalImagesPullingTime="1.576579099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:27.080578982 +0000 UTC m=+49.822496850" watchObservedRunningTime="2026-07-14 07:50:27.081525969 +0000 UTC m=+49.823443837"
Jul 14 07:50:27.151083 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:27.151052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:27.178423 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:27.178385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:27.178601 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:27.178524    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:27.178601 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:27.178532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:27.178715 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:27.178605    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls podName:2e14ecd3-766a-45a3-9615-e881f7dac04f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:31.178583527 +0000 UTC m=+53.920501376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjvtp" (UID: "2e14ecd3-766a-45a3-9615-e881f7dac04f") : secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:27.178715 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:27.178638    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 07:50:27.178715 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:27.178696    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm podName:2e14ecd3-766a-45a3-9615-e881f7dac04f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:31.178679845 +0000 UTC m=+53.920597696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjvtp" (UID: "2e14ecd3-766a-45a3-9615-e881f7dac04f") : configmap "kube-rbac-proxy" not found
Jul 14 07:50:27.513246 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:27.513212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:27.682482 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:27.682448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:27.682654 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:27.682574    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 07:50:27.682654 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:27.682626    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert podName:e050bbe6-b0f6-4b14-b96c-15408e08fb00 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:35.682612511 +0000 UTC m=+58.424530356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fpvtl" (UID: "e050bbe6-b0f6-4b14-b96c-15408e08fb00") : secret "networking-console-plugin-cert" not found
Jul 14 07:50:28.114488 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:28.114453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:29.499221 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.499189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:29.499707 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.499238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:29.499707 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:29.499365    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 07:50:29.499707 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:29.499389    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665c7578c7-z8t55: secret "image-registry-tls" not found
Jul 14 07:50:29.499707 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:29.499426    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:29.499707 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:29.499456    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls podName:f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:45.499436015 +0000 UTC m=+68.241353879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls") pod "image-registry-665c7578c7-z8t55" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6") : secret "image-registry-tls" not found
Jul 14 07:50:29.499707 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:29.499479    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls podName:c00ad41c-67de-4cc6-951a-78f04f46bc7a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:45.499465818 +0000 UTC m=+68.241383667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wpgfz" (UID: "c00ad41c-67de-4cc6-951a-78f04f46bc7a") : secret "cluster-monitoring-operator-tls" not found
Jul 14 07:50:29.600735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.600697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:29.600930 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.600845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:29.600930 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.600913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:29.601082 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:29.600989    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 07:50:29.601082 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:29.601078    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:45.601061337 +0000 UTC m=+68.342979187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : secret "router-metrics-certs-default" not found
Jul 14 07:50:29.601174 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:29.601093    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle podName:ee5e97bf-4810-415c-881a-0ab22e7d22b3 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:45.601086538 +0000 UTC m=+68.343004384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle") pod "router-default-c79d46876-mj7tx" (UID: "ee5e97bf-4810-415c-881a-0ab22e7d22b3") : configmap references non-existent config key: service-ca.crt
Jul 14 07:50:29.603081 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.603052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de40039d-c78f-4b39-81f1-ab14ef33de8e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p8dg2\" (UID: \"de40039d-c78f-4b39-81f1-ab14ef33de8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:29.802746 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.802655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:29.805132 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.805111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54c6beae-ce14-49ed-b191-b072a7ab5c67-metrics-tls\") pod \"dns-default-vgdqw\" (UID: \"54c6beae-ce14-49ed-b191-b072a7ab5c67\") " pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:29.858506 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.858468    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"
Jul 14 07:50:29.972652 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:29.972458    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:30.006687 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:30.006660    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2"]
Jul 14 07:50:30.077550 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:30.077512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2" event={"ID":"de40039d-c78f-4b39-81f1-ab14ef33de8e","Type":"ContainerStarted","Data":"97de128ccb65f30e03ce72077cef78fe647da66dc6afc34dffebdc2d2f6aa087"}
Jul 14 07:50:30.119735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:30.119712    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgdqw"]
Jul 14 07:50:30.122194 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:30.122167    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c6beae_ce14_49ed_b191_b072a7ab5c67.slice/crio-d1956d9be04cf513f34c97cb9d2e2455f697c17f470a73df001b80e040cd40a2 WatchSource:0}: Error finding container d1956d9be04cf513f34c97cb9d2e2455f697c17f470a73df001b80e040cd40a2: Status 404 returned error can't find the container with id d1956d9be04cf513f34c97cb9d2e2455f697c17f470a73df001b80e040cd40a2
Jul 14 07:50:31.082107 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:31.082071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgdqw" event={"ID":"54c6beae-ce14-49ed-b191-b072a7ab5c67","Type":"ContainerStarted","Data":"d1956d9be04cf513f34c97cb9d2e2455f697c17f470a73df001b80e040cd40a2"}
Jul 14 07:50:31.215381 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:31.215337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:31.215553 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:31.215481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:31.215669 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:31.215650    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:31.215747 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:50:31.215730    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls podName:2e14ecd3-766a-45a3-9615-e881f7dac04f nodeName:}" failed. No retries permitted until 2026-07-14 07:50:39.215712517 +0000 UTC m=+61.957630385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjvtp" (UID: "2e14ecd3-766a-45a3-9615-e881f7dac04f") : secret "insights-runtime-extractor-tls" not found
Jul 14 07:50:31.215956 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:31.215934    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e14ecd3-766a-45a3-9615-e881f7dac04f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:32.087956 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:32.087917    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2" event={"ID":"de40039d-c78f-4b39-81f1-ab14ef33de8e","Type":"ContainerStarted","Data":"8b5b6d4fa9b5c1e0dff09a235327a1e9a47799ded9a369b8fedc0360234bec93"}
Jul 14 07:50:33.093077 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:33.093036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2" event={"ID":"de40039d-c78f-4b39-81f1-ab14ef33de8e","Type":"ContainerStarted","Data":"e4ee8167991c4f7c53ccbd3cec7bef5c51e090f8c2f293a02c5b19c185f24225"}
Jul 14 07:50:33.094967 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:33.094941    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgdqw" event={"ID":"54c6beae-ce14-49ed-b191-b072a7ab5c67","Type":"ContainerStarted","Data":"fa06d96776a83345019412556f0d6b8fb2209ea6f523dde6f386153e872d3ce1"}
Jul 14 07:50:33.095098 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:33.094985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgdqw" event={"ID":"54c6beae-ce14-49ed-b191-b072a7ab5c67","Type":"ContainerStarted","Data":"eaaaaebf0b90c0bca3ae2294a47f50b0e2b91383be53f6a66938f2dccf192220"}
Jul 14 07:50:33.095098 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:33.095053    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:33.111770 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:33.111723    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p8dg2" podStartSLOduration=43.305126692 podStartE2EDuration="45.111709542s" totalImagesPullingTime="1.80658285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:33.110439658 +0000 UTC m=+55.852357526" watchObservedRunningTime="2026-07-14 07:50:33.111709542 +0000 UTC m=+55.853627410"
Jul 14 07:50:33.131991 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:33.131942    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vgdqw" podStartSLOduration=17.829341923 podStartE2EDuration="20.131924722s" totalImagesPullingTime="2.302582799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:33.131353842 +0000 UTC m=+55.873271710" watchObservedRunningTime="2026-07-14 07:50:33.131924722 +0000 UTC m=+55.873842583"
Jul 14 07:50:35.761839 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:35.761796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:35.764328 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:35.764301    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e050bbe6-b0f6-4b14-b96c-15408e08fb00-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fpvtl\" (UID: \"e050bbe6-b0f6-4b14-b96c-15408e08fb00\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:35.804475 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:35.804433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"
Jul 14 07:50:35.953270 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:35.953171    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fpvtl"]
Jul 14 07:50:35.957735 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:35.957697    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode050bbe6_b0f6_4b14_b96c_15408e08fb00.slice/crio-cf8dcafed29a5d119bae90a77d0aeb245b681b3e13d90e77d9e3b1dd39bf8dce WatchSource:0}: Error finding container cf8dcafed29a5d119bae90a77d0aeb245b681b3e13d90e77d9e3b1dd39bf8dce: Status 404 returned error can't find the container with id cf8dcafed29a5d119bae90a77d0aeb245b681b3e13d90e77d9e3b1dd39bf8dce
Jul 14 07:50:36.106784 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:36.106689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl" event={"ID":"e050bbe6-b0f6-4b14-b96c-15408e08fb00","Type":"ContainerStarted","Data":"cf8dcafed29a5d119bae90a77d0aeb245b681b3e13d90e77d9e3b1dd39bf8dce"}
Jul 14 07:50:37.111829 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:37.111792    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl" event={"ID":"e050bbe6-b0f6-4b14-b96c-15408e08fb00","Type":"ContainerStarted","Data":"df101ceea314dd1729301f94cb4439fd4356ea71e03751f96683402a69ac379b"}
Jul 14 07:50:37.127937 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:37.127890    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-fpvtl" podStartSLOduration=17.045884584 podStartE2EDuration="18.127873707s" totalImagesPullingTime="1.081989123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:37.127083679 +0000 UTC m=+59.869001548" watchObservedRunningTime="2026-07-14 07:50:37.127873707 +0000 UTC m=+59.869791574"
Jul 14 07:50:37.696786 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:37.696751    2562 scope.go:117] "RemoveContainer" containerID="06e5199b5075b3ad125f6276132d47065a50bd0520815c73f223f5662e157c2b"
Jul 14 07:50:38.116946 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:38.116915    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 07:50:38.117323 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:38.116987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nzn8l" event={"ID":"d65da55a-a502-464f-8c67-f626a5b8cb04","Type":"ContainerStarted","Data":"6cf2a70681efb98134b10daaed5728ad9765e8484f009a1643ec07827db3ca41"}
Jul 14 07:50:38.117494 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:38.117478    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:38.134468 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:38.134418    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-nzn8l" podStartSLOduration=41.764111083 podStartE2EDuration="49.134403971s" totalImagesPullingTime="7.370292888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:38.13401651 +0000 UTC m=+60.875934374" watchObservedRunningTime="2026-07-14 07:50:38.134403971 +0000 UTC m=+60.876321854"
Jul 14 07:50:38.578604 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:38.578575    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-nzn8l"
Jul 14 07:50:39.295435 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:39.295389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:39.297644 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:39.297616    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e14ecd3-766a-45a3-9615-e881f7dac04f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjvtp\" (UID: \"2e14ecd3-766a-45a3-9615-e881f7dac04f\") " pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:39.370573 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:39.370543    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zq59h\""
Jul 14 07:50:39.377754 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:39.377733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjvtp"
Jul 14 07:50:39.504758 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:39.504728    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjvtp"]
Jul 14 07:50:39.507555 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:39.507529    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e14ecd3_766a_45a3_9615_e881f7dac04f.slice/crio-a9a383df5c4ca3dbeb6f0479f1d9b31d367a6d9256fbb50f4c5aab76d21a238d WatchSource:0}: Error finding container a9a383df5c4ca3dbeb6f0479f1d9b31d367a6d9256fbb50f4c5aab76d21a238d: Status 404 returned error can't find the container with id a9a383df5c4ca3dbeb6f0479f1d9b31d367a6d9256fbb50f4c5aab76d21a238d
Jul 14 07:50:39.945427 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:39.945397    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnv2c"
Jul 14 07:50:40.127760 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:40.127676    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjvtp" event={"ID":"2e14ecd3-766a-45a3-9615-e881f7dac04f","Type":"ContainerStarted","Data":"a9a383df5c4ca3dbeb6f0479f1d9b31d367a6d9256fbb50f4c5aab76d21a238d"}
Jul 14 07:50:43.100930 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:43.100894    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vgdqw"
Jul 14 07:50:44.143809 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.143721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjvtp" event={"ID":"2e14ecd3-766a-45a3-9615-e881f7dac04f","Type":"ContainerStarted","Data":"dd1a5d0562dc7c0fc39aaa841b39169804160c638391712daed9e3310e16d988"}
Jul 14 07:50:44.143809 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.143782    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjvtp" event={"ID":"2e14ecd3-766a-45a3-9615-e881f7dac04f","Type":"ContainerStarted","Data":"9a754a10984484493c36e5b1ed8a19a8e824cc59902ae155b206f71e22b605aa"}
Jul 14 07:50:44.862922 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.862886    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"]
Jul 14 07:50:44.890888 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.890172    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:44.890888 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.890482    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"]
Jul 14 07:50:44.894280 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.894256    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 07:50:44.894657 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.894498    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 07:50:44.895546 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.895502    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 14 07:50:44.895546 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.895511    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 07:50:44.905743 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.905715    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"]
Jul 14 07:50:44.905876 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.905857    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"
Jul 14 07:50:44.908389 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.908366    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2pgsc\""
Jul 14 07:50:44.908926 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.908903    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 14 07:50:44.925809 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.925780    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"]
Jul 14 07:50:44.925955 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.925831    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"]
Jul 14 07:50:44.925955 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.925851    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"]
Jul 14 07:50:44.925955 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.925934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:44.929453 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.929427    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 14 07:50:44.929573 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.929523    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 14 07:50:44.929880 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.929861    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 14 07:50:44.930074 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.929895    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 14 07:50:44.972305 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.972272    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-d6c7m"]
Jul 14 07:50:44.997996 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.997955    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-d6c7m"]
Jul 14 07:50:44.998180 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:44.998098    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-d6c7m"
Jul 14 07:50:45.001340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.001315    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-s77lc\""
Jul 14 07:50:45.001485 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.001466    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 07:50:45.001568 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.001553    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 07:50:45.051704 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.051669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.051901 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.051717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/496ae8ae-ad76-4e04-8873-683877edd8e8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.051901 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.051789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8eb7112-469c-495b-84c8-29dd530abd45-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65b59bbd44-2vhpn\" (UID: \"d8eb7112-469c-495b-84c8-29dd530abd45\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"
Jul 14 07:50:45.051901 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.051825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcd4\" (UniqueName: \"kubernetes.io/projected/c2a21cdf-71af-43fd-bb3b-5d044b032ba8-kube-api-access-jpcd4\") pod \"klusterlet-addon-workmgr-76d5c9f97f-dhb2b\" (UID: \"c2a21cdf-71af-43fd-bb3b-5d044b032ba8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.051901 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.051856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2a21cdf-71af-43fd-bb3b-5d044b032ba8-klusterlet-config\") pod \"klusterlet-addon-workmgr-76d5c9f97f-dhb2b\" (UID: \"c2a21cdf-71af-43fd-bb3b-5d044b032ba8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.051901 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.051879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-ca\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.052153 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.051931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msl75\" (UniqueName: \"kubernetes.io/projected/496ae8ae-ad76-4e04-8873-683877edd8e8-kube-api-access-msl75\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.052153 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.052018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.052153 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.052123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-hub\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.052279 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.052149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9zgh\" (UniqueName: \"kubernetes.io/projected/d8eb7112-469c-495b-84c8-29dd530abd45-kube-api-access-s9zgh\") pod \"managed-serviceaccount-addon-agent-65b59bbd44-2vhpn\" (UID: \"d8eb7112-469c-495b-84c8-29dd530abd45\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"
Jul 14 07:50:45.052279 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.052191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a21cdf-71af-43fd-bb3b-5d044b032ba8-tmp\") pod \"klusterlet-addon-workmgr-76d5c9f97f-dhb2b\" (UID: \"c2a21cdf-71af-43fd-bb3b-5d044b032ba8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.153303 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.153214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2a21cdf-71af-43fd-bb3b-5d044b032ba8-klusterlet-config\") pod \"klusterlet-addon-workmgr-76d5c9f97f-dhb2b\" (UID: \"c2a21cdf-71af-43fd-bb3b-5d044b032ba8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.153842 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.153817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-ca\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.153935 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.153889    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msl75\" (UniqueName: \"kubernetes.io/projected/496ae8ae-ad76-4e04-8873-683877edd8e8-kube-api-access-msl75\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.153935 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.153925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mwtf\" (UniqueName: \"kubernetes.io/projected/25ddcf6d-2002-40b8-b101-fd5eb3225a69-kube-api-access-6mwtf\") pod \"downloads-68c9cbb497-d6c7m\" (UID: \"25ddcf6d-2002-40b8-b101-fd5eb3225a69\") " pod="openshift-console/downloads-68c9cbb497-d6c7m"
Jul 14 07:50:45.154083 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.153959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.154083 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.154048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-hub\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.154083 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.154065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9zgh\" (UniqueName: \"kubernetes.io/projected/d8eb7112-469c-495b-84c8-29dd530abd45-kube-api-access-s9zgh\") pod \"managed-serviceaccount-addon-agent-65b59bbd44-2vhpn\" (UID: \"d8eb7112-469c-495b-84c8-29dd530abd45\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"
Jul 14 07:50:45.154229 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.154090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a21cdf-71af-43fd-bb3b-5d044b032ba8-tmp\") pod \"klusterlet-addon-workmgr-76d5c9f97f-dhb2b\" (UID: \"c2a21cdf-71af-43fd-bb3b-5d044b032ba8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.154229 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.154139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.154229 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.154171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/496ae8ae-ad76-4e04-8873-683877edd8e8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.154229 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.154210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8eb7112-469c-495b-84c8-29dd530abd45-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65b59bbd44-2vhpn\" (UID: \"d8eb7112-469c-495b-84c8-29dd530abd45\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"
Jul 14 07:50:45.154428 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.154245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcd4\" (UniqueName: \"kubernetes.io/projected/c2a21cdf-71af-43fd-bb3b-5d044b032ba8-kube-api-access-jpcd4\") pod \"klusterlet-addon-workmgr-76d5c9f97f-dhb2b\" (UID: \"c2a21cdf-71af-43fd-bb3b-5d044b032ba8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.155022 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.154941    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a21cdf-71af-43fd-bb3b-5d044b032ba8-tmp\") pod \"klusterlet-addon-workmgr-76d5c9f97f-dhb2b\" (UID: \"c2a21cdf-71af-43fd-bb3b-5d044b032ba8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.155262 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.155222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/496ae8ae-ad76-4e04-8873-683877edd8e8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.157163 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.157115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2a21cdf-71af-43fd-bb3b-5d044b032ba8-klusterlet-config\") pod \"klusterlet-addon-workmgr-76d5c9f97f-dhb2b\" (UID: \"c2a21cdf-71af-43fd-bb3b-5d044b032ba8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.157567 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.157529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.157929 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.157890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8eb7112-469c-495b-84c8-29dd530abd45-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65b59bbd44-2vhpn\" (UID: \"d8eb7112-469c-495b-84c8-29dd530abd45\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"
Jul 14 07:50:45.158292 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.158270    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.158496 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.158473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-hub\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.158559 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.158502    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/496ae8ae-ad76-4e04-8873-683877edd8e8-ca\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.164344 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.164316    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msl75\" (UniqueName: \"kubernetes.io/projected/496ae8ae-ad76-4e04-8873-683877edd8e8-kube-api-access-msl75\") pod \"cluster-proxy-proxy-agent-6c8467969c-5gwlm\" (UID: \"496ae8ae-ad76-4e04-8873-683877edd8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.169248 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.169201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcd4\" (UniqueName: \"kubernetes.io/projected/c2a21cdf-71af-43fd-bb3b-5d044b032ba8-kube-api-access-jpcd4\") pod \"klusterlet-addon-workmgr-76d5c9f97f-dhb2b\" (UID: \"c2a21cdf-71af-43fd-bb3b-5d044b032ba8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.172908 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.172885    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9zgh\" (UniqueName: \"kubernetes.io/projected/d8eb7112-469c-495b-84c8-29dd530abd45-kube-api-access-s9zgh\") pod \"managed-serviceaccount-addon-agent-65b59bbd44-2vhpn\" (UID: \"d8eb7112-469c-495b-84c8-29dd530abd45\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"
Jul 14 07:50:45.202927 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.202886    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:50:45.225376 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.225344    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"
Jul 14 07:50:45.238450 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.238411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"
Jul 14 07:50:45.254840 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.254815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mwtf\" (UniqueName: \"kubernetes.io/projected/25ddcf6d-2002-40b8-b101-fd5eb3225a69-kube-api-access-6mwtf\") pod \"downloads-68c9cbb497-d6c7m\" (UID: \"25ddcf6d-2002-40b8-b101-fd5eb3225a69\") " pod="openshift-console/downloads-68c9cbb497-d6c7m"
Jul 14 07:50:45.277295 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.277257    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mwtf\" (UniqueName: \"kubernetes.io/projected/25ddcf6d-2002-40b8-b101-fd5eb3225a69-kube-api-access-6mwtf\") pod \"downloads-68c9cbb497-d6c7m\" (UID: \"25ddcf6d-2002-40b8-b101-fd5eb3225a69\") " pod="openshift-console/downloads-68c9cbb497-d6c7m"
Jul 14 07:50:45.318640 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.317896    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-d6c7m"
Jul 14 07:50:45.358240 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.357536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:45.360733 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.360325    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 07:50:45.376019 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.375752    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c94effb-a854-417f-98e8-0a2d4c97bc25-metrics-certs\") pod \"network-metrics-daemon-fkzdh\" (UID: \"7c94effb-a854-417f-98e8-0a2d4c97bc25\") " pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:45.446527 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.446409    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"]
Jul 14 07:50:45.449535 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.449508    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn"]
Jul 14 07:50:45.450697 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:45.450673    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a21cdf_71af_43fd_bb3b_5d044b032ba8.slice/crio-c333505363d795e500097732bdd61ffc3032d8c334f7f5bf1b9f49616a47cc2b WatchSource:0}: Error finding container c333505363d795e500097732bdd61ffc3032d8c334f7f5bf1b9f49616a47cc2b: Status 404 returned error can't find the container with id c333505363d795e500097732bdd61ffc3032d8c334f7f5bf1b9f49616a47cc2b
Jul 14 07:50:45.458112 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.458090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:45.458216 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:45.458129    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8eb7112_469c_495b_84c8_29dd530abd45.slice/crio-34ef918a08ec967c6ed8d87a1c52c3a868d68dda76e4f272164261213977e684 WatchSource:0}: Error finding container 34ef918a08ec967c6ed8d87a1c52c3a868d68dda76e4f272164261213977e684: Status 404 returned error can't find the container with id 34ef918a08ec967c6ed8d87a1c52c3a868d68dda76e4f272164261213977e684
Jul 14 07:50:45.458216 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.458210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:45.460977 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.460949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtx4x\" (UniqueName: \"kubernetes.io/projected/0ce822ae-f256-411e-ba04-046313ed265d-kube-api-access-mtx4x\") pod \"network-check-target-8j2kw\" (UID: \"0ce822ae-f256-411e-ba04-046313ed265d\") " pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:45.461685 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.461662    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 07:50:45.472158 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.472020    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c400d5dd-5e2f-42d2-98e6-8efb2140df6f-original-pull-secret\") pod \"global-pull-secret-syncer-csf4v\" (UID: \"c400d5dd-5e2f-42d2-98e6-8efb2140df6f\") " pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:45.473439 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.473415    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm"]
Jul 14 07:50:45.476642 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:45.476620    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod496ae8ae_ad76_4e04_8873_683877edd8e8.slice/crio-76bde0dfd5da495a522f6e969b33f4d0eeb4640aa8e8ba1df2294883a1a27746 WatchSource:0}: Error finding container 76bde0dfd5da495a522f6e969b33f4d0eeb4640aa8e8ba1df2294883a1a27746: Status 404 returned error can't find the container with id 76bde0dfd5da495a522f6e969b33f4d0eeb4640aa8e8ba1df2294883a1a27746
Jul 14 07:50:45.506835 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.506664    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-d6c7m"]
Jul 14 07:50:45.547502 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.547472    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csf4v"
Jul 14 07:50:45.558839 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.558810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:45.558976 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.558917    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:45.561419 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.561395    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c00ad41c-67de-4cc6-951a-78f04f46bc7a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wpgfz\" (UID: \"c00ad41c-67de-4cc6-951a-78f04f46bc7a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:45.561539 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.561472    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"image-registry-665c7578c7-z8t55\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") " pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:45.607991 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.607956    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjcpw\""
Jul 14 07:50:45.612311 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.612284    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skvf2\""
Jul 14 07:50:45.615547 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.615496    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:45.620854 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.620833    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkzdh"
Jul 14 07:50:45.660055 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.659996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:45.660197 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.660093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:45.660721 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.660698    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee5e97bf-4810-415c-881a-0ab22e7d22b3-service-ca-bundle\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:45.662470 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.662452    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee5e97bf-4810-415c-881a-0ab22e7d22b3-metrics-certs\") pod \"router-default-c79d46876-mj7tx\" (UID: \"ee5e97bf-4810-415c-881a-0ab22e7d22b3\") " pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:45.739047 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.738995    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtm4v\""
Jul 14 07:50:45.745894 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.745864    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ps5qh\""
Jul 14 07:50:45.746884 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.746858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:45.754127 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.754101    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"
Jul 14 07:50:45.802696 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.802663    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pvb26\""
Jul 14 07:50:45.811361 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:45.811242    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:46.154082 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:46.154038    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm" event={"ID":"496ae8ae-ad76-4e04-8873-683877edd8e8","Type":"ContainerStarted","Data":"76bde0dfd5da495a522f6e969b33f4d0eeb4640aa8e8ba1df2294883a1a27746"}
Jul 14 07:50:46.155295 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:46.155261    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn" event={"ID":"d8eb7112-469c-495b-84c8-29dd530abd45","Type":"ContainerStarted","Data":"34ef918a08ec967c6ed8d87a1c52c3a868d68dda76e4f272164261213977e684"}
Jul 14 07:50:46.156494 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:46.156468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b" event={"ID":"c2a21cdf-71af-43fd-bb3b-5d044b032ba8","Type":"ContainerStarted","Data":"c333505363d795e500097732bdd61ffc3032d8c334f7f5bf1b9f49616a47cc2b"}
Jul 14 07:50:46.619073 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:46.619031    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ddcf6d_2002_40b8_b101_fd5eb3225a69.slice/crio-6792c306a6642a6c0eaa3875c3f6bde4ea1bb6bbcf8b21538996c55b5bc41f0d WatchSource:0}: Error finding container 6792c306a6642a6c0eaa3875c3f6bde4ea1bb6bbcf8b21538996c55b5bc41f0d: Status 404 returned error can't find the container with id 6792c306a6642a6c0eaa3875c3f6bde4ea1bb6bbcf8b21538996c55b5bc41f0d
Jul 14 07:50:46.874938 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:46.874904    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8j2kw"]
Jul 14 07:50:46.911722 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:46.911638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-csf4v"]
Jul 14 07:50:46.924058 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:46.923999    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c79d46876-mj7tx"]
Jul 14 07:50:46.945389 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:46.945344    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5e97bf_4810_415c_881a_0ab22e7d22b3.slice/crio-610dca887e5b2b188069618fa4a3fc48db4df533083b89aebb743f67ea1c856d WatchSource:0}: Error finding container 610dca887e5b2b188069618fa4a3fc48db4df533083b89aebb743f67ea1c856d: Status 404 returned error can't find the container with id 610dca887e5b2b188069618fa4a3fc48db4df533083b89aebb743f67ea1c856d
Jul 14 07:50:47.182226 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.180936    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fkzdh"]
Jul 14 07:50:47.182226 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.181956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-d6c7m" event={"ID":"25ddcf6d-2002-40b8-b101-fd5eb3225a69","Type":"ContainerStarted","Data":"6792c306a6642a6c0eaa3875c3f6bde4ea1bb6bbcf8b21538996c55b5bc41f0d"}
Jul 14 07:50:47.189094 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.186952    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-665c7578c7-z8t55"]
Jul 14 07:50:47.195143 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:50:47.194659    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0462f5e_2b4a_48b8_8e9a_91a57b63b4a6.slice/crio-b153df5a102e5152ea5e7162f8741e986cb038e8dd1c754a507013d4668a1841 WatchSource:0}: Error finding container b153df5a102e5152ea5e7162f8741e986cb038e8dd1c754a507013d4668a1841: Status 404 returned error can't find the container with id b153df5a102e5152ea5e7162f8741e986cb038e8dd1c754a507013d4668a1841
Jul 14 07:50:47.198954 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.198925    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz"]
Jul 14 07:50:47.199440 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.199367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjvtp" event={"ID":"2e14ecd3-766a-45a3-9615-e881f7dac04f","Type":"ContainerStarted","Data":"f8d27779d971808fd18abcc785f17661062bb55809782e9e6657e3530971448e"}
Jul 14 07:50:47.233664 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.221972    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c79d46876-mj7tx" event={"ID":"ee5e97bf-4810-415c-881a-0ab22e7d22b3","Type":"ContainerStarted","Data":"7548b697dc55f8b363cdca3844a45ec3d733ae9e17791bc9d7013df377b1db62"}
Jul 14 07:50:47.233664 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.222053    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c79d46876-mj7tx" event={"ID":"ee5e97bf-4810-415c-881a-0ab22e7d22b3","Type":"ContainerStarted","Data":"610dca887e5b2b188069618fa4a3fc48db4df533083b89aebb743f67ea1c856d"}
Jul 14 07:50:47.241394 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.241232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8j2kw" event={"ID":"0ce822ae-f256-411e-ba04-046313ed265d","Type":"ContainerStarted","Data":"a099f9dfaade973d68f96040fc4b4e9b0cf72a4075f30d1bf1d80532b0cf0a30"}
Jul 14 07:50:47.241394 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.241288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8j2kw" event={"ID":"0ce822ae-f256-411e-ba04-046313ed265d","Type":"ContainerStarted","Data":"30105db2d5abd4287f6890ce6a3bd32a4f08d80b7c9e10713785ddb2e56a2d56"}
Jul 14 07:50:47.243610 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.242893    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-csf4v" event={"ID":"c400d5dd-5e2f-42d2-98e6-8efb2140df6f","Type":"ContainerStarted","Data":"310a3af6571b158313d3ff4ef22ca976bdb931285ca5e993ef4ad803dd9a6351"}
Jul 14 07:50:47.244526 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.244488    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:50:47.249520 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.248252    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cjvtp" podStartSLOduration=17.197203329 podStartE2EDuration="24.248232233s" totalImagesPullingTime="7.051028904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:47.24726985 +0000 UTC m=+69.989187722" watchObservedRunningTime="2026-07-14 07:50:47.248232233 +0000 UTC m=+69.990150102"
Jul 14 07:50:47.274321 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.272397    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c79d46876-mj7tx" podStartSLOduration=59.272365289 podStartE2EDuration="59.272365289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:47.271984284 +0000 UTC m=+70.013902168" watchObservedRunningTime="2026-07-14 07:50:47.272365289 +0000 UTC m=+70.014283155"
Jul 14 07:50:47.300038 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.299498    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8j2kw" podStartSLOduration=70.29946206 podStartE2EDuration="1m10.29946206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:47.298979699 +0000 UTC m=+70.040897591" watchObservedRunningTime="2026-07-14 07:50:47.29946206 +0000 UTC m=+70.041379929"
Jul 14 07:50:47.493584 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.492207    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57df98c99d-j7nxh"]
Jul 14 07:50:47.495864 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.495833    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.499026 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.498825    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xjbc6\""
Jul 14 07:50:47.500890 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.499380    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 07:50:47.500890 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.499642    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 07:50:47.500890 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.499823    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 07:50:47.500890 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.500102    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 07:50:47.500890 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.500312    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 07:50:47.523810 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.523731    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57df98c99d-j7nxh"]
Jul 14 07:50:47.584327 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.583971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7565q\" (UniqueName: \"kubernetes.io/projected/39f3ebb7-fd29-4d01-b6c9-3394366a6282-kube-api-access-7565q\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.584327 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.584042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-config\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.584327 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.584083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-oauth-config\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.584327 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.584114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-serving-cert\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.584327 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.584160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-service-ca\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.584327 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.584194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-oauth-serving-cert\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.684933 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.684894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-service-ca\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.685155 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.684956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-oauth-serving-cert\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.685155 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.685039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7565q\" (UniqueName: \"kubernetes.io/projected/39f3ebb7-fd29-4d01-b6c9-3394366a6282-kube-api-access-7565q\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.685155 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.685072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-config\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.685155 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.685108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-oauth-config\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.685155 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.685142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-serving-cert\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.686473 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.686440    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-config\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.686602 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.686490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-service-ca\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.687126 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.687102    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-oauth-serving-cert\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.691517 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.691470    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-oauth-config\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.692142 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.692088    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-serving-cert\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.704446 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.704416    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7565q\" (UniqueName: \"kubernetes.io/projected/39f3ebb7-fd29-4d01-b6c9-3394366a6282-kube-api-access-7565q\") pod \"console-57df98c99d-j7nxh\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") " pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:47.813350 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.812187    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:47.815641 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.815383    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:47.817285 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:47.817047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:50:48.047413 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.047244    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57df98c99d-j7nxh"]
Jul 14 07:50:48.265729 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.265634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-665c7578c7-z8t55" event={"ID":"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6","Type":"ContainerStarted","Data":"06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f"}
Jul 14 07:50:48.265729 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.265698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-665c7578c7-z8t55" event={"ID":"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6","Type":"ContainerStarted","Data":"b153df5a102e5152ea5e7162f8741e986cb038e8dd1c754a507013d4668a1841"}
Jul 14 07:50:48.266574 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.266549    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:50:48.285653 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.285560    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57df98c99d-j7nxh" event={"ID":"39f3ebb7-fd29-4d01-b6c9-3394366a6282","Type":"ContainerStarted","Data":"50694a3711ca44df5081aaa53d517a409b95da126135a344f26b5cdc7fd10594"}
Jul 14 07:50:48.299488 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.297775    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-665c7578c7-z8t55" podStartSLOduration=70.297752861 podStartE2EDuration="1m10.297752861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:48.296371988 +0000 UTC m=+71.038289869" watchObservedRunningTime="2026-07-14 07:50:48.297752861 +0000 UTC m=+71.039670733"
Jul 14 07:50:48.299488 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.299400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fkzdh" event={"ID":"7c94effb-a854-417f-98e8-0a2d4c97bc25","Type":"ContainerStarted","Data":"f415310bf02e6dd269a51edd0a196ecf099d85d3959f43312b97f3943a3f1dda"}
Jul 14 07:50:48.309687 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.309243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz" event={"ID":"c00ad41c-67de-4cc6-951a-78f04f46bc7a","Type":"ContainerStarted","Data":"683a860f8bffedd96460f8d4b94b50765b2f7d7979984f6bad53ea185f79882e"}
Jul 14 07:50:48.309687 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.309292    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:50:48.310306 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:50:48.310285    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c79d46876-mj7tx"
Jul 14 07:51:00.377351 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:00.377311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm" event={"ID":"496ae8ae-ad76-4e04-8873-683877edd8e8","Type":"ContainerStarted","Data":"d0590c961cec4a9928f13577496467972756922806d21250621feb394f2a2a08"}
Jul 14 07:51:00.378951 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:00.378916    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn" event={"ID":"d8eb7112-469c-495b-84c8-29dd530abd45","Type":"ContainerStarted","Data":"99c50aabd14c9b8293a426d6f8b5572da55d6f2fe23878177d15d3903c4ebc52"}
Jul 14 07:51:00.380772 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:00.380745    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b" event={"ID":"c2a21cdf-71af-43fd-bb3b-5d044b032ba8","Type":"ContainerStarted","Data":"861294c0cde8285650b46ce171756766cd4236acec858f4b943af61727fe7c6f"}
Jul 14 07:51:00.380896 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:00.380832    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:51:00.382642 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:00.382613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fkzdh" event={"ID":"7c94effb-a854-417f-98e8-0a2d4c97bc25","Type":"ContainerStarted","Data":"f219125008aedf1d6a17228b0e9f8b3bcd8034e7bbad706dfa69496dfe80e3ce"}
Jul 14 07:51:00.382818 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:00.382802    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b"
Jul 14 07:51:00.397974 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:00.397918    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65b59bbd44-2vhpn" podStartSLOduration=2.208278594 podStartE2EDuration="16.397902873s" totalImagesPullingTime="14.189624279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:00.396942849 +0000 UTC m=+83.138860720" watchObservedRunningTime="2026-07-14 07:51:00.397902873 +0000 UTC m=+83.139820718"
Jul 14 07:51:00.420718 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:00.420661    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d5c9f97f-dhb2b" podStartSLOduration=2.224435109 podStartE2EDuration="16.42063631s" totalImagesPullingTime="14.196201201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:00.41948466 +0000 UTC m=+83.161402530" watchObservedRunningTime="2026-07-14 07:51:00.42063631 +0000 UTC m=+83.162554232"
Jul 14 07:51:07.415510 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.415363    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57df98c99d-j7nxh" event={"ID":"39f3ebb7-fd29-4d01-b6c9-3394366a6282","Type":"ContainerStarted","Data":"f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b"}
Jul 14 07:51:07.421439 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.421396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-csf4v" event={"ID":"c400d5dd-5e2f-42d2-98e6-8efb2140df6f","Type":"ContainerStarted","Data":"a4078a757a1426629e382bcedcad0d71ef49e64b092737f6d53b9a60cba79690"}
Jul 14 07:51:07.423893 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.423842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fkzdh" event={"ID":"7c94effb-a854-417f-98e8-0a2d4c97bc25","Type":"ContainerStarted","Data":"cb062b2c379dfe1f9ed31e55457f8c60d763e4abd1b214fe2152084dbab2c537"}
Jul 14 07:51:07.426606 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.426576    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz" event={"ID":"c00ad41c-67de-4cc6-951a-78f04f46bc7a","Type":"ContainerStarted","Data":"3097d20de25f7d71acc2e9e202110cb2478923f5e47ee31609d87042e7fc2254"}
Jul 14 07:51:07.428756 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.428732    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm" event={"ID":"496ae8ae-ad76-4e04-8873-683877edd8e8","Type":"ContainerStarted","Data":"e61269335e8895d4191f956aee2602696b8f6ffc7d3d0e8c9930f434d59b9bad"}
Jul 14 07:51:07.435645 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.435594    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57df98c99d-j7nxh" podStartSLOduration=8.848845913 podStartE2EDuration="20.435575669s" totalImagesPullingTime="11.586729756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:07.434272727 +0000 UTC m=+90.176190594" watchObservedRunningTime="2026-07-14 07:51:07.435575669 +0000 UTC m=+90.177493518"
Jul 14 07:51:07.451334 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.451280    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fkzdh" podStartSLOduration=78.077217247 podStartE2EDuration="1m30.451260704s" totalImagesPullingTime="12.374043457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:07.448913638 +0000 UTC m=+90.190831507" watchObservedRunningTime="2026-07-14 07:51:07.451260704 +0000 UTC m=+90.193178577"
Jul 14 07:51:07.464459 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.464401    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-csf4v" podStartSLOduration=76.714789464 podStartE2EDuration="1m29.46438278s" totalImagesPullingTime="12.749593316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:07.463595973 +0000 UTC m=+90.205513841" watchObservedRunningTime="2026-07-14 07:51:07.46438278 +0000 UTC m=+90.206300649"
Jul 14 07:51:07.482137 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.482055    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wpgfz" podStartSLOduration=67.078331473 podStartE2EDuration="1m19.482034097s" totalImagesPullingTime="12.403702624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:07.481361754 +0000 UTC m=+90.223279620" watchObservedRunningTime="2026-07-14 07:51:07.482034097 +0000 UTC m=+90.223951964"
Jul 14 07:51:07.818571 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.818529    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:51:07.818765 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.818591    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:51:07.823524 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:07.823497    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:51:08.436737 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:08.436694    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm" event={"ID":"496ae8ae-ad76-4e04-8873-683877edd8e8","Type":"ContainerStarted","Data":"19e22a065182e529eb2cf192b2e4fc083ab07ca9091ccff99fb260324829c415"}
Jul 14 07:51:08.438563 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:08.438520    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-d6c7m" event={"ID":"25ddcf6d-2002-40b8-b101-fd5eb3225a69","Type":"ContainerStarted","Data":"e3fdfe61bb9f14b86a121173e429cf545c76c1f2539d247e2ea5d07bc2022d2e"}
Jul 14 07:51:08.439325 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:08.439297    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-d6c7m"
Jul 14 07:51:08.443673 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:08.443651    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:51:08.455288 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:08.455260    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-d6c7m"
Jul 14 07:51:08.457771 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:08.457716    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8467969c-5gwlm" podStartSLOduration=10.286285993 podStartE2EDuration="24.457699932s" totalImagesPullingTime="14.171413939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:08.456306381 +0000 UTC m=+91.198224252" watchObservedRunningTime="2026-07-14 07:51:08.457699932 +0000 UTC m=+91.199617801"
Jul 14 07:51:08.475843 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:08.475780    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-d6c7m" podStartSLOduration=3.611428021 podStartE2EDuration="24.475758301s" totalImagesPullingTime="20.86433028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:08.474129949 +0000 UTC m=+91.216047817" watchObservedRunningTime="2026-07-14 07:51:08.475758301 +0000 UTC m=+91.217676170"
Jul 14 07:51:10.330641 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:10.330608    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:51:11.840407 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:11.840368    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-665c7578c7-z8t55"]
Jul 14 07:51:17.271882 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:17.271843    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57df98c99d-j7nxh"]
Jul 14 07:51:18.311955 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:18.311926    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8j2kw"
Jul 14 07:51:19.207649 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.207609    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z8gg6"]
Jul 14 07:51:19.269793 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.269760    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.273096 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.273067    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 07:51:19.273241 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.273148    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 07:51:19.273241 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.273180    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 07:51:19.273405 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.273391    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 07:51:19.274095 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.274079    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cdj8g\""
Jul 14 07:51:19.385085 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.384992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-textfile\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.385085 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.385051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-wtmp\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.385576 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.385104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-accelerators-collector-config\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.385576 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.385158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.385576 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.385192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-metrics-client-ca\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.385576 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.385229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-sys\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.385576 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.385252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-root\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.385576 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.385281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-tls\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.385576 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.385317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whhwf\" (UniqueName: \"kubernetes.io/projected/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-kube-api-access-whhwf\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486170 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-wtmp\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486360 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-accelerators-collector-config\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486360 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486360 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-metrics-client-ca\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486360 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-sys\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486360 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486336    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-root\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486545 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-tls\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486545 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whhwf\" (UniqueName: \"kubernetes.io/projected/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-kube-api-access-whhwf\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486545 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-textfile\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486820 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-textfile\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.486969 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.486953    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-wtmp\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.487498 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.487471    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-accelerators-collector-config\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.488174 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.487842    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-root\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.488174 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.487915    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-sys\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.488174 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:51:19.487951    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 14 07:51:19.488174 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:51:19.488044    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-tls podName:8a2d3227-e3d1-4d82-8885-8c04e1ce7993 nodeName:}" failed. No retries permitted until 2026-07-14 07:51:19.988023177 +0000 UTC m=+102.729941032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-tls") pod "node-exporter-z8gg6" (UID: "8a2d3227-e3d1-4d82-8885-8c04e1ce7993") : secret "node-exporter-tls" not found
Jul 14 07:51:19.512270 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.512231    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.512443 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.512406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-metrics-client-ca\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.530837 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.521233    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whhwf\" (UniqueName: \"kubernetes.io/projected/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-kube-api-access-whhwf\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.991199 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.991159    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-tls\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:19.993569 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:19.993534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a2d3227-e3d1-4d82-8885-8c04e1ce7993-node-exporter-tls\") pod \"node-exporter-z8gg6\" (UID: \"8a2d3227-e3d1-4d82-8885-8c04e1ce7993\") " pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:20.183511 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:20.183476    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z8gg6"
Jul 14 07:51:20.523981 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:20.523944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z8gg6" event={"ID":"8a2d3227-e3d1-4d82-8885-8c04e1ce7993","Type":"ContainerStarted","Data":"2d0351517e243dba8e24a93e27e75e38a45f4b43c4fbd31d319dc2a2c90326ff"}
Jul 14 07:51:22.536637 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:22.536604    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a2d3227-e3d1-4d82-8885-8c04e1ce7993" containerID="ddb3a7dc48e907436cfe2f888a88224ddf6404697ba6f117b20a291c96d5195a" exitCode=0
Jul 14 07:51:22.537092 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:22.536683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z8gg6" event={"ID":"8a2d3227-e3d1-4d82-8885-8c04e1ce7993","Type":"ContainerDied","Data":"ddb3a7dc48e907436cfe2f888a88224ddf6404697ba6f117b20a291c96d5195a"}
Jul 14 07:51:23.548284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:23.548247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z8gg6" event={"ID":"8a2d3227-e3d1-4d82-8885-8c04e1ce7993","Type":"ContainerStarted","Data":"8e8ef512239d4f459787b4891383a31d6e0bce7d77c7933acbb924891eadb41c"}
Jul 14 07:51:23.548747 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:23.548343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z8gg6" event={"ID":"8a2d3227-e3d1-4d82-8885-8c04e1ce7993","Type":"ContainerStarted","Data":"76b024f87ba013e0f7d1a80d198c61cb29f0a8b304ba9ba1b394d32dcf8abdd9"}
Jul 14 07:51:23.572136 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:23.572085    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z8gg6" podStartSLOduration=2.993138862 podStartE2EDuration="4.572068996s" totalImagesPullingTime="1.473781572s" totalInitContainerRuntime="105.148562ms" isStatefulPod=true podCreationTimestamp="2026-07-14 07:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:23.570235068 +0000 UTC m=+106.312152936" watchObservedRunningTime="2026-07-14 07:51:23.572068996 +0000 UTC m=+106.313986885"
Jul 14 07:51:28.570254 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:28.570214    2562 generic.go:356] "Generic (PLEG): container finished" podID="8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2" containerID="aea07b27cfb8d2b3b9c0e455ba07a1f1e9318c189df7c5b59b66327bdd01af21" exitCode=0
Jul 14 07:51:28.570775 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:28.570298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9" event={"ID":"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2","Type":"ContainerDied","Data":"aea07b27cfb8d2b3b9c0e455ba07a1f1e9318c189df7c5b59b66327bdd01af21"}
Jul 14 07:51:28.570775 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:28.570712    2562 scope.go:117] "RemoveContainer" containerID="aea07b27cfb8d2b3b9c0e455ba07a1f1e9318c189df7c5b59b66327bdd01af21"
Jul 14 07:51:29.577278 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:29.577242    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4jbz9" event={"ID":"8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2","Type":"ContainerStarted","Data":"d7f827203217a42350fdb140867ce619d8aafdbc26f4e0bc65941b20912bb327"}
Jul 14 07:51:36.869191 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:36.869144    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-665c7578c7-z8t55" podUID="f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" containerName="registry" containerID="cri-o://06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f" gracePeriod=30
Jul 14 07:51:37.123626 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.123562    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:51:37.232760 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.232720    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-trusted-ca\") pod \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") "
Jul 14 07:51:37.232760 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.232761    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-installation-pull-secrets\") pod \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") "
Jul 14 07:51:37.233078 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.232783    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") pod \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") "
Jul 14 07:51:37.233078 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.232823    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc5m2\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-kube-api-access-bc5m2\") pod \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") "
Jul 14 07:51:37.233078 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.232855    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-certificates\") pod \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") "
Jul 14 07:51:37.233078 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.232884    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-ca-trust-extracted\") pod \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") "
Jul 14 07:51:37.233078 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.233033    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-bound-sa-token\") pod \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") "
Jul 14 07:51:37.233336 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.233080    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-image-registry-private-configuration\") pod \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\" (UID: \"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6\") "
Jul 14 07:51:37.233336 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.233274    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:51:37.233448 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.233379    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-trusted-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:37.233448 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.233387    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:51:37.235564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.235493    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:51:37.235712 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.235644    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-kube-api-access-bc5m2" (OuterVolumeSpecName: "kube-api-access-bc5m2") pod "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6"). InnerVolumeSpecName "kube-api-access-bc5m2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:51:37.235712 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.235668    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:51:37.235830 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.235709    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:51:37.235830 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.235761    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:51:37.241148 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.241121    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" (UID: "f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 07:51:37.334125 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.334086    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-installation-pull-secrets\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:37.334125 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.334119    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:37.334125 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.334132    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc5m2\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-kube-api-access-bc5m2\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:37.334367 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.334144    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-registry-certificates\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:37.334367 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.334155    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-ca-trust-extracted\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:37.334367 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.334168    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-bound-sa-token\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:37.334367 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.334180    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6-image-registry-private-configuration\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:37.611816 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.611781    2562 generic.go:356] "Generic (PLEG): container finished" podID="f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" containerID="06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f" exitCode=0
Jul 14 07:51:37.611984 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.611826    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665c7578c7-z8t55"
Jul 14 07:51:37.611984 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.611864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-665c7578c7-z8t55" event={"ID":"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6","Type":"ContainerDied","Data":"06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f"}
Jul 14 07:51:37.611984 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.611916    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-665c7578c7-z8t55" event={"ID":"f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6","Type":"ContainerDied","Data":"b153df5a102e5152ea5e7162f8741e986cb038e8dd1c754a507013d4668a1841"}
Jul 14 07:51:37.611984 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.611936    2562 scope.go:117] "RemoveContainer" containerID="06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f"
Jul 14 07:51:37.620672 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.620655    2562 scope.go:117] "RemoveContainer" containerID="06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f"
Jul 14 07:51:37.620950 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:51:37.620929    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f\": container with ID starting with 06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f not found: ID does not exist" containerID="06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f"
Jul 14 07:51:37.620999 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.620960    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f"} err="failed to get container status \"06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f\": rpc error: code = NotFound desc = could not find container \"06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f\": container with ID starting with 06febac618cc7fa1647e428fa30b9d5cc9c91b04e60165ff69f0d5cdf0ae644f not found: ID does not exist"
Jul 14 07:51:37.633953 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.633927    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-665c7578c7-z8t55"]
Jul 14 07:51:37.639360 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.639334    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-665c7578c7-z8t55"]
Jul 14 07:51:37.704034 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:37.702160    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" path="/var/lib/kubelet/pods/f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6/volumes"
Jul 14 07:51:42.293145 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.293080    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57df98c99d-j7nxh" podUID="39f3ebb7-fd29-4d01-b6c9-3394366a6282" containerName="console" containerID="cri-o://f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b" gracePeriod=15
Jul 14 07:51:42.586116 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.586085    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:51:42.641250 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.641213    2562 generic.go:356] "Generic (PLEG): container finished" podID="39f3ebb7-fd29-4d01-b6c9-3394366a6282" containerID="f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b" exitCode=0
Jul 14 07:51:42.641436 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.641275    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57df98c99d-j7nxh"
Jul 14 07:51:42.641436 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.641298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57df98c99d-j7nxh" event={"ID":"39f3ebb7-fd29-4d01-b6c9-3394366a6282","Type":"ContainerDied","Data":"f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b"}
Jul 14 07:51:42.641436 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.641377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57df98c99d-j7nxh" event={"ID":"39f3ebb7-fd29-4d01-b6c9-3394366a6282","Type":"ContainerDied","Data":"50694a3711ca44df5081aaa53d517a409b95da126135a344f26b5cdc7fd10594"}
Jul 14 07:51:42.641436 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.641403    2562 scope.go:117] "RemoveContainer" containerID="f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b"
Jul 14 07:51:42.642757 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.642733    2562 generic.go:356] "Generic (PLEG): container finished" podID="090f2367-54a2-401a-8686-e99d1a738379" containerID="d7607400d9a48f49c20414f669141ee652a47daaace3ccad3990c013faa684b5" exitCode=0
Jul 14 07:51:42.642877 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.642817    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p" event={"ID":"090f2367-54a2-401a-8686-e99d1a738379","Type":"ContainerDied","Data":"d7607400d9a48f49c20414f669141ee652a47daaace3ccad3990c013faa684b5"}
Jul 14 07:51:42.643147 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.643131    2562 scope.go:117] "RemoveContainer" containerID="d7607400d9a48f49c20414f669141ee652a47daaace3ccad3990c013faa684b5"
Jul 14 07:51:42.649947 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.649925    2562 scope.go:117] "RemoveContainer" containerID="f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b"
Jul 14 07:51:42.650252 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:51:42.650231    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b\": container with ID starting with f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b not found: ID does not exist" containerID="f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b"
Jul 14 07:51:42.650323 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.650264    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b"} err="failed to get container status \"f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b\": rpc error: code = NotFound desc = could not find container \"f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b\": container with ID starting with f7a5b107516fa9bec60a5c31efe64fca399d35c60d3b65f265fb900f002b913b not found: ID does not exist"
Jul 14 07:51:42.685587 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.685559    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-serving-cert\") pod \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") "
Jul 14 07:51:42.685717 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.685642    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-oauth-serving-cert\") pod \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") "
Jul 14 07:51:42.685783 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.685731    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-config\") pod \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") "
Jul 14 07:51:42.685831 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.685809    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7565q\" (UniqueName: \"kubernetes.io/projected/39f3ebb7-fd29-4d01-b6c9-3394366a6282-kube-api-access-7565q\") pod \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") "
Jul 14 07:51:42.685878 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.685859    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-oauth-config\") pod \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") "
Jul 14 07:51:42.685931 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.685883    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-service-ca\") pod \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\" (UID: \"39f3ebb7-fd29-4d01-b6c9-3394366a6282\") "
Jul 14 07:51:42.686113 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.686088    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39f3ebb7-fd29-4d01-b6c9-3394366a6282" (UID: "39f3ebb7-fd29-4d01-b6c9-3394366a6282"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:51:42.686246 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.686156    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-config" (OuterVolumeSpecName: "console-config") pod "39f3ebb7-fd29-4d01-b6c9-3394366a6282" (UID: "39f3ebb7-fd29-4d01-b6c9-3394366a6282"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:51:42.686689 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.686667    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-service-ca" (OuterVolumeSpecName: "service-ca") pod "39f3ebb7-fd29-4d01-b6c9-3394366a6282" (UID: "39f3ebb7-fd29-4d01-b6c9-3394366a6282"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:51:42.688567 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.688537    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39f3ebb7-fd29-4d01-b6c9-3394366a6282" (UID: "39f3ebb7-fd29-4d01-b6c9-3394366a6282"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:51:42.688777 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.688751    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f3ebb7-fd29-4d01-b6c9-3394366a6282-kube-api-access-7565q" (OuterVolumeSpecName: "kube-api-access-7565q") pod "39f3ebb7-fd29-4d01-b6c9-3394366a6282" (UID: "39f3ebb7-fd29-4d01-b6c9-3394366a6282"). InnerVolumeSpecName "kube-api-access-7565q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:51:42.688946 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.688925    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39f3ebb7-fd29-4d01-b6c9-3394366a6282" (UID: "39f3ebb7-fd29-4d01-b6c9-3394366a6282"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:51:42.787060 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.787019    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7565q\" (UniqueName: \"kubernetes.io/projected/39f3ebb7-fd29-4d01-b6c9-3394366a6282-kube-api-access-7565q\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:42.787060 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.787049    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-oauth-config\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:42.787060 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.787059    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:42.787060 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.787068    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-serving-cert\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:42.787321 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.787077    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-oauth-serving-cert\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:42.787321 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.787086    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39f3ebb7-fd29-4d01-b6c9-3394366a6282-console-config\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:51:42.961804 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.961767    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57df98c99d-j7nxh"]
Jul 14 07:51:42.963838 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:42.963811    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57df98c99d-j7nxh"]
Jul 14 07:51:43.648569 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:43.648530    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hpq4p" event={"ID":"090f2367-54a2-401a-8686-e99d1a738379","Type":"ContainerStarted","Data":"d7066c6fea9d96f125bcd4f9366c97c67d9a23dfba961fe12e86ea4255d4753c"}
Jul 14 07:51:43.699760 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:43.699729    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39f3ebb7-fd29-4d01-b6c9-3394366a6282" path="/var/lib/kubelet/pods/39f3ebb7-fd29-4d01-b6c9-3394366a6282/volumes"
Jul 14 07:51:48.672134 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:48.672097    2562 generic.go:356] "Generic (PLEG): container finished" podID="3d69459a-868a-4c7f-b665-9ce0d8a7d6b6" containerID="dce2e62cb4bf75bafcacc0eed55de0df1cd87cd8f34f7c47bb1da6a4eb36ebcc" exitCode=0
Jul 14 07:51:48.672654 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:48.672180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-szw28" event={"ID":"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6","Type":"ContainerDied","Data":"dce2e62cb4bf75bafcacc0eed55de0df1cd87cd8f34f7c47bb1da6a4eb36ebcc"}
Jul 14 07:51:48.672654 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:48.672608    2562 scope.go:117] "RemoveContainer" containerID="dce2e62cb4bf75bafcacc0eed55de0df1cd87cd8f34f7c47bb1da6a4eb36ebcc"
Jul 14 07:51:49.679329 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:49.679291    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-szw28" event={"ID":"3d69459a-868a-4c7f-b665-9ce0d8a7d6b6","Type":"ContainerStarted","Data":"bfa7af8a18e489ff683dba72f618333f38d9169b080f30eedb4d4f314e294773"}
Jul 14 07:51:49.682860 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:49.682836    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c79d46876-mj7tx_ee5e97bf-4810-415c-881a-0ab22e7d22b3/router/0.log"
Jul 14 07:51:49.696020 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:51:49.695975    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dbsxm_b8d72dd8-efdb-4c85-b6cc-ffd58a507662/serve-healthcheck-canary/0.log"
Jul 14 07:54:37.560809 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:37.560775    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 07:54:37.569664 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:37.569633    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 07:54:37.574782 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:37.574760    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 07:54:37.576825 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:37.576805    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 07:54:37.579102 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:37.579081    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 07:54:51.700268 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.700215    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"]
Jul 14 07:54:51.702623 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.700525    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f3ebb7-fd29-4d01-b6c9-3394366a6282" containerName="console"
Jul 14 07:54:51.702623 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.700551    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f3ebb7-fd29-4d01-b6c9-3394366a6282" containerName="console"
Jul 14 07:54:51.702623 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.700577    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" containerName="registry"
Jul 14 07:54:51.702623 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.700586    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" containerName="registry"
Jul 14 07:54:51.702623 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.700646    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f3ebb7-fd29-4d01-b6c9-3394366a6282" containerName="console"
Jul 14 07:54:51.702623 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.700655    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0462f5e-2b4a-48b8-8e9a-91a57b63b4a6" containerName="registry"
Jul 14 07:54:51.703465 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.703451    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.707020 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.706981    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 07:54:51.707145 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.707090    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 07:54:51.707145 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.707108    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 07:54:51.707482 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.707466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xkkrl\""
Jul 14 07:54:51.707532 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.707492    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 07:54:51.717510 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.717488    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"]
Jul 14 07:54:51.783904 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.783873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.784123 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.783918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-manifests\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.784123 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.783939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzpcb\" (UniqueName: \"kubernetes.io/projected/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-kube-api-access-jzpcb\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.784123 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.784058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-tmp\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.784123 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.784111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.884783 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.884746    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-manifests\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.884783 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.884782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpcb\" (UniqueName: \"kubernetes.io/projected/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-kube-api-access-jzpcb\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.885066 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.884818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-tmp\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.885066 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.884991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.885175 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.885075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.885175 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.885148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-manifests\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.886969 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.886937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-tmp\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.887232 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.887210    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.887370 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.887350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:51.900984 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:51.900959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzpcb\" (UniqueName: \"kubernetes.io/projected/e124b782-ece2-45b2-9ea5-efe9f65ae4d2-kube-api-access-jzpcb\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm\" (UID: \"e124b782-ece2-45b2-9ea5-efe9f65ae4d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:52.014334 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:52.014297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:52.153573 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:52.153538    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"]
Jul 14 07:54:52.156975 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:54:52.156947    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode124b782_ece2_45b2_9ea5_efe9f65ae4d2.slice/crio-a21a67f9d0b3cd06b1c329c7679ca4273f7aba0051e914c145e527fb46e75270 WatchSource:0}: Error finding container a21a67f9d0b3cd06b1c329c7679ca4273f7aba0051e914c145e527fb46e75270: Status 404 returned error can't find the container with id a21a67f9d0b3cd06b1c329c7679ca4273f7aba0051e914c145e527fb46e75270
Jul 14 07:54:52.158699 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:52.158683    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 07:54:52.386890 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:52.386805    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm" event={"ID":"e124b782-ece2-45b2-9ea5-efe9f65ae4d2","Type":"ContainerStarted","Data":"a21a67f9d0b3cd06b1c329c7679ca4273f7aba0051e914c145e527fb46e75270"}
Jul 14 07:54:55.404790 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:55.404703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm" event={"ID":"e124b782-ece2-45b2-9ea5-efe9f65ae4d2","Type":"ContainerStarted","Data":"4d28158db0ff68ccae329400067e38c7a4bddee04facb254ce053dd30ba0fbc5"}
Jul 14 07:54:56.410035 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:56.409981    2562 generic.go:356] "Generic (PLEG): container finished" podID="e124b782-ece2-45b2-9ea5-efe9f65ae4d2" containerID="4d28158db0ff68ccae329400067e38c7a4bddee04facb254ce053dd30ba0fbc5" exitCode=0
Jul 14 07:54:56.410466 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:56.410070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm" event={"ID":"e124b782-ece2-45b2-9ea5-efe9f65ae4d2","Type":"ContainerDied","Data":"4d28158db0ff68ccae329400067e38c7a4bddee04facb254ce053dd30ba0fbc5"}
Jul 14 07:54:57.417227 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:57.417184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm" event={"ID":"e124b782-ece2-45b2-9ea5-efe9f65ae4d2","Type":"ContainerStarted","Data":"6475c5616fe87df862c6da4be268e1cd49857705ad747950374005b74d018cf3"}
Jul 14 07:54:57.417695 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:57.417269    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:54:57.441801 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:54:57.441752    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm" podStartSLOduration=2.038126544 podStartE2EDuration="6.441734965s" totalImagesPullingTime="3.343168635s" totalInitContainerRuntime="1.060439786s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:54:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:54:57.440983332 +0000 UTC m=+320.182901200" watchObservedRunningTime="2026-07-14 07:54:57.441734965 +0000 UTC m=+320.183652832"
Jul 14 07:55:08.425093 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:08.425059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm"
Jul 14 07:55:11.910615 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:11.910579    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"]
Jul 14 07:55:11.920381 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:11.920356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:11.925752 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:11.925729    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cwqq7\""
Jul 14 07:55:11.925980 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:11.925967    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 07:55:11.926076 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:11.925984    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 07:55:11.936234 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:11.936212    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"]
Jul 14 07:55:12.056297 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.056263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8lj5\" (UniqueName: \"kubernetes.io/projected/7a6ac8ac-5c52-4838-8b31-86d62301b62a-kube-api-access-r8lj5\") pod \"kube-auth-proxy-7b677bd8c7-mk4zk\" (UID: \"7a6ac8ac-5c52-4838-8b31-86d62301b62a\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.056297 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.056299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a6ac8ac-5c52-4838-8b31-86d62301b62a-tmp\") pod \"kube-auth-proxy-7b677bd8c7-mk4zk\" (UID: \"7a6ac8ac-5c52-4838-8b31-86d62301b62a\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.056502 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.056321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a6ac8ac-5c52-4838-8b31-86d62301b62a-tls-certs\") pod \"kube-auth-proxy-7b677bd8c7-mk4zk\" (UID: \"7a6ac8ac-5c52-4838-8b31-86d62301b62a\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.115929 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.115890    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mjxgs"]
Jul 14 07:55:12.118823 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.118799    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:12.125625 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.125600    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 14 07:55:12.125742 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.125608    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-p2h9s\""
Jul 14 07:55:12.137707 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.137680    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mjxgs"]
Jul 14 07:55:12.157315 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.157286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8lj5\" (UniqueName: \"kubernetes.io/projected/7a6ac8ac-5c52-4838-8b31-86d62301b62a-kube-api-access-r8lj5\") pod \"kube-auth-proxy-7b677bd8c7-mk4zk\" (UID: \"7a6ac8ac-5c52-4838-8b31-86d62301b62a\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.157472 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.157318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a6ac8ac-5c52-4838-8b31-86d62301b62a-tmp\") pod \"kube-auth-proxy-7b677bd8c7-mk4zk\" (UID: \"7a6ac8ac-5c52-4838-8b31-86d62301b62a\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.157472 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.157350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a6ac8ac-5c52-4838-8b31-86d62301b62a-tls-certs\") pod \"kube-auth-proxy-7b677bd8c7-mk4zk\" (UID: \"7a6ac8ac-5c52-4838-8b31-86d62301b62a\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.159971 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.159944    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a6ac8ac-5c52-4838-8b31-86d62301b62a-tmp\") pod \"kube-auth-proxy-7b677bd8c7-mk4zk\" (UID: \"7a6ac8ac-5c52-4838-8b31-86d62301b62a\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.160082 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.159996    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a6ac8ac-5c52-4838-8b31-86d62301b62a-tls-certs\") pod \"kube-auth-proxy-7b677bd8c7-mk4zk\" (UID: \"7a6ac8ac-5c52-4838-8b31-86d62301b62a\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.168358 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.168295    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8lj5\" (UniqueName: \"kubernetes.io/projected/7a6ac8ac-5c52-4838-8b31-86d62301b62a-kube-api-access-r8lj5\") pod \"kube-auth-proxy-7b677bd8c7-mk4zk\" (UID: \"7a6ac8ac-5c52-4838-8b31-86d62301b62a\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.230888 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.230858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"
Jul 14 07:55:12.258088 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.258057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53dbd3f7-821f-4aca-b64d-8b3179aae69f-cert\") pod \"odh-model-controller-7998c67dc4-mjxgs\" (UID: \"53dbd3f7-821f-4aca-b64d-8b3179aae69f\") " pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:12.258239 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.258143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg2j9\" (UniqueName: \"kubernetes.io/projected/53dbd3f7-821f-4aca-b64d-8b3179aae69f-kube-api-access-tg2j9\") pod \"odh-model-controller-7998c67dc4-mjxgs\" (UID: \"53dbd3f7-821f-4aca-b64d-8b3179aae69f\") " pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:12.359224 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.359189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg2j9\" (UniqueName: \"kubernetes.io/projected/53dbd3f7-821f-4aca-b64d-8b3179aae69f-kube-api-access-tg2j9\") pod \"odh-model-controller-7998c67dc4-mjxgs\" (UID: \"53dbd3f7-821f-4aca-b64d-8b3179aae69f\") " pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:12.359379 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.359254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53dbd3f7-821f-4aca-b64d-8b3179aae69f-cert\") pod \"odh-model-controller-7998c67dc4-mjxgs\" (UID: \"53dbd3f7-821f-4aca-b64d-8b3179aae69f\") " pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:12.359379 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:55:12.359375    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 14 07:55:12.359499 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:55:12.359460    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53dbd3f7-821f-4aca-b64d-8b3179aae69f-cert podName:53dbd3f7-821f-4aca-b64d-8b3179aae69f nodeName:}" failed. No retries permitted until 2026-07-14 07:55:12.859438399 +0000 UTC m=+335.601356246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53dbd3f7-821f-4aca-b64d-8b3179aae69f-cert") pod "odh-model-controller-7998c67dc4-mjxgs" (UID: "53dbd3f7-821f-4aca-b64d-8b3179aae69f") : secret "odh-model-controller-webhook-cert" not found
Jul 14 07:55:12.367481 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.367448    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg2j9\" (UniqueName: \"kubernetes.io/projected/53dbd3f7-821f-4aca-b64d-8b3179aae69f-kube-api-access-tg2j9\") pod \"odh-model-controller-7998c67dc4-mjxgs\" (UID: \"53dbd3f7-821f-4aca-b64d-8b3179aae69f\") " pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:12.372250 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.372227    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk"]
Jul 14 07:55:12.375472 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:55:12.375437    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6ac8ac_5c52_4838_8b31_86d62301b62a.slice/crio-d040cbf44f2d481d575e66ff51e94167601c9b0686aec6d5c57d0cc3284de84a WatchSource:0}: Error finding container d040cbf44f2d481d575e66ff51e94167601c9b0686aec6d5c57d0cc3284de84a: Status 404 returned error can't find the container with id d040cbf44f2d481d575e66ff51e94167601c9b0686aec6d5c57d0cc3284de84a
Jul 14 07:55:12.482795 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.482760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk" event={"ID":"7a6ac8ac-5c52-4838-8b31-86d62301b62a","Type":"ContainerStarted","Data":"d040cbf44f2d481d575e66ff51e94167601c9b0686aec6d5c57d0cc3284de84a"}
Jul 14 07:55:12.863290 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.863191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53dbd3f7-821f-4aca-b64d-8b3179aae69f-cert\") pod \"odh-model-controller-7998c67dc4-mjxgs\" (UID: \"53dbd3f7-821f-4aca-b64d-8b3179aae69f\") " pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:12.866212 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:12.866189    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53dbd3f7-821f-4aca-b64d-8b3179aae69f-cert\") pod \"odh-model-controller-7998c67dc4-mjxgs\" (UID: \"53dbd3f7-821f-4aca-b64d-8b3179aae69f\") " pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:13.028825 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.028785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:13.111739 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.111707    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-96rxz"]
Jul 14 07:55:13.115349 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.115186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:13.118786 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.118731    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 14 07:55:13.119034 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.118790    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8xf44\""
Jul 14 07:55:13.125697 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.125665    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-96rxz"]
Jul 14 07:55:13.165972 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.165735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqzkr\" (UniqueName: \"kubernetes.io/projected/600f7953-d367-4df7-9534-415ed48d88c4-kube-api-access-jqzkr\") pod \"model-serving-api-54d89bd5fc-96rxz\" (UID: \"600f7953-d367-4df7-9534-415ed48d88c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:13.165972 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.165849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/600f7953-d367-4df7-9534-415ed48d88c4-tls-certs\") pod \"model-serving-api-54d89bd5fc-96rxz\" (UID: \"600f7953-d367-4df7-9534-415ed48d88c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:13.191935 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.191898    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"]
Jul 14 07:55:13.195339 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.195311    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.198401 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.198159    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 07:55:13.198401 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.198225    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 07:55:13.198401 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.198159    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 07:55:13.199148 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.198895    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mjxgs"]
Jul 14 07:55:13.199148 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.199024    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 07:55:13.199148 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.199039    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7brz4\""
Jul 14 07:55:13.201727 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:55:13.201701    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53dbd3f7_821f_4aca_b64d_8b3179aae69f.slice/crio-6690fc323de3e9ec6c02eebbdebdeac6e3a829198b4c71356c0b0cb9799f074b WatchSource:0}: Error finding container 6690fc323de3e9ec6c02eebbdebdeac6e3a829198b4c71356c0b0cb9799f074b: Status 404 returned error can't find the container with id 6690fc323de3e9ec6c02eebbdebdeac6e3a829198b4c71356c0b0cb9799f074b
Jul 14 07:55:13.206717 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.206229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"]
Jul 14 07:55:13.266652 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.266614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/600f7953-d367-4df7-9534-415ed48d88c4-tls-certs\") pod \"model-serving-api-54d89bd5fc-96rxz\" (UID: \"600f7953-d367-4df7-9534-415ed48d88c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:13.266846 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.266665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-token\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.266846 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.266769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.266846 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.266806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.266846 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.266838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.267102 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:55:13.266867    2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 14 07:55:13.267102 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.266928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqzkr\" (UniqueName: \"kubernetes.io/projected/600f7953-d367-4df7-9534-415ed48d88c4-kube-api-access-jqzkr\") pod \"model-serving-api-54d89bd5fc-96rxz\" (UID: \"600f7953-d367-4df7-9534-415ed48d88c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:13.267102 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:55:13.267066    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600f7953-d367-4df7-9534-415ed48d88c4-tls-certs podName:600f7953-d367-4df7-9534-415ed48d88c4 nodeName:}" failed. No retries permitted until 2026-07-14 07:55:13.766969036 +0000 UTC m=+336.508886895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/600f7953-d367-4df7-9534-415ed48d88c4-tls-certs") pod "model-serving-api-54d89bd5fc-96rxz" (UID: "600f7953-d367-4df7-9534-415ed48d88c4") : secret "model-serving-api-tls" not found
Jul 14 07:55:13.267260 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.267116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafc0383-339a-4183-8ee4-ca6b4bf09092-local-certs\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.267260 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.267138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7qfc\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-kube-api-access-b7qfc\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.267260 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.267185    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-cacerts\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.276352 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.276325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqzkr\" (UniqueName: \"kubernetes.io/projected/600f7953-d367-4df7-9534-415ed48d88c4-kube-api-access-jqzkr\") pod \"model-serving-api-54d89bd5fc-96rxz\" (UID: \"600f7953-d367-4df7-9534-415ed48d88c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:13.368612 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.368529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafc0383-339a-4183-8ee4-ca6b4bf09092-local-certs\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.368612 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.368577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7qfc\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-kube-api-access-b7qfc\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.368832 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.368618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-cacerts\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.368832 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.368678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-token\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.368832 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.368704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.368832 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.368741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.368832 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.368766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.369560 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.369509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.371810 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.371784    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-cacerts\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.372028 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.371989    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafc0383-339a-4183-8ee4-ca6b4bf09092-local-certs\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.372309 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.372285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.372668 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.372646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.380557 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.380504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-token\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.380900 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.380850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7qfc\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-kube-api-access-b7qfc\") pod \"istiod-openshift-gateway-7574459656-xkzb8\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.489140 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.489099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs" event={"ID":"53dbd3f7-821f-4aca-b64d-8b3179aae69f","Type":"ContainerStarted","Data":"6690fc323de3e9ec6c02eebbdebdeac6e3a829198b4c71356c0b0cb9799f074b"}
Jul 14 07:55:13.518137 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.518110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:13.661249 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.661225    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"]
Jul 14 07:55:13.663159 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:55:13.663133    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafc0383_339a_4183_8ee4_ca6b4bf09092.slice/crio-7763d1dfc706a31739db0a83eadab9246373d1fd17f6174fd05357a4acdd0c51 WatchSource:0}: Error finding container 7763d1dfc706a31739db0a83eadab9246373d1fd17f6174fd05357a4acdd0c51: Status 404 returned error can't find the container with id 7763d1dfc706a31739db0a83eadab9246373d1fd17f6174fd05357a4acdd0c51
Jul 14 07:55:13.773211 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.773171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/600f7953-d367-4df7-9534-415ed48d88c4-tls-certs\") pod \"model-serving-api-54d89bd5fc-96rxz\" (UID: \"600f7953-d367-4df7-9534-415ed48d88c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:13.776449 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:13.776416    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/600f7953-d367-4df7-9534-415ed48d88c4-tls-certs\") pod \"model-serving-api-54d89bd5fc-96rxz\" (UID: \"600f7953-d367-4df7-9534-415ed48d88c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:14.029351 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:14.029310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:14.414827 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:14.414799    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-96rxz"]
Jul 14 07:55:14.496249 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:14.496181    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8" event={"ID":"aafc0383-339a-4183-8ee4-ca6b4bf09092","Type":"ContainerStarted","Data":"7763d1dfc706a31739db0a83eadab9246373d1fd17f6174fd05357a4acdd0c51"}
Jul 14 07:55:14.999214 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:55:14.999177    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600f7953_d367_4df7_9534_415ed48d88c4.slice/crio-0091cb3b8f07c774fbdef58c09b3f30aa83492cf31c7013fa8aaf89a0ccb7e45 WatchSource:0}: Error finding container 0091cb3b8f07c774fbdef58c09b3f30aa83492cf31c7013fa8aaf89a0ccb7e45: Status 404 returned error can't find the container with id 0091cb3b8f07c774fbdef58c09b3f30aa83492cf31c7013fa8aaf89a0ccb7e45
Jul 14 07:55:15.504479 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:15.504440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-96rxz" event={"ID":"600f7953-d367-4df7-9534-415ed48d88c4","Type":"ContainerStarted","Data":"0091cb3b8f07c774fbdef58c09b3f30aa83492cf31c7013fa8aaf89a0ccb7e45"}
Jul 14 07:55:16.510888 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:16.510834    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk" event={"ID":"7a6ac8ac-5c52-4838-8b31-86d62301b62a","Type":"ContainerStarted","Data":"da4c4dce7a7dcd887346212cd858f4126c83afd791ed698c027943d4c4de2c99"}
Jul 14 07:55:16.512495 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:16.512459    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs" event={"ID":"53dbd3f7-821f-4aca-b64d-8b3179aae69f","Type":"ContainerStarted","Data":"3f1f2f6014597285c8bd8769865c4765f9b6dabc6cdba933413e369ba83feb43"}
Jul 14 07:55:16.512627 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:16.512534    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:16.528356 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:16.528295    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-mk4zk" podStartSLOduration=1.5406825 podStartE2EDuration="5.528272757s" totalImagesPullingTime="3.987590257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:16.526592891 +0000 UTC m=+339.268510760" watchObservedRunningTime="2026-07-14 07:55:16.528272757 +0000 UTC m=+339.270190626"
Jul 14 07:55:16.542079 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:16.542027    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs" podStartSLOduration=1.333270605 podStartE2EDuration="4.54198203s" totalImagesPullingTime="3.208711425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:16.541757359 +0000 UTC m=+339.283675230" watchObservedRunningTime="2026-07-14 07:55:16.54198203 +0000 UTC m=+339.283899900"
Jul 14 07:55:18.126079 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:18.126042    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 07:55:18.126358 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:18.126112    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 07:55:18.524469 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:18.524433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-96rxz" event={"ID":"600f7953-d367-4df7-9534-415ed48d88c4","Type":"ContainerStarted","Data":"a65c7295fcdbf3c2a4da4bbb6d25c48477a637bd532ffc98d2ef90aca8212175"}
Jul 14 07:55:18.524643 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:18.524535    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:18.526234 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:18.526202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8" event={"ID":"aafc0383-339a-4183-8ee4-ca6b4bf09092","Type":"ContainerStarted","Data":"b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90"}
Jul 14 07:55:18.526338 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:18.526248    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:18.562991 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:18.562929    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-96rxz" podStartSLOduration=2.437320632 podStartE2EDuration="5.562907081s" totalImagesPullingTime="3.125586449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:18.554595788 +0000 UTC m=+341.296513658" watchObservedRunningTime="2026-07-14 07:55:18.562907081 +0000 UTC m=+341.304824953"
Jul 14 07:55:19.532551 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:19.532516    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xkzb8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 07:55:19.533027 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:19.532574    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8" podUID="aafc0383-339a-4183-8ee4-ca6b4bf09092" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 07:55:22.531812 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:22.531778    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:22.602758 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:22.602700    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8" podStartSLOduration=5.142004901 podStartE2EDuration="9.602684053s" totalImagesPullingTime="4.460679152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:18.606500046 +0000 UTC m=+341.348417914" watchObservedRunningTime="2026-07-14 07:55:22.602684053 +0000 UTC m=+345.344601920"
Jul 14 07:55:23.051542 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.051509    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"]
Jul 14 07:55:23.055426 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.055391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:55:23.058361 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.058338    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 14 07:55:23.058921 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.058899    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8vdnt\""
Jul 14 07:55:23.070699 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.070671    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"]
Jul 14 07:55:23.163601 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.163552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6423a520-7044-4556-a277-d23dde708377-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l8kmz\" (UID: \"6423a520-7044-4556-a277-d23dde708377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:55:23.163794 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.163618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86zwj\" (UniqueName: \"kubernetes.io/projected/6423a520-7044-4556-a277-d23dde708377-kube-api-access-86zwj\") pod \"llmisvc-controller-manager-777c6bd7d5-l8kmz\" (UID: \"6423a520-7044-4556-a277-d23dde708377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:55:23.264418 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.264379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86zwj\" (UniqueName: \"kubernetes.io/projected/6423a520-7044-4556-a277-d23dde708377-kube-api-access-86zwj\") pod \"llmisvc-controller-manager-777c6bd7d5-l8kmz\" (UID: \"6423a520-7044-4556-a277-d23dde708377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:55:23.264690 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.264455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6423a520-7044-4556-a277-d23dde708377-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l8kmz\" (UID: \"6423a520-7044-4556-a277-d23dde708377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:55:23.267224 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.267193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6423a520-7044-4556-a277-d23dde708377-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l8kmz\" (UID: \"6423a520-7044-4556-a277-d23dde708377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:55:23.279218 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.279190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86zwj\" (UniqueName: \"kubernetes.io/projected/6423a520-7044-4556-a277-d23dde708377-kube-api-access-86zwj\") pod \"llmisvc-controller-manager-777c6bd7d5-l8kmz\" (UID: \"6423a520-7044-4556-a277-d23dde708377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:55:23.370184 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.370086    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:55:23.542946 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.542913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"]
Jul 14 07:55:23.559644 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:23.559609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz" event={"ID":"6423a520-7044-4556-a277-d23dde708377","Type":"ContainerStarted","Data":"5e41375164c9d094552118013be032abaef225948caf69490ac62bce964bd1db"}
Jul 14 07:55:25.026727 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.026694    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"]
Jul 14 07:55:25.027158 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.026889    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8" podUID="aafc0383-339a-4183-8ee4-ca6b4bf09092" containerName="discovery" containerID="cri-o://b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90" gracePeriod=30
Jul 14 07:55:25.306100 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.306076    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:25.384631 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.384505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-dns-cert\") pod \"aafc0383-339a-4183-8ee4-ca6b4bf09092\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") "
Jul 14 07:55:25.384631 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.384559    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7qfc\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-kube-api-access-b7qfc\") pod \"aafc0383-339a-4183-8ee4-ca6b4bf09092\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") "
Jul 14 07:55:25.384631 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.384589    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-ca-configmap\") pod \"aafc0383-339a-4183-8ee4-ca6b4bf09092\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") "
Jul 14 07:55:25.385371 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.385326    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "aafc0383-339a-4183-8ee4-ca6b4bf09092" (UID: "aafc0383-339a-4183-8ee4-ca6b4bf09092"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:55:25.386662 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.385554    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafc0383-339a-4183-8ee4-ca6b4bf09092-local-certs\") pod \"aafc0383-339a-4183-8ee4-ca6b4bf09092\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") "
Jul 14 07:55:25.386662 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.385597    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-cacerts\") pod \"aafc0383-339a-4183-8ee4-ca6b4bf09092\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") "
Jul 14 07:55:25.386662 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.385643    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-token\") pod \"aafc0383-339a-4183-8ee4-ca6b4bf09092\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") "
Jul 14 07:55:25.386662 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.385665    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-kubeconfig\") pod \"aafc0383-339a-4183-8ee4-ca6b4bf09092\" (UID: \"aafc0383-339a-4183-8ee4-ca6b4bf09092\") "
Jul 14 07:55:25.386662 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.385919    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-ca-configmap\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:55:25.391280 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.391226    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-cacerts" (OuterVolumeSpecName: "cacerts") pod "aafc0383-339a-4183-8ee4-ca6b4bf09092" (UID: "aafc0383-339a-4183-8ee4-ca6b4bf09092"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:55:25.391575 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.391522    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "aafc0383-339a-4183-8ee4-ca6b4bf09092" (UID: "aafc0383-339a-4183-8ee4-ca6b4bf09092"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:55:25.393025 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.392983    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-kube-api-access-b7qfc" (OuterVolumeSpecName: "kube-api-access-b7qfc") pod "aafc0383-339a-4183-8ee4-ca6b4bf09092" (UID: "aafc0383-339a-4183-8ee4-ca6b4bf09092"). InnerVolumeSpecName "kube-api-access-b7qfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:55:25.393119 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.393037    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-token" (OuterVolumeSpecName: "istio-token") pod "aafc0383-339a-4183-8ee4-ca6b4bf09092" (UID: "aafc0383-339a-4183-8ee4-ca6b4bf09092"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:55:25.393806 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.393771    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aafc0383-339a-4183-8ee4-ca6b4bf09092-local-certs" (OuterVolumeSpecName: "local-certs") pod "aafc0383-339a-4183-8ee4-ca6b4bf09092" (UID: "aafc0383-339a-4183-8ee4-ca6b4bf09092"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 07:55:25.394284 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.394259    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "aafc0383-339a-4183-8ee4-ca6b4bf09092" (UID: "aafc0383-339a-4183-8ee4-ca6b4bf09092"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:55:25.487176 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.487140    2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafc0383-339a-4183-8ee4-ca6b4bf09092-local-certs\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:55:25.487176 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.487176    2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-cacerts\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:55:25.487392 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.487190    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-token\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:55:25.487392 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.487205    2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-kubeconfig\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:55:25.487392 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.487218    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aafc0383-339a-4183-8ee4-ca6b4bf09092-istio-csr-dns-cert\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:55:25.487392 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.487232    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7qfc\" (UniqueName: \"kubernetes.io/projected/aafc0383-339a-4183-8ee4-ca6b4bf09092-kube-api-access-b7qfc\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:55:25.570310 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.570233    2562 generic.go:356] "Generic (PLEG): container finished" podID="aafc0383-339a-4183-8ee4-ca6b4bf09092" containerID="b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90" exitCode=0
Jul 14 07:55:25.570310 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.570298    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"
Jul 14 07:55:25.570482 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.570310    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8" event={"ID":"aafc0383-339a-4183-8ee4-ca6b4bf09092","Type":"ContainerDied","Data":"b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90"}
Jul 14 07:55:25.570482 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.570372    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8" event={"ID":"aafc0383-339a-4183-8ee4-ca6b4bf09092","Type":"ContainerDied","Data":"7763d1dfc706a31739db0a83eadab9246373d1fd17f6174fd05357a4acdd0c51"}
Jul 14 07:55:25.570482 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.570391    2562 scope.go:117] "RemoveContainer" containerID="b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90"
Jul 14 07:55:25.578867 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.578848    2562 scope.go:117] "RemoveContainer" containerID="b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90"
Jul 14 07:55:25.579126 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:55:25.579107    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90\": container with ID starting with b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90 not found: ID does not exist" containerID="b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90"
Jul 14 07:55:25.579184 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.579135    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90"} err="failed to get container status \"b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90\": rpc error: code = NotFound desc = could not find container \"b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90\": container with ID starting with b236aff9a4a341fdf7ae3a0138f3762ce46861f5673c7bf2a76845fbbeda0e90 not found: ID does not exist"
Jul 14 07:55:25.592811 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.592787    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"]
Jul 14 07:55:25.597208 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.597190    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xkzb8"]
Jul 14 07:55:25.700021 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:25.699975    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aafc0383-339a-4183-8ee4-ca6b4bf09092" path="/var/lib/kubelet/pods/aafc0383-339a-4183-8ee4-ca6b4bf09092/volumes"
Jul 14 07:55:27.521085 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:27.521054    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mjxgs"
Jul 14 07:55:27.583708 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:27.583672    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz" event={"ID":"6423a520-7044-4556-a277-d23dde708377","Type":"ContainerStarted","Data":"07f01d8dffa451ff5f949d58c65548f9920d3a2e8cc299705a34a6e329060334"}
Jul 14 07:55:27.583878 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:27.583845    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:55:27.599370 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:27.599328    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz" podStartSLOduration=1.442038628 podStartE2EDuration="4.599313131s" totalImagesPullingTime="3.157274503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:27.598443862 +0000 UTC m=+350.340361732" watchObservedRunningTime="2026-07-14 07:55:27.599313131 +0000 UTC m=+350.341230998"
Jul 14 07:55:29.536612 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:29.536498    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-96rxz"
Jul 14 07:55:58.590161 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:55:58.590129    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l8kmz"
Jul 14 07:56:12.091964 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.091931    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sq6kq"]
Jul 14 07:56:12.092419 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.092286    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aafc0383-339a-4183-8ee4-ca6b4bf09092" containerName="discovery"
Jul 14 07:56:12.092419 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.092298    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aafc0383-339a-4183-8ee4-ca6b4bf09092" containerName="discovery"
Jul 14 07:56:12.092419 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.092356    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aafc0383-339a-4183-8ee4-ca6b4bf09092" containerName="discovery"
Jul 14 07:56:12.095334 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.095315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq"
Jul 14 07:56:12.098182 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.098163    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 07:56:12.098304 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.098167    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-f67lr\""
Jul 14 07:56:12.098304 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.098198    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 07:56:12.104144 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.104123    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sq6kq"]
Jul 14 07:56:12.184918 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.184886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb4ht\" (UniqueName: \"kubernetes.io/projected/3dea1d79-81c5-446e-b6af-6e2d84c74f86-kube-api-access-fb4ht\") pod \"kuadrant-operator-catalog-sq6kq\" (UID: \"3dea1d79-81c5-446e-b6af-6e2d84c74f86\") " pod="kuadrant-system/kuadrant-operator-catalog-sq6kq"
Jul 14 07:56:12.285548 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.285510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4ht\" (UniqueName: \"kubernetes.io/projected/3dea1d79-81c5-446e-b6af-6e2d84c74f86-kube-api-access-fb4ht\") pod \"kuadrant-operator-catalog-sq6kq\" (UID: \"3dea1d79-81c5-446e-b6af-6e2d84c74f86\") " pod="kuadrant-system/kuadrant-operator-catalog-sq6kq"
Jul 14 07:56:12.294306 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.294277    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb4ht\" (UniqueName: \"kubernetes.io/projected/3dea1d79-81c5-446e-b6af-6e2d84c74f86-kube-api-access-fb4ht\") pod \"kuadrant-operator-catalog-sq6kq\" (UID: \"3dea1d79-81c5-446e-b6af-6e2d84c74f86\") " pod="kuadrant-system/kuadrant-operator-catalog-sq6kq"
Jul 14 07:56:12.405582 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.405484    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq"
Jul 14 07:56:12.455894 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.455859    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sq6kq"]
Jul 14 07:56:12.541917 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.541847    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sq6kq"]
Jul 14 07:56:12.545883 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:56:12.545856    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dea1d79_81c5_446e_b6af_6e2d84c74f86.slice/crio-b4d2f3242edef91e6df39c7232aa5d51790d6654c828fc9bf982e136e09242b7 WatchSource:0}: Error finding container b4d2f3242edef91e6df39c7232aa5d51790d6654c828fc9bf982e136e09242b7: Status 404 returned error can't find the container with id b4d2f3242edef91e6df39c7232aa5d51790d6654c828fc9bf982e136e09242b7
Jul 14 07:56:12.666345 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.666268    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7hvd"]
Jul 14 07:56:12.670703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.670680    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7hvd"
Jul 14 07:56:12.677380 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.677356    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7hvd"]
Jul 14 07:56:12.784508 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.784474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq" event={"ID":"3dea1d79-81c5-446e-b6af-6e2d84c74f86","Type":"ContainerStarted","Data":"b4d2f3242edef91e6df39c7232aa5d51790d6654c828fc9bf982e136e09242b7"}
Jul 14 07:56:12.789385 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.789365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbdwd\" (UniqueName: \"kubernetes.io/projected/581393fb-f6d2-4d43-9052-77f488bcf644-kube-api-access-xbdwd\") pod \"kuadrant-operator-catalog-l7hvd\" (UID: \"581393fb-f6d2-4d43-9052-77f488bcf644\") " pod="kuadrant-system/kuadrant-operator-catalog-l7hvd"
Jul 14 07:56:12.890663 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.890626    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbdwd\" (UniqueName: \"kubernetes.io/projected/581393fb-f6d2-4d43-9052-77f488bcf644-kube-api-access-xbdwd\") pod \"kuadrant-operator-catalog-l7hvd\" (UID: \"581393fb-f6d2-4d43-9052-77f488bcf644\") " pod="kuadrant-system/kuadrant-operator-catalog-l7hvd"
Jul 14 07:56:12.898756 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.898712    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbdwd\" (UniqueName: \"kubernetes.io/projected/581393fb-f6d2-4d43-9052-77f488bcf644-kube-api-access-xbdwd\") pod \"kuadrant-operator-catalog-l7hvd\" (UID: \"581393fb-f6d2-4d43-9052-77f488bcf644\") " pod="kuadrant-system/kuadrant-operator-catalog-l7hvd"
Jul 14 07:56:12.981828 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:12.981796    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7hvd"
Jul 14 07:56:13.114703 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:13.114539    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7hvd"]
Jul 14 07:56:13.117251 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:56:13.117222    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581393fb_f6d2_4d43_9052_77f488bcf644.slice/crio-9d2d084f24f6a13c9870e39985a5c65504b7f4f10b1b813926f898abee383302 WatchSource:0}: Error finding container 9d2d084f24f6a13c9870e39985a5c65504b7f4f10b1b813926f898abee383302: Status 404 returned error can't find the container with id 9d2d084f24f6a13c9870e39985a5c65504b7f4f10b1b813926f898abee383302
Jul 14 07:56:13.790611 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:13.790576    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7hvd" event={"ID":"581393fb-f6d2-4d43-9052-77f488bcf644","Type":"ContainerStarted","Data":"9d2d084f24f6a13c9870e39985a5c65504b7f4f10b1b813926f898abee383302"}
Jul 14 07:56:15.802083 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:15.802045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq" event={"ID":"3dea1d79-81c5-446e-b6af-6e2d84c74f86","Type":"ContainerStarted","Data":"99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661"}
Jul 14 07:56:15.802572 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:15.802107    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq" podUID="3dea1d79-81c5-446e-b6af-6e2d84c74f86" containerName="registry-server" containerID="cri-o://99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661" gracePeriod=2
Jul 14 07:56:15.803653 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:15.803628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7hvd" event={"ID":"581393fb-f6d2-4d43-9052-77f488bcf644","Type":"ContainerStarted","Data":"6c5873022d1a724005af6f9f3c4f0484b7c1005796cc8a45639c78260f510e23"}
Jul 14 07:56:15.819203 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:15.819163    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq" podStartSLOduration=1.4657626320000001 podStartE2EDuration="3.819147896s" totalImagesPullingTime="2.353385264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:56:15.816743762 +0000 UTC m=+398.558661630" watchObservedRunningTime="2026-07-14 07:56:15.819147896 +0000 UTC m=+398.561065764"
Jul 14 07:56:15.831958 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:15.831915    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l7hvd" podStartSLOduration=2.029626548 podStartE2EDuration="3.831902145s" totalImagesPullingTime="1.802275597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:56:15.831099299 +0000 UTC m=+398.573017168" watchObservedRunningTime="2026-07-14 07:56:15.831902145 +0000 UTC m=+398.573820042"
Jul 14 07:56:16.048412 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.048384    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq"
Jul 14 07:56:16.118878 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.118783    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb4ht\" (UniqueName: \"kubernetes.io/projected/3dea1d79-81c5-446e-b6af-6e2d84c74f86-kube-api-access-fb4ht\") pod \"3dea1d79-81c5-446e-b6af-6e2d84c74f86\" (UID: \"3dea1d79-81c5-446e-b6af-6e2d84c74f86\") "
Jul 14 07:56:16.120918 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.120891    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dea1d79-81c5-446e-b6af-6e2d84c74f86-kube-api-access-fb4ht" (OuterVolumeSpecName: "kube-api-access-fb4ht") pod "3dea1d79-81c5-446e-b6af-6e2d84c74f86" (UID: "3dea1d79-81c5-446e-b6af-6e2d84c74f86"). InnerVolumeSpecName "kube-api-access-fb4ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:56:16.219580 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.219525    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb4ht\" (UniqueName: \"kubernetes.io/projected/3dea1d79-81c5-446e-b6af-6e2d84c74f86-kube-api-access-fb4ht\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:56:16.809218 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.809183    2562 generic.go:356] "Generic (PLEG): container finished" podID="3dea1d79-81c5-446e-b6af-6e2d84c74f86" containerID="99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661" exitCode=0
Jul 14 07:56:16.809635 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.809224    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq"
Jul 14 07:56:16.809635 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.809271    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq" event={"ID":"3dea1d79-81c5-446e-b6af-6e2d84c74f86","Type":"ContainerDied","Data":"99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661"}
Jul 14 07:56:16.809635 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.809325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sq6kq" event={"ID":"3dea1d79-81c5-446e-b6af-6e2d84c74f86","Type":"ContainerDied","Data":"b4d2f3242edef91e6df39c7232aa5d51790d6654c828fc9bf982e136e09242b7"}
Jul 14 07:56:16.809635 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.809354    2562 scope.go:117] "RemoveContainer" containerID="99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661"
Jul 14 07:56:16.818130 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.818112    2562 scope.go:117] "RemoveContainer" containerID="99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661"
Jul 14 07:56:16.818377 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:56:16.818360    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661\": container with ID starting with 99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661 not found: ID does not exist" containerID="99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661"
Jul 14 07:56:16.818417 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.818386    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661"} err="failed to get container status \"99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661\": rpc error: code = NotFound desc = could not find container \"99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661\": container with ID starting with 99c056a2631ea1655d716e59b22bebb19927ca76da4c2ec300c6fed2fa550661 not found: ID does not exist"
Jul 14 07:56:16.830385 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.830353    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sq6kq"]
Jul 14 07:56:16.835239 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:16.835219    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sq6kq"]
Jul 14 07:56:17.700683 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:17.700648    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dea1d79-81c5-446e-b6af-6e2d84c74f86" path="/var/lib/kubelet/pods/3dea1d79-81c5-446e-b6af-6e2d84c74f86/volumes"
Jul 14 07:56:22.982242 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:22.982200    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-l7hvd"
Jul 14 07:56:22.982756 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:22.982266    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-l7hvd"
Jul 14 07:56:23.004830 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:23.004802    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-l7hvd"
Jul 14 07:56:23.862776 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:23.862744    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-l7hvd"
Jul 14 07:56:39.714069 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.714035    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c475986b-ncg8s"]
Jul 14 07:56:39.714448 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.714368    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dea1d79-81c5-446e-b6af-6e2d84c74f86" containerName="registry-server"
Jul 14 07:56:39.714448 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.714378    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dea1d79-81c5-446e-b6af-6e2d84c74f86" containerName="registry-server"
Jul 14 07:56:39.714448 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.714432    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dea1d79-81c5-446e-b6af-6e2d84c74f86" containerName="registry-server"
Jul 14 07:56:39.721821 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.721802    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.727857 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.727837    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 07:56:39.729140 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.729105    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 07:56:39.729257 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.729191    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xjbc6\""
Jul 14 07:56:39.729257 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.729228    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 07:56:39.729365 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.729191    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 07:56:39.729365 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.729312    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 07:56:39.733851 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.733831    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 07:56:39.739947 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.739923    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c475986b-ncg8s"]
Jul 14 07:56:39.814900 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.814867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1cb67da-ee00-4731-8418-e08a9c83901d-console-serving-cert\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.814900 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.814899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-service-ca\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.815142 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.814929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1cb67da-ee00-4731-8418-e08a9c83901d-console-oauth-config\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.815142 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.815017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-console-config\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.815142 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.815051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2krf6\" (UniqueName: \"kubernetes.io/projected/d1cb67da-ee00-4731-8418-e08a9c83901d-kube-api-access-2krf6\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.815261 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.815148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-trusted-ca-bundle\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.815261 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.815193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-oauth-serving-cert\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.915803 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.915767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1cb67da-ee00-4731-8418-e08a9c83901d-console-oauth-config\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.915973 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.915819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-console-config\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.915973 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.915850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2krf6\" (UniqueName: \"kubernetes.io/projected/d1cb67da-ee00-4731-8418-e08a9c83901d-kube-api-access-2krf6\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.915973 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.915926    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-trusted-ca-bundle\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.915973 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.915949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-oauth-serving-cert\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.916217 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.915987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1cb67da-ee00-4731-8418-e08a9c83901d-console-serving-cert\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.916217 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.916025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-service-ca\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.916645 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.916621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-oauth-serving-cert\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.916744 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.916621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-console-config\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.916744 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.916716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-service-ca\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.917301 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.917280    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1cb67da-ee00-4731-8418-e08a9c83901d-trusted-ca-bundle\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.918339 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.918312    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1cb67da-ee00-4731-8418-e08a9c83901d-console-oauth-config\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.918510 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.918493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1cb67da-ee00-4731-8418-e08a9c83901d-console-serving-cert\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:39.924157 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:39.924135    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2krf6\" (UniqueName: \"kubernetes.io/projected/d1cb67da-ee00-4731-8418-e08a9c83901d-kube-api-access-2krf6\") pod \"console-84c475986b-ncg8s\" (UID: \"d1cb67da-ee00-4731-8418-e08a9c83901d\") " pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:40.031995 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:40.031910    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:40.184229 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:40.184204    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c475986b-ncg8s"]
Jul 14 07:56:40.186942 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:56:40.186915    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1cb67da_ee00_4731_8418_e08a9c83901d.slice/crio-580362119a9011c0875878afdbb608c1bb385b2a567de93064554c7c970d2cf4 WatchSource:0}: Error finding container 580362119a9011c0875878afdbb608c1bb385b2a567de93064554c7c970d2cf4: Status 404 returned error can't find the container with id 580362119a9011c0875878afdbb608c1bb385b2a567de93064554c7c970d2cf4
Jul 14 07:56:40.922891 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:40.922854    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c475986b-ncg8s" event={"ID":"d1cb67da-ee00-4731-8418-e08a9c83901d","Type":"ContainerStarted","Data":"2ab1eba39024cfe89bb6cd43f4ad551d9aea383ec2d592a7cc543bf32b4c8210"}
Jul 14 07:56:40.923249 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:40.922913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c475986b-ncg8s" event={"ID":"d1cb67da-ee00-4731-8418-e08a9c83901d","Type":"ContainerStarted","Data":"580362119a9011c0875878afdbb608c1bb385b2a567de93064554c7c970d2cf4"}
Jul 14 07:56:40.944399 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:40.944353    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c475986b-ncg8s" podStartSLOduration=1.944339735 podStartE2EDuration="1.944339735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:56:40.942670319 +0000 UTC m=+423.684588188" watchObservedRunningTime="2026-07-14 07:56:40.944339735 +0000 UTC m=+423.686257602"
Jul 14 07:56:44.863099 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:44.863061    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"]
Jul 14 07:56:44.867864 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:44.867840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:56:44.871714 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:44.871690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-brnjk\""
Jul 14 07:56:44.882623 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:44.882601    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"]
Jul 14 07:56:44.952363 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:44.952332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d08061f-610c-48a3-a0f1-d6d6d724a22f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" (UID: \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:56:44.952363 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:44.952367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8f7j\" (UniqueName: \"kubernetes.io/projected/3d08061f-610c-48a3-a0f1-d6d6d724a22f-kube-api-access-r8f7j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" (UID: \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:56:45.053468 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:45.053429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d08061f-610c-48a3-a0f1-d6d6d724a22f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" (UID: \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:56:45.053633 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:45.053487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8f7j\" (UniqueName: \"kubernetes.io/projected/3d08061f-610c-48a3-a0f1-d6d6d724a22f-kube-api-access-r8f7j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" (UID: \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:56:45.053793 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:45.053774    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d08061f-610c-48a3-a0f1-d6d6d724a22f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" (UID: \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:56:45.069747 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:45.069716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8f7j\" (UniqueName: \"kubernetes.io/projected/3d08061f-610c-48a3-a0f1-d6d6d724a22f-kube-api-access-r8f7j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" (UID: \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:56:45.177603 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:45.177516    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:56:45.326405 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:45.326340    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"]
Jul 14 07:56:45.329725 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:56:45.329695    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d08061f_610c_48a3_a0f1_d6d6d724a22f.slice/crio-9ba9a9329da2a4e30cb549950e9a812d181cc1734cadc083253429d018a211e7 WatchSource:0}: Error finding container 9ba9a9329da2a4e30cb549950e9a812d181cc1734cadc083253429d018a211e7: Status 404 returned error can't find the container with id 9ba9a9329da2a4e30cb549950e9a812d181cc1734cadc083253429d018a211e7
Jul 14 07:56:45.947306 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:45.947265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm" event={"ID":"3d08061f-610c-48a3-a0f1-d6d6d724a22f","Type":"ContainerStarted","Data":"9ba9a9329da2a4e30cb549950e9a812d181cc1734cadc083253429d018a211e7"}
Jul 14 07:56:47.472652 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.472595    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"]
Jul 14 07:56:47.476799 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.476778    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"
Jul 14 07:56:47.480071 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.480048    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7vrqh\""
Jul 14 07:56:47.490247 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.490224    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"]
Jul 14 07:56:47.576295 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.576257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzswt\" (UniqueName: \"kubernetes.io/projected/d7b9cb1c-2a51-48d0-bc43-a442578060da-kube-api-access-wzswt\") pod \"authorino-operator-75cc8d5cb7-kvcc7\" (UID: \"d7b9cb1c-2a51-48d0-bc43-a442578060da\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"
Jul 14 07:56:47.677633 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.677591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzswt\" (UniqueName: \"kubernetes.io/projected/d7b9cb1c-2a51-48d0-bc43-a442578060da-kube-api-access-wzswt\") pod \"authorino-operator-75cc8d5cb7-kvcc7\" (UID: \"d7b9cb1c-2a51-48d0-bc43-a442578060da\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"
Jul 14 07:56:47.689565 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.689528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzswt\" (UniqueName: \"kubernetes.io/projected/d7b9cb1c-2a51-48d0-bc43-a442578060da-kube-api-access-wzswt\") pod \"authorino-operator-75cc8d5cb7-kvcc7\" (UID: \"d7b9cb1c-2a51-48d0-bc43-a442578060da\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"
Jul 14 07:56:47.790893 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.790814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"
Jul 14 07:56:47.936974 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.936945    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"]
Jul 14 07:56:47.938810 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:56:47.938779    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b9cb1c_2a51_48d0_bc43_a442578060da.slice/crio-780095f110a8d76accc4da80beedf94d77a60d59d475ca478c7070f5995cb67e WatchSource:0}: Error finding container 780095f110a8d76accc4da80beedf94d77a60d59d475ca478c7070f5995cb67e: Status 404 returned error can't find the container with id 780095f110a8d76accc4da80beedf94d77a60d59d475ca478c7070f5995cb67e
Jul 14 07:56:47.960610 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:47.960581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7" event={"ID":"d7b9cb1c-2a51-48d0-bc43-a442578060da","Type":"ContainerStarted","Data":"780095f110a8d76accc4da80beedf94d77a60d59d475ca478c7070f5995cb67e"}
Jul 14 07:56:49.728759 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:49.728719    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"]
Jul 14 07:56:49.734139 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:49.734113    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"
Jul 14 07:56:49.737131 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:49.737106    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 14 07:56:49.737131 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:49.737123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vkf4m\""
Jul 14 07:56:49.743419 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:49.743365    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"]
Jul 14 07:56:49.794977 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:49.794938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2sgk\" (UniqueName: \"kubernetes.io/projected/c358115d-d67a-49d6-9443-58dedd885c3e-kube-api-access-x2sgk\") pod \"dns-operator-controller-manager-864dd78c4c-9hmd4\" (UID: \"c358115d-d67a-49d6-9443-58dedd885c3e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"
Jul 14 07:56:49.896269 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:49.896234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2sgk\" (UniqueName: \"kubernetes.io/projected/c358115d-d67a-49d6-9443-58dedd885c3e-kube-api-access-x2sgk\") pod \"dns-operator-controller-manager-864dd78c4c-9hmd4\" (UID: \"c358115d-d67a-49d6-9443-58dedd885c3e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"
Jul 14 07:56:49.908543 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:49.908508    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2sgk\" (UniqueName: \"kubernetes.io/projected/c358115d-d67a-49d6-9443-58dedd885c3e-kube-api-access-x2sgk\") pod \"dns-operator-controller-manager-864dd78c4c-9hmd4\" (UID: \"c358115d-d67a-49d6-9443-58dedd885c3e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"
Jul 14 07:56:50.032474 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:50.032392    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:50.032474 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:50.032456    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:50.038112 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:50.038086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:50.047286 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:50.047264    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"
Jul 14 07:56:50.982493 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:50.982458    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c475986b-ncg8s"
Jul 14 07:56:51.538573 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:51.538549    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"]
Jul 14 07:56:51.540672 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:56:51.540643    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc358115d_d67a_49d6_9443_58dedd885c3e.slice/crio-6c836422fce7788db8d6d8ed96c83917fdb2d883f7a4e209f685811383b8335c WatchSource:0}: Error finding container 6c836422fce7788db8d6d8ed96c83917fdb2d883f7a4e209f685811383b8335c: Status 404 returned error can't find the container with id 6c836422fce7788db8d6d8ed96c83917fdb2d883f7a4e209f685811383b8335c
Jul 14 07:56:51.984158 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:51.984120    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm" event={"ID":"3d08061f-610c-48a3-a0f1-d6d6d724a22f","Type":"ContainerStarted","Data":"8651f795968c64e02103a29a50e52d2f56f1061c5d168270c7c6fbc0dc27e4d6"}
Jul 14 07:56:51.984648 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:51.984241    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:56:51.985817 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:51.985789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7" event={"ID":"d7b9cb1c-2a51-48d0-bc43-a442578060da","Type":"ContainerStarted","Data":"c5f53d6f81130ad9569d429b60122bb3968cd089c047b8a761f82283534e5f1f"}
Jul 14 07:56:51.985961 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:51.985868    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"
Jul 14 07:56:51.987071 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:51.987050    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4" event={"ID":"c358115d-d67a-49d6-9443-58dedd885c3e","Type":"ContainerStarted","Data":"6c836422fce7788db8d6d8ed96c83917fdb2d883f7a4e209f685811383b8335c"}
Jul 14 07:56:52.009635 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.009583    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm" podStartSLOduration=1.930891948 podStartE2EDuration="8.009568846s" totalImagesPullingTime="6.078676898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:56:52.007233929 +0000 UTC m=+434.749151798" watchObservedRunningTime="2026-07-14 07:56:52.009568846 +0000 UTC m=+434.751486714"
Jul 14 07:56:52.016331 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.016294    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"]
Jul 14 07:56:52.020491 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.020470    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:56:52.023385 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.023365    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9rjpf\""
Jul 14 07:56:52.030395 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.030372    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"]
Jul 14 07:56:52.032830 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.032789    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7" podStartSLOduration=1.576375056 podStartE2EDuration="5.03277608s" totalImagesPullingTime="3.456401024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:56:52.031226074 +0000 UTC m=+434.773143943" watchObservedRunningTime="2026-07-14 07:56:52.03277608 +0000 UTC m=+434.774693949"
Jul 14 07:56:52.119023 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.118974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkfzv\" (UniqueName: \"kubernetes.io/projected/288269d3-997d-4e99-8c11-5c7cb715b8da-kube-api-access-nkfzv\") pod \"limitador-operator-controller-manager-859d7b78bd-vwxkx\" (UID: \"288269d3-997d-4e99-8c11-5c7cb715b8da\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:56:52.219874 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.219808    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkfzv\" (UniqueName: \"kubernetes.io/projected/288269d3-997d-4e99-8c11-5c7cb715b8da-kube-api-access-nkfzv\") pod \"limitador-operator-controller-manager-859d7b78bd-vwxkx\" (UID: \"288269d3-997d-4e99-8c11-5c7cb715b8da\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:56:52.229106 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.229072    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkfzv\" (UniqueName: \"kubernetes.io/projected/288269d3-997d-4e99-8c11-5c7cb715b8da-kube-api-access-nkfzv\") pod \"limitador-operator-controller-manager-859d7b78bd-vwxkx\" (UID: \"288269d3-997d-4e99-8c11-5c7cb715b8da\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:56:52.332437 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.332329    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:56:52.687771 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.687733    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"]
Jul 14 07:56:52.739443 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:56:52.739397    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288269d3_997d_4e99_8c11_5c7cb715b8da.slice/crio-1bbc00a68475ada76e66aeef63be9060e9fcf3fdb6c266b1e89590920f793def WatchSource:0}: Error finding container 1bbc00a68475ada76e66aeef63be9060e9fcf3fdb6c266b1e89590920f793def: Status 404 returned error can't find the container with id 1bbc00a68475ada76e66aeef63be9060e9fcf3fdb6c266b1e89590920f793def
Jul 14 07:56:52.994364 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:52.994328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx" event={"ID":"288269d3-997d-4e99-8c11-5c7cb715b8da","Type":"ContainerStarted","Data":"1bbc00a68475ada76e66aeef63be9060e9fcf3fdb6c266b1e89590920f793def"}
Jul 14 07:56:54.001256 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:54.001200    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4" event={"ID":"c358115d-d67a-49d6-9443-58dedd885c3e","Type":"ContainerStarted","Data":"3e38eac5b65a402b16e5acd1a2dac0b464fd8b4c98eca940faa64a445f44c6ca"}
Jul 14 07:56:54.001661 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:54.001344    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"
Jul 14 07:56:54.023356 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:54.023293    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4" podStartSLOduration=2.945915932 podStartE2EDuration="5.023271992s" totalImagesPullingTime="2.07735606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:56:54.020383402 +0000 UTC m=+436.762301272" watchObservedRunningTime="2026-07-14 07:56:54.023271992 +0000 UTC m=+436.765189860"
Jul 14 07:56:55.008000 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:55.007963    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx" event={"ID":"288269d3-997d-4e99-8c11-5c7cb715b8da","Type":"ContainerStarted","Data":"7aabbac4b7208d12261154b1481a60474c0193cddf31cebcc4b166f7d0ec2986"}
Jul 14 07:56:55.008435 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:55.008145    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:56:55.025283 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:56:55.025234    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx" podStartSLOduration=2.157854186 podStartE2EDuration="4.025216829s" totalImagesPullingTime="1.867362643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:56:55.024424376 +0000 UTC m=+437.766342257" watchObservedRunningTime="2026-07-14 07:56:55.025216829 +0000 UTC m=+437.767134697"
Jul 14 07:57:02.996892 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:02.996823    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kvcc7"
Jul 14 07:57:02.997264 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:02.996896    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:57:04.752268 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.752235    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"]
Jul 14 07:57:04.752746 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.752446    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" containerName="manager" containerID="cri-o://8651f795968c64e02103a29a50e52d2f56f1061c5d168270c7c6fbc0dc27e4d6" gracePeriod=2
Jul 14 07:57:04.763411 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.763385    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"]
Jul 14 07:57:04.781463 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.781438    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"]
Jul 14 07:57:04.781827 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.781810    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" containerName="manager"
Jul 14 07:57:04.781827 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.781825    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" containerName="manager"
Jul 14 07:57:04.781961 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.781910    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" containerName="manager"
Jul 14 07:57:04.785100 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.785079    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:04.802033 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.801995    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"]
Jul 14 07:57:04.817976 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.817951    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"]
Jul 14 07:57:04.818190 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.818159    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx" podUID="288269d3-997d-4e99-8c11-5c7cb715b8da" containerName="manager" containerID="cri-o://7aabbac4b7208d12261154b1481a60474c0193cddf31cebcc4b166f7d0ec2986" gracePeriod=2
Jul 14 07:57:04.820154 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.820134    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:57:04.824190 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:04.824156    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:57:04.832334 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.832311    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"]
Jul 14 07:57:04.834676 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:04.834648    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:57:04.836453 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.836434    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"]
Jul 14 07:57:04.836567 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.836549    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:04.837405 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.837288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqq5q\" (UID: \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:04.837405 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.837370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9kb2\" (UniqueName: \"kubernetes.io/projected/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-kube-api-access-j9kb2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqq5q\" (UID: \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:04.868839 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.868814    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"]
Jul 14 07:57:04.893351 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:04.893308    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:57:04.895753 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:04.895725    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vwxkx\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="288269d3-997d-4e99-8c11-5c7cb715b8da" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:57:04.938687 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.938647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqq5q\" (UID: \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:04.938795 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.938761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9kb2\" (UniqueName: \"kubernetes.io/projected/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-kube-api-access-j9kb2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqq5q\" (UID: \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:04.938869 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.938848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/696736aa-a47f-4871-954e-c202ac38000f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7k4cc\" (UID: \"696736aa-a47f-4871-954e-c202ac38000f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:04.938926 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.938893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njwlp\" (UniqueName: \"kubernetes.io/projected/696736aa-a47f-4871-954e-c202ac38000f-kube-api-access-njwlp\") pod \"kuadrant-operator-controller-manager-86878c769f-7k4cc\" (UID: \"696736aa-a47f-4871-954e-c202ac38000f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:04.939080 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.939049    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqq5q\" (UID: \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:04.950758 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:04.950729    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9kb2\" (UniqueName: \"kubernetes.io/projected/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-kube-api-access-j9kb2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqq5q\" (UID: \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:05.010779 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.010747    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hmd4"
Jul 14 07:57:05.013682 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:05.013642    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:57:05.039482 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.039450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/696736aa-a47f-4871-954e-c202ac38000f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7k4cc\" (UID: \"696736aa-a47f-4871-954e-c202ac38000f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:05.039640 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.039490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njwlp\" (UniqueName: \"kubernetes.io/projected/696736aa-a47f-4871-954e-c202ac38000f-kube-api-access-njwlp\") pod \"kuadrant-operator-controller-manager-86878c769f-7k4cc\" (UID: \"696736aa-a47f-4871-954e-c202ac38000f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:05.039903 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.039856    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/696736aa-a47f-4871-954e-c202ac38000f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7k4cc\" (UID: \"696736aa-a47f-4871-954e-c202ac38000f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:05.042186 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:05.042152    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vwxkx\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="288269d3-997d-4e99-8c11-5c7cb715b8da" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:57:05.058917 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.058889    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njwlp\" (UniqueName: \"kubernetes.io/projected/696736aa-a47f-4871-954e-c202ac38000f-kube-api-access-njwlp\") pod \"kuadrant-operator-controller-manager-86878c769f-7k4cc\" (UID: \"696736aa-a47f-4871-954e-c202ac38000f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:05.061915 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.061891    2562 generic.go:356] "Generic (PLEG): container finished" podID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" containerID="8651f795968c64e02103a29a50e52d2f56f1061c5d168270c7c6fbc0dc27e4d6" exitCode=0
Jul 14 07:57:05.062050 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.061965    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ba9a9329da2a4e30cb549950e9a812d181cc1734cadc083253429d018a211e7"
Jul 14 07:57:05.063720 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.063695    2562 generic.go:356] "Generic (PLEG): container finished" podID="288269d3-997d-4e99-8c11-5c7cb715b8da" containerID="7aabbac4b7208d12261154b1481a60474c0193cddf31cebcc4b166f7d0ec2986" exitCode=0
Jul 14 07:57:05.068416 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.068391    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:57:05.070750 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.070730    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:57:05.071361 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:05.071340    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vwxkx\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="288269d3-997d-4e99-8c11-5c7cb715b8da" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:57:05.073879 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:05.073853    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:57:05.076604 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:05.076578    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kvkrm\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:57:05.080073 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:05.079995    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vwxkx\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="288269d3-997d-4e99-8c11-5c7cb715b8da" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:57:05.125010 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.124971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:05.140820 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.140789    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d08061f-610c-48a3-a0f1-d6d6d724a22f-extensions-socket-volume\") pod \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\" (UID: \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\") "
Jul 14 07:57:05.140935 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.140832    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkfzv\" (UniqueName: \"kubernetes.io/projected/288269d3-997d-4e99-8c11-5c7cb715b8da-kube-api-access-nkfzv\") pod \"288269d3-997d-4e99-8c11-5c7cb715b8da\" (UID: \"288269d3-997d-4e99-8c11-5c7cb715b8da\") "
Jul 14 07:57:05.140935 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.140903    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8f7j\" (UniqueName: \"kubernetes.io/projected/3d08061f-610c-48a3-a0f1-d6d6d724a22f-kube-api-access-r8f7j\") pod \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\" (UID: \"3d08061f-610c-48a3-a0f1-d6d6d724a22f\") "
Jul 14 07:57:05.141368 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.141340    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d08061f-610c-48a3-a0f1-d6d6d724a22f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3d08061f-610c-48a3-a0f1-d6d6d724a22f" (UID: "3d08061f-610c-48a3-a0f1-d6d6d724a22f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 07:57:05.142818 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.142799    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/288269d3-997d-4e99-8c11-5c7cb715b8da-kube-api-access-nkfzv" (OuterVolumeSpecName: "kube-api-access-nkfzv") pod "288269d3-997d-4e99-8c11-5c7cb715b8da" (UID: "288269d3-997d-4e99-8c11-5c7cb715b8da"). InnerVolumeSpecName "kube-api-access-nkfzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:57:05.143350 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.143330    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d08061f-610c-48a3-a0f1-d6d6d724a22f-kube-api-access-r8f7j" (OuterVolumeSpecName: "kube-api-access-r8f7j") pod "3d08061f-610c-48a3-a0f1-d6d6d724a22f" (UID: "3d08061f-610c-48a3-a0f1-d6d6d724a22f"). InnerVolumeSpecName "kube-api-access-r8f7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:57:05.203641 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.203610    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:05.242393 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.242366    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8f7j\" (UniqueName: \"kubernetes.io/projected/3d08061f-610c-48a3-a0f1-d6d6d724a22f-kube-api-access-r8f7j\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:57:05.242393 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.242391    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d08061f-610c-48a3-a0f1-d6d6d724a22f-extensions-socket-volume\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:57:05.242596 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.242400    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkfzv\" (UniqueName: \"kubernetes.io/projected/288269d3-997d-4e99-8c11-5c7cb715b8da-kube-api-access-nkfzv\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:57:05.270037 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.269925    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"]
Jul 14 07:57:05.272285 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:57:05.272251    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17dea62a_c20f_4fd2_af3f_4dc4386ce2c7.slice/crio-03a5708acd2884f44a017c3ac52e23096e0d210b9cf5f63539cbd5e322ee69e6 WatchSource:0}: Error finding container 03a5708acd2884f44a017c3ac52e23096e0d210b9cf5f63539cbd5e322ee69e6: Status 404 returned error can't find the container with id 03a5708acd2884f44a017c3ac52e23096e0d210b9cf5f63539cbd5e322ee69e6
Jul 14 07:57:05.352394 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.352366    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"]
Jul 14 07:57:05.354466 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:57:05.354442    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696736aa_a47f_4871_954e_c202ac38000f.slice/crio-35128f34848d1bcedcda0532f3026755c5d35ba0293bf84d6f33ae50ffc83f57 WatchSource:0}: Error finding container 35128f34848d1bcedcda0532f3026755c5d35ba0293bf84d6f33ae50ffc83f57: Status 404 returned error can't find the container with id 35128f34848d1bcedcda0532f3026755c5d35ba0293bf84d6f33ae50ffc83f57
Jul 14 07:57:05.701528 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.701449    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="288269d3-997d-4e99-8c11-5c7cb715b8da" path="/var/lib/kubelet/pods/288269d3-997d-4e99-8c11-5c7cb715b8da/volumes"
Jul 14 07:57:05.701794 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:05.701782    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d08061f-610c-48a3-a0f1-d6d6d724a22f" path="/var/lib/kubelet/pods/3d08061f-610c-48a3-a0f1-d6d6d724a22f/volumes"
Jul 14 07:57:06.070508 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.070468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q" event={"ID":"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7","Type":"ContainerStarted","Data":"a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7"}
Jul 14 07:57:06.070938 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.070535    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:06.070938 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.070561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q" event={"ID":"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7","Type":"ContainerStarted","Data":"03a5708acd2884f44a017c3ac52e23096e0d210b9cf5f63539cbd5e322ee69e6"}
Jul 14 07:57:06.071792 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.071775    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxkx"
Jul 14 07:57:06.071880 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.071798    2562 scope.go:117] "RemoveContainer" containerID="7aabbac4b7208d12261154b1481a60474c0193cddf31cebcc4b166f7d0ec2986"
Jul 14 07:57:06.073588 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.073562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc" event={"ID":"696736aa-a47f-4871-954e-c202ac38000f","Type":"ContainerStarted","Data":"0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc"}
Jul 14 07:57:06.073692 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.073616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc" event={"ID":"696736aa-a47f-4871-954e-c202ac38000f","Type":"ContainerStarted","Data":"35128f34848d1bcedcda0532f3026755c5d35ba0293bf84d6f33ae50ffc83f57"}
Jul 14 07:57:06.073692 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.073662    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:06.073856 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.073840    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kvkrm"
Jul 14 07:57:06.117500 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.117446    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q" podStartSLOduration=2.117427229 podStartE2EDuration="2.117427229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:57:06.113751089 +0000 UTC m=+448.855668957" watchObservedRunningTime="2026-07-14 07:57:06.117427229 +0000 UTC m=+448.859345097"
Jul 14 07:57:06.148645 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:06.148591    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc" podStartSLOduration=2.148575186 podStartE2EDuration="2.148575186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:57:06.147369811 +0000 UTC m=+448.889287681" watchObservedRunningTime="2026-07-14 07:57:06.148575186 +0000 UTC m=+448.890493055"
Jul 14 07:57:17.082635 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.082605    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:17.083118 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.082682    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 07:57:17.164375 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.164343    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"]
Jul 14 07:57:17.164611 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.164572    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q" podUID="17dea62a-c20f-4fd2-af3f-4dc4386ce2c7" containerName="manager" containerID="cri-o://a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7" gracePeriod=10
Jul 14 07:57:17.421440 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.421415    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:17.554919 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.554886    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-extensions-socket-volume\") pod \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\" (UID: \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\") "
Jul 14 07:57:17.554919 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.554919    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9kb2\" (UniqueName: \"kubernetes.io/projected/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-kube-api-access-j9kb2\") pod \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\" (UID: \"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7\") "
Jul 14 07:57:17.555381 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.555349    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "17dea62a-c20f-4fd2-af3f-4dc4386ce2c7" (UID: "17dea62a-c20f-4fd2-af3f-4dc4386ce2c7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 07:57:17.557108 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.557074    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-kube-api-access-j9kb2" (OuterVolumeSpecName: "kube-api-access-j9kb2") pod "17dea62a-c20f-4fd2-af3f-4dc4386ce2c7" (UID: "17dea62a-c20f-4fd2-af3f-4dc4386ce2c7"). InnerVolumeSpecName "kube-api-access-j9kb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:57:17.655883 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.655792    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-extensions-socket-volume\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:57:17.655883 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:17.655824    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9kb2\" (UniqueName: \"kubernetes.io/projected/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7-kube-api-access-j9kb2\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:57:18.133321 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:18.133288    2562 generic.go:356] "Generic (PLEG): container finished" podID="17dea62a-c20f-4fd2-af3f-4dc4386ce2c7" containerID="a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7" exitCode=0
Jul 14 07:57:18.133736 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:18.133335    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"
Jul 14 07:57:18.133736 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:18.133357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q" event={"ID":"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7","Type":"ContainerDied","Data":"a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7"}
Jul 14 07:57:18.133736 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:18.133399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q" event={"ID":"17dea62a-c20f-4fd2-af3f-4dc4386ce2c7","Type":"ContainerDied","Data":"03a5708acd2884f44a017c3ac52e23096e0d210b9cf5f63539cbd5e322ee69e6"}
Jul 14 07:57:18.133736 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:18.133421    2562 scope.go:117] "RemoveContainer" containerID="a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7"
Jul 14 07:57:18.142768 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:18.142747    2562 scope.go:117] "RemoveContainer" containerID="a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7"
Jul 14 07:57:18.143051 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:18.143028    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7\": container with ID starting with a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7 not found: ID does not exist" containerID="a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7"
Jul 14 07:57:18.143107 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:18.143060    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7"} err="failed to get container status \"a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7\": rpc error: code = NotFound desc = could not find container \"a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7\": container with ID starting with a7c19fda393eb8a4bb3315c8ea0f9e772cd061c250c2a3eea50c3cfa4057f9d7 not found: ID does not exist"
Jul 14 07:57:18.154770 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:18.154737    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"]
Jul 14 07:57:18.159048 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:18.159027    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqq5q"]
Jul 14 07:57:19.700021 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:19.699984    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17dea62a-c20f-4fd2-af3f-4dc4386ce2c7" path="/var/lib/kubelet/pods/17dea62a-c20f-4fd2-af3f-4dc4386ce2c7/volumes"
Jul 14 07:57:33.651413 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.651383    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"]
Jul 14 07:57:33.651792 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.651772    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17dea62a-c20f-4fd2-af3f-4dc4386ce2c7" containerName="manager"
Jul 14 07:57:33.651792 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.651784    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="17dea62a-c20f-4fd2-af3f-4dc4386ce2c7" containerName="manager"
Jul 14 07:57:33.651871 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.651796    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="288269d3-997d-4e99-8c11-5c7cb715b8da" containerName="manager"
Jul 14 07:57:33.651871 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.651802    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="288269d3-997d-4e99-8c11-5c7cb715b8da" containerName="manager"
Jul 14 07:57:33.651938 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.651878    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="17dea62a-c20f-4fd2-af3f-4dc4386ce2c7" containerName="manager"
Jul 14 07:57:33.651938 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.651891    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="288269d3-997d-4e99-8c11-5c7cb715b8da" containerName="manager"
Jul 14 07:57:33.654965 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.654949    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.660586 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.660531    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 07:57:33.661247 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.661229    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jp7lk\""
Jul 14 07:57:33.674158 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.674136    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"]
Jul 14 07:57:33.698631 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.698607    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.698769 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.698643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.698769 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.698666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.698899 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.698770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9bw\" (UniqueName: \"kubernetes.io/projected/666d1f3a-e7e0-4abe-9171-75707dcfe080-kube-api-access-gj9bw\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.698899 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.698836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.698899 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.698892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/666d1f3a-e7e0-4abe-9171-75707dcfe080-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.699072 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.698922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.699072 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.698948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.699072 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.698985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800214 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800379 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/666d1f3a-e7e0-4abe-9171-75707dcfe080-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800379 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800379 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800379 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800583 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800638 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800593    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800638 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800749 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800749 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800649    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800938 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.800938 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9bw\" (UniqueName: \"kubernetes.io/projected/666d1f3a-e7e0-4abe-9171-75707dcfe080-kube-api-access-gj9bw\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.801135 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.800940    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.801135 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.801057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/666d1f3a-e7e0-4abe-9171-75707dcfe080-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.802941 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.802919    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.803050 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.803024    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.831680 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.831653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/666d1f3a-e7e0-4abe-9171-75707dcfe080-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.832364 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.832346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9bw\" (UniqueName: \"kubernetes.io/projected/666d1f3a-e7e0-4abe-9171-75707dcfe080-kube-api-access-gj9bw\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ts8gs\" (UID: \"666d1f3a-e7e0-4abe-9171-75707dcfe080\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:33.965495 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:33.965468    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:34.120396 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:34.120373    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"]
Jul 14 07:57:34.121709 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:57:34.121679    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666d1f3a_e7e0_4abe_9171_75707dcfe080.slice/crio-0d9c9e6d98d470523ff070e3934f33f97a52b5ca066466f018cd029c4a409197 WatchSource:0}: Error finding container 0d9c9e6d98d470523ff070e3934f33f97a52b5ca066466f018cd029c4a409197: Status 404 returned error can't find the container with id 0d9c9e6d98d470523ff070e3934f33f97a52b5ca066466f018cd029c4a409197
Jul 14 07:57:34.213108 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:34.213075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs" event={"ID":"666d1f3a-e7e0-4abe-9171-75707dcfe080","Type":"ContainerStarted","Data":"0d9c9e6d98d470523ff070e3934f33f97a52b5ca066466f018cd029c4a409197"}
Jul 14 07:57:36.348659 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:36.348620    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 07:57:36.348918 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:36.348696    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 07:57:36.348918 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:36.348724    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 07:57:37.232266 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:37.232233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs" event={"ID":"666d1f3a-e7e0-4abe-9171-75707dcfe080","Type":"ContainerStarted","Data":"de2de41cc60977342ffd1f4769a09e1667af0888608b273e9e450a99c4c6a99c"}
Jul 14 07:57:37.254545 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:37.254493    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs" podStartSLOduration=2.029866393 podStartE2EDuration="4.254477151s" totalImagesPullingTime="2.224610758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:57:37.252293971 +0000 UTC m=+479.994211840" watchObservedRunningTime="2026-07-14 07:57:37.254477151 +0000 UTC m=+479.996395051"
Jul 14 07:57:37.966214 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:37.966184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:37.970913 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:37.970891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:38.237043 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.236955    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:38.237996 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.237972    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:57:38.254488 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.254460    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8nv68"]
Jul 14 07:57:38.259098 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.259079    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:38.261669 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.261641    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 07:57:38.261752 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.261709    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7fh6g\""
Jul 14 07:57:38.265979 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.265960    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8nv68"]
Jul 14 07:57:38.340543 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.340503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl6lj\" (UniqueName: \"kubernetes.io/projected/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-kube-api-access-gl6lj\") pod \"limitador-limitador-64c94fd64f-8nv68\" (UID: \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:38.340707 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.340558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-config-file\") pod \"limitador-limitador-64c94fd64f-8nv68\" (UID: \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:38.357746 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.357717    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8nv68"]
Jul 14 07:57:38.441722 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.441687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl6lj\" (UniqueName: \"kubernetes.io/projected/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-kube-api-access-gl6lj\") pod \"limitador-limitador-64c94fd64f-8nv68\" (UID: \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:38.441891 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.441730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-config-file\") pod \"limitador-limitador-64c94fd64f-8nv68\" (UID: \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:38.442417 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.442398    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-config-file\") pod \"limitador-limitador-64c94fd64f-8nv68\" (UID: \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:38.450403 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.450375    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl6lj\" (UniqueName: \"kubernetes.io/projected/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-kube-api-access-gl6lj\") pod \"limitador-limitador-64c94fd64f-8nv68\" (UID: \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:38.572781 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.572704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:38.717903 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:38.717864    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8nv68"]
Jul 14 07:57:38.719892 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:57:38.719865    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9fdcb3b_6538_4b80_a287_e2b3ede432cb.slice/crio-0935dd808cd539d1404b5d1b2f217538eab75324b4609e02e33b83bbcd657d0e WatchSource:0}: Error finding container 0935dd808cd539d1404b5d1b2f217538eab75324b4609e02e33b83bbcd657d0e: Status 404 returned error can't find the container with id 0935dd808cd539d1404b5d1b2f217538eab75324b4609e02e33b83bbcd657d0e
Jul 14 07:57:39.098512 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.098478    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-tfqps"]
Jul 14 07:57:39.103091 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.103070    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tfqps"
Jul 14 07:57:39.108063 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.108040    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8fmc5\""
Jul 14 07:57:39.113403 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.113374    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfqps"]
Jul 14 07:57:39.147232 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.147177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2952\" (UniqueName: \"kubernetes.io/projected/eb47cca3-b5ee-4247-a227-fa0a9bd1d069-kube-api-access-p2952\") pod \"authorino-58cd955675-tfqps\" (UID: \"eb47cca3-b5ee-4247-a227-fa0a9bd1d069\") " pod="kuadrant-system/authorino-58cd955675-tfqps"
Jul 14 07:57:39.242819 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.242781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68" event={"ID":"b9fdcb3b-6538-4b80-a287-e2b3ede432cb","Type":"ContainerStarted","Data":"0935dd808cd539d1404b5d1b2f217538eab75324b4609e02e33b83bbcd657d0e"}
Jul 14 07:57:39.248463 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.248440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2952\" (UniqueName: \"kubernetes.io/projected/eb47cca3-b5ee-4247-a227-fa0a9bd1d069-kube-api-access-p2952\") pod \"authorino-58cd955675-tfqps\" (UID: \"eb47cca3-b5ee-4247-a227-fa0a9bd1d069\") " pod="kuadrant-system/authorino-58cd955675-tfqps"
Jul 14 07:57:39.256999 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.256977    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2952\" (UniqueName: \"kubernetes.io/projected/eb47cca3-b5ee-4247-a227-fa0a9bd1d069-kube-api-access-p2952\") pod \"authorino-58cd955675-tfqps\" (UID: \"eb47cca3-b5ee-4247-a227-fa0a9bd1d069\") " pod="kuadrant-system/authorino-58cd955675-tfqps"
Jul 14 07:57:39.413955 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.413880    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tfqps"
Jul 14 07:57:39.598501 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:39.598065    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfqps"]
Jul 14 07:57:39.600301 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:57:39.600262    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb47cca3_b5ee_4247_a227_fa0a9bd1d069.slice/crio-0441493007b11448c7071115cc4317472209348bc7b6998c3882e5c52c231f71 WatchSource:0}: Error finding container 0441493007b11448c7071115cc4317472209348bc7b6998c3882e5c52c231f71: Status 404 returned error can't find the container with id 0441493007b11448c7071115cc4317472209348bc7b6998c3882e5c52c231f71
Jul 14 07:57:40.251970 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:40.251898    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tfqps" event={"ID":"eb47cca3-b5ee-4247-a227-fa0a9bd1d069","Type":"ContainerStarted","Data":"0441493007b11448c7071115cc4317472209348bc7b6998c3882e5c52c231f71"}
Jul 14 07:57:43.077071 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:43.077035    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfqps"]
Jul 14 07:57:44.276600 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.276566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tfqps" event={"ID":"eb47cca3-b5ee-4247-a227-fa0a9bd1d069","Type":"ContainerStarted","Data":"92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5"}
Jul 14 07:57:44.276600 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.276587    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-tfqps" podUID="eb47cca3-b5ee-4247-a227-fa0a9bd1d069" containerName="authorino" containerID="cri-o://92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5" gracePeriod=30
Jul 14 07:57:44.278178 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.278156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68" event={"ID":"b9fdcb3b-6538-4b80-a287-e2b3ede432cb","Type":"ContainerStarted","Data":"a9f796627ddcfc2f980c03aef7b480c234d9ff058901c1777424a09e46641b4d"}
Jul 14 07:57:44.278298 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.278283    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:44.337920 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.337874    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-tfqps" podStartSLOduration=1.60358844 podStartE2EDuration="5.337860638s" totalImagesPullingTime="3.734272198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:57:44.304530463 +0000 UTC m=+487.046448332" watchObservedRunningTime="2026-07-14 07:57:44.337860638 +0000 UTC m=+487.079778505"
Jul 14 07:57:44.338396 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.338369    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68" podStartSLOduration=1.734042307 podStartE2EDuration="6.338362442s" totalImagesPullingTime="4.604320135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:57:44.336660406 +0000 UTC m=+487.078578275" watchObservedRunningTime="2026-07-14 07:57:44.338362442 +0000 UTC m=+487.080280310"
Jul 14 07:57:44.522059 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.522033    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tfqps"
Jul 14 07:57:44.598830 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.598752    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2952\" (UniqueName: \"kubernetes.io/projected/eb47cca3-b5ee-4247-a227-fa0a9bd1d069-kube-api-access-p2952\") pod \"eb47cca3-b5ee-4247-a227-fa0a9bd1d069\" (UID: \"eb47cca3-b5ee-4247-a227-fa0a9bd1d069\") "
Jul 14 07:57:44.600753 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.600719    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb47cca3-b5ee-4247-a227-fa0a9bd1d069-kube-api-access-p2952" (OuterVolumeSpecName: "kube-api-access-p2952") pod "eb47cca3-b5ee-4247-a227-fa0a9bd1d069" (UID: "eb47cca3-b5ee-4247-a227-fa0a9bd1d069"). InnerVolumeSpecName "kube-api-access-p2952". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:57:44.699650 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:44.699617    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2952\" (UniqueName: \"kubernetes.io/projected/eb47cca3-b5ee-4247-a227-fa0a9bd1d069-kube-api-access-p2952\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:57:45.284022 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.283982    2562 generic.go:356] "Generic (PLEG): container finished" podID="eb47cca3-b5ee-4247-a227-fa0a9bd1d069" containerID="92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5" exitCode=0
Jul 14 07:57:45.284439 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.284038    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tfqps"
Jul 14 07:57:45.284439 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.284068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tfqps" event={"ID":"eb47cca3-b5ee-4247-a227-fa0a9bd1d069","Type":"ContainerDied","Data":"92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5"}
Jul 14 07:57:45.284439 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.284108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tfqps" event={"ID":"eb47cca3-b5ee-4247-a227-fa0a9bd1d069","Type":"ContainerDied","Data":"0441493007b11448c7071115cc4317472209348bc7b6998c3882e5c52c231f71"}
Jul 14 07:57:45.284439 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.284129    2562 scope.go:117] "RemoveContainer" containerID="92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5"
Jul 14 07:57:45.293791 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.293774    2562 scope.go:117] "RemoveContainer" containerID="92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5"
Jul 14 07:57:45.294057 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:57:45.294037    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5\": container with ID starting with 92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5 not found: ID does not exist" containerID="92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5"
Jul 14 07:57:45.294110 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.294065    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5"} err="failed to get container status \"92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5\": rpc error: code = NotFound desc = could not find container \"92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5\": container with ID starting with 92b1b29f455aee2d4160013baf6e785c305f490edc6c081fb1da59cc308c98b5 not found: ID does not exist"
Jul 14 07:57:45.318624 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.318603    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfqps"]
Jul 14 07:57:45.330615 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.330590    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfqps"]
Jul 14 07:57:45.700750 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:45.700673    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb47cca3-b5ee-4247-a227-fa0a9bd1d069" path="/var/lib/kubelet/pods/eb47cca3-b5ee-4247-a227-fa0a9bd1d069/volumes"
Jul 14 07:57:52.728597 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:52.728558    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8nv68"]
Jul 14 07:57:52.729215 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:52.728772    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68" podUID="b9fdcb3b-6538-4b80-a287-e2b3ede432cb" containerName="limitador" containerID="cri-o://a9f796627ddcfc2f980c03aef7b480c234d9ff058901c1777424a09e46641b4d" gracePeriod=30
Jul 14 07:57:52.729788 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:52.729770    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:53.325905 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:53.325819    2562 generic.go:356] "Generic (PLEG): container finished" podID="b9fdcb3b-6538-4b80-a287-e2b3ede432cb" containerID="a9f796627ddcfc2f980c03aef7b480c234d9ff058901c1777424a09e46641b4d" exitCode=0
Jul 14 07:57:53.325905 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:53.325868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68" event={"ID":"b9fdcb3b-6538-4b80-a287-e2b3ede432cb","Type":"ContainerDied","Data":"a9f796627ddcfc2f980c03aef7b480c234d9ff058901c1777424a09e46641b4d"}
Jul 14 07:57:53.674860 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:53.674834    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:53.778983 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:53.778954    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl6lj\" (UniqueName: \"kubernetes.io/projected/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-kube-api-access-gl6lj\") pod \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\" (UID: \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\") "
Jul 14 07:57:53.779456 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:53.779038    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-config-file\") pod \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\" (UID: \"b9fdcb3b-6538-4b80-a287-e2b3ede432cb\") "
Jul 14 07:57:53.779456 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:53.779360    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-config-file" (OuterVolumeSpecName: "config-file") pod "b9fdcb3b-6538-4b80-a287-e2b3ede432cb" (UID: "b9fdcb3b-6538-4b80-a287-e2b3ede432cb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:57:53.781135 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:53.781113    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-kube-api-access-gl6lj" (OuterVolumeSpecName: "kube-api-access-gl6lj") pod "b9fdcb3b-6538-4b80-a287-e2b3ede432cb" (UID: "b9fdcb3b-6538-4b80-a287-e2b3ede432cb"). InnerVolumeSpecName "kube-api-access-gl6lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:57:53.880109 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:53.880030    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl6lj\" (UniqueName: \"kubernetes.io/projected/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-kube-api-access-gl6lj\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:57:53.880109 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:53.880057    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9fdcb3b-6538-4b80-a287-e2b3ede432cb-config-file\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:57:54.332062 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.332036    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68"
Jul 14 07:57:54.332062 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.332043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8nv68" event={"ID":"b9fdcb3b-6538-4b80-a287-e2b3ede432cb","Type":"ContainerDied","Data":"0935dd808cd539d1404b5d1b2f217538eab75324b4609e02e33b83bbcd657d0e"}
Jul 14 07:57:54.332288 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.332101    2562 scope.go:117] "RemoveContainer" containerID="a9f796627ddcfc2f980c03aef7b480c234d9ff058901c1777424a09e46641b4d"
Jul 14 07:57:54.356904 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.356878    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8nv68"]
Jul 14 07:57:54.364907 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.364885    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8nv68"]
Jul 14 07:57:54.867577 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.867540    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"]
Jul 14 07:57:54.867950 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.867936    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb47cca3-b5ee-4247-a227-fa0a9bd1d069" containerName="authorino"
Jul 14 07:57:54.868016 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.867951    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb47cca3-b5ee-4247-a227-fa0a9bd1d069" containerName="authorino"
Jul 14 07:57:54.868016 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.867967    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9fdcb3b-6538-4b80-a287-e2b3ede432cb" containerName="limitador"
Jul 14 07:57:54.868016 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.867976    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9fdcb3b-6538-4b80-a287-e2b3ede432cb" containerName="limitador"
Jul 14 07:57:54.868167 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.868074    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb47cca3-b5ee-4247-a227-fa0a9bd1d069" containerName="authorino"
Jul 14 07:57:54.868167 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.868085    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9fdcb3b-6538-4b80-a287-e2b3ede432cb" containerName="limitador"
Jul 14 07:57:54.872422 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.872404    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:57:54.875784 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.875761    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 14 07:57:54.876798 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.876778    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-c4hgd\""
Jul 14 07:57:54.876906 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.876808    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 14 07:57:54.876906 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.876811    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 07:57:54.885309 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.885282    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"]
Jul 14 07:57:54.990564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.990528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9c0d2b85-8a76-4dcf-a78b-c426e7af0be3-data\") pod \"postgres-69fb4594cf-npbcs\" (UID: \"9c0d2b85-8a76-4dcf-a78b-c426e7af0be3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:57:54.990564 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:54.990571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mnct\" (UniqueName: \"kubernetes.io/projected/9c0d2b85-8a76-4dcf-a78b-c426e7af0be3-kube-api-access-7mnct\") pod \"postgres-69fb4594cf-npbcs\" (UID: \"9c0d2b85-8a76-4dcf-a78b-c426e7af0be3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:57:55.091205 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:55.091160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9c0d2b85-8a76-4dcf-a78b-c426e7af0be3-data\") pod \"postgres-69fb4594cf-npbcs\" (UID: \"9c0d2b85-8a76-4dcf-a78b-c426e7af0be3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:57:55.091377 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:55.091211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mnct\" (UniqueName: \"kubernetes.io/projected/9c0d2b85-8a76-4dcf-a78b-c426e7af0be3-kube-api-access-7mnct\") pod \"postgres-69fb4594cf-npbcs\" (UID: \"9c0d2b85-8a76-4dcf-a78b-c426e7af0be3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:57:55.091544 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:55.091521    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9c0d2b85-8a76-4dcf-a78b-c426e7af0be3-data\") pod \"postgres-69fb4594cf-npbcs\" (UID: \"9c0d2b85-8a76-4dcf-a78b-c426e7af0be3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:57:55.102369 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:55.102338    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mnct\" (UniqueName: \"kubernetes.io/projected/9c0d2b85-8a76-4dcf-a78b-c426e7af0be3-kube-api-access-7mnct\") pod \"postgres-69fb4594cf-npbcs\" (UID: \"9c0d2b85-8a76-4dcf-a78b-c426e7af0be3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:57:55.183096 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:55.182990    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:57:55.314773 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:55.314747    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"]
Jul 14 07:57:55.316502 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:57:55.316465    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0d2b85_8a76_4dcf_a78b_c426e7af0be3.slice/crio-a440e6f19146e27bbdf65200c0a7b44ff6b192eecf9b9ada43b1e0f0eebffadb WatchSource:0}: Error finding container a440e6f19146e27bbdf65200c0a7b44ff6b192eecf9b9ada43b1e0f0eebffadb: Status 404 returned error can't find the container with id a440e6f19146e27bbdf65200c0a7b44ff6b192eecf9b9ada43b1e0f0eebffadb
Jul 14 07:57:55.337678 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:55.337645    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs" event={"ID":"9c0d2b85-8a76-4dcf-a78b-c426e7af0be3","Type":"ContainerStarted","Data":"a440e6f19146e27bbdf65200c0a7b44ff6b192eecf9b9ada43b1e0f0eebffadb"}
Jul 14 07:57:55.700517 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:57:55.700483    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9fdcb3b-6538-4b80-a287-e2b3ede432cb" path="/var/lib/kubelet/pods/b9fdcb3b-6538-4b80-a287-e2b3ede432cb/volumes"
Jul 14 07:58:00.370378 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:00.370288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs" event={"ID":"9c0d2b85-8a76-4dcf-a78b-c426e7af0be3","Type":"ContainerStarted","Data":"0597fd4a6201db9b8075833841ccc4fb3324d315e86fe3435d5e2b940b59b73b"}
Jul 14 07:58:00.370819 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:00.370423    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:58:00.394397 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:00.394343    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs" podStartSLOduration=1.6668672230000001 podStartE2EDuration="6.394328423s" totalImagesPullingTime="4.7274612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:58:00.392066271 +0000 UTC m=+503.133984138" watchObservedRunningTime="2026-07-14 07:58:00.394328423 +0000 UTC m=+503.136246290"
Jul 14 07:58:06.404464 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:06.404433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-npbcs"
Jul 14 07:58:14.009949 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.009915    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-787bf9669b-hvc78"]
Jul 14 07:58:14.091426 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.091391    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-787bf9669b-hvc78"]
Jul 14 07:58:14.091588 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.091515    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:14.094992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.094969    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 07:58:14.094992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.094987    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 07:58:14.095190 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.095021    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rslgb\""
Jul 14 07:58:14.157212 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.157184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjpgq\" (UniqueName: \"kubernetes.io/projected/56635e0b-7a0a-46f5-bac4-c00aa30c619c-kube-api-access-kjpgq\") pod \"maas-controller-787bf9669b-hvc78\" (UID: \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\") " pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:14.157390 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.157235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56635e0b-7a0a-46f5-bac4-c00aa30c619c-webhook-cert\") pod \"maas-controller-787bf9669b-hvc78\" (UID: \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\") " pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:14.205093 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.205061    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56f8f76b54-r78t5"]
Jul 14 07:58:14.257889 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.257850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56635e0b-7a0a-46f5-bac4-c00aa30c619c-webhook-cert\") pod \"maas-controller-787bf9669b-hvc78\" (UID: \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\") " pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:14.258092 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.257953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjpgq\" (UniqueName: \"kubernetes.io/projected/56635e0b-7a0a-46f5-bac4-c00aa30c619c-kube-api-access-kjpgq\") pod \"maas-controller-787bf9669b-hvc78\" (UID: \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\") " pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:14.258092 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.258054    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f8f76b54-r78t5"]
Jul 14 07:58:14.258183 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.258111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:14.260796 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.260731    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56635e0b-7a0a-46f5-bac4-c00aa30c619c-webhook-cert\") pod \"maas-controller-787bf9669b-hvc78\" (UID: \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\") " pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:14.267941 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.267914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjpgq\" (UniqueName: \"kubernetes.io/projected/56635e0b-7a0a-46f5-bac4-c00aa30c619c-kube-api-access-kjpgq\") pod \"maas-controller-787bf9669b-hvc78\" (UID: \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\") " pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:14.358742 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.358698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-webhook-cert\") pod \"maas-controller-56f8f76b54-r78t5\" (UID: \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\") " pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:14.358961 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.358793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966bl\" (UniqueName: \"kubernetes.io/projected/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-kube-api-access-966bl\") pod \"maas-controller-56f8f76b54-r78t5\" (UID: \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\") " pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:14.402466 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.402431    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:14.460058 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.460000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-webhook-cert\") pod \"maas-controller-56f8f76b54-r78t5\" (UID: \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\") " pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:14.460222 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.460082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966bl\" (UniqueName: \"kubernetes.io/projected/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-kube-api-access-966bl\") pod \"maas-controller-56f8f76b54-r78t5\" (UID: \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\") " pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:14.463544 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.463515    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-webhook-cert\") pod \"maas-controller-56f8f76b54-r78t5\" (UID: \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\") " pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:14.473123 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.473095    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-966bl\" (UniqueName: \"kubernetes.io/projected/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-kube-api-access-966bl\") pod \"maas-controller-56f8f76b54-r78t5\" (UID: \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\") " pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:14.555163 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.555135    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-787bf9669b-hvc78"]
Jul 14 07:58:14.557074 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:58:14.557048    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56635e0b_7a0a_46f5_bac4_c00aa30c619c.slice/crio-f17333db6eed46d9ca00cd9427cde5a103eb9780a42475513c8c599079956e97 WatchSource:0}: Error finding container f17333db6eed46d9ca00cd9427cde5a103eb9780a42475513c8c599079956e97: Status 404 returned error can't find the container with id f17333db6eed46d9ca00cd9427cde5a103eb9780a42475513c8c599079956e97
Jul 14 07:58:14.584344 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.584308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:14.750580 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:14.750551    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f8f76b54-r78t5"]
Jul 14 07:58:14.752456 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:58:14.752432    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3af86b4_84d6_4033_a7a0_3bfbc5ce3b2b.slice/crio-87be4bcbfe9792eb2315ddeab6a49f4cac9f76288578a6c95ef16f972c1d8c24 WatchSource:0}: Error finding container 87be4bcbfe9792eb2315ddeab6a49f4cac9f76288578a6c95ef16f972c1d8c24: Status 404 returned error can't find the container with id 87be4bcbfe9792eb2315ddeab6a49f4cac9f76288578a6c95ef16f972c1d8c24
Jul 14 07:58:15.448686 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:15.448596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f8f76b54-r78t5" event={"ID":"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b","Type":"ContainerStarted","Data":"87be4bcbfe9792eb2315ddeab6a49f4cac9f76288578a6c95ef16f972c1d8c24"}
Jul 14 07:58:15.452089 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:15.452017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787bf9669b-hvc78" event={"ID":"56635e0b-7a0a-46f5-bac4-c00aa30c619c","Type":"ContainerStarted","Data":"f17333db6eed46d9ca00cd9427cde5a103eb9780a42475513c8c599079956e97"}
Jul 14 07:58:17.464600 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:17.464489    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f8f76b54-r78t5" event={"ID":"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b","Type":"ContainerStarted","Data":"0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c"}
Jul 14 07:58:17.464600 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:17.464565    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:17.466619 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:17.466590    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787bf9669b-hvc78" event={"ID":"56635e0b-7a0a-46f5-bac4-c00aa30c619c","Type":"ContainerStarted","Data":"b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a"}
Jul 14 07:58:17.466726 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:17.466672    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:17.492558 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:17.492501    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56f8f76b54-r78t5" podStartSLOduration=0.953997832 podStartE2EDuration="3.492484687s" totalImagesPullingTime="2.538486855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:58:17.490574914 +0000 UTC m=+520.232492783" watchObservedRunningTime="2026-07-14 07:58:17.492484687 +0000 UTC m=+520.234402552"
Jul 14 07:58:17.514949 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:17.514892    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-787bf9669b-hvc78" podStartSLOduration=1.791619809 podStartE2EDuration="4.514872416s" totalImagesPullingTime="2.723252607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:58:17.513415155 +0000 UTC m=+520.255333024" watchObservedRunningTime="2026-07-14 07:58:17.514872416 +0000 UTC m=+520.256790286"
Jul 14 07:58:28.474613 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.474579    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:28.474992 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.474653    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 07:58:28.573033 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.572992    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-787bf9669b-hvc78"]
Jul 14 07:58:28.573207 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.573180    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-787bf9669b-hvc78" podUID="56635e0b-7a0a-46f5-bac4-c00aa30c619c" containerName="manager" containerID="cri-o://b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a" gracePeriod=30
Jul 14 07:58:28.818956 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.818931    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:28.892702 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.892673    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjpgq\" (UniqueName: \"kubernetes.io/projected/56635e0b-7a0a-46f5-bac4-c00aa30c619c-kube-api-access-kjpgq\") pod \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\" (UID: \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\") "
Jul 14 07:58:28.892873 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.892752    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56635e0b-7a0a-46f5-bac4-c00aa30c619c-webhook-cert\") pod \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\" (UID: \"56635e0b-7a0a-46f5-bac4-c00aa30c619c\") "
Jul 14 07:58:28.894863 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.894824    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56635e0b-7a0a-46f5-bac4-c00aa30c619c-kube-api-access-kjpgq" (OuterVolumeSpecName: "kube-api-access-kjpgq") pod "56635e0b-7a0a-46f5-bac4-c00aa30c619c" (UID: "56635e0b-7a0a-46f5-bac4-c00aa30c619c"). InnerVolumeSpecName "kube-api-access-kjpgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:58:28.894863 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.894845    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56635e0b-7a0a-46f5-bac4-c00aa30c619c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "56635e0b-7a0a-46f5-bac4-c00aa30c619c" (UID: "56635e0b-7a0a-46f5-bac4-c00aa30c619c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:58:28.993458 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.993384    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjpgq\" (UniqueName: \"kubernetes.io/projected/56635e0b-7a0a-46f5-bac4-c00aa30c619c-kube-api-access-kjpgq\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:58:28.993458 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:28.993411    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56635e0b-7a0a-46f5-bac4-c00aa30c619c-webhook-cert\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 07:58:29.529892 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.529856    2562 generic.go:356] "Generic (PLEG): container finished" podID="56635e0b-7a0a-46f5-bac4-c00aa30c619c" containerID="b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a" exitCode=0
Jul 14 07:58:29.530335 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.529917    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787bf9669b-hvc78"
Jul 14 07:58:29.530335 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.529925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787bf9669b-hvc78" event={"ID":"56635e0b-7a0a-46f5-bac4-c00aa30c619c","Type":"ContainerDied","Data":"b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a"}
Jul 14 07:58:29.530335 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.529993    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787bf9669b-hvc78" event={"ID":"56635e0b-7a0a-46f5-bac4-c00aa30c619c","Type":"ContainerDied","Data":"f17333db6eed46d9ca00cd9427cde5a103eb9780a42475513c8c599079956e97"}
Jul 14 07:58:29.530335 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.530030    2562 scope.go:117] "RemoveContainer" containerID="b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a"
Jul 14 07:58:29.538980 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.538959    2562 scope.go:117] "RemoveContainer" containerID="b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a"
Jul 14 07:58:29.539251 ip-10-0-129-164 kubenswrapper[2562]: E0714 07:58:29.539232    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a\": container with ID starting with b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a not found: ID does not exist" containerID="b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a"
Jul 14 07:58:29.539311 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.539259    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a"} err="failed to get container status \"b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a\": rpc error: code = NotFound desc = could not find container \"b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a\": container with ID starting with b557a8c6b08f620f97033508233c11baeaa69a3bc4195f6154d1d969c898920a not found: ID does not exist"
Jul 14 07:58:29.558288 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.558256    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-787bf9669b-hvc78"]
Jul 14 07:58:29.563041 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.562995    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-787bf9669b-hvc78"]
Jul 14 07:58:29.700485 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:29.700449    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56635e0b-7a0a-46f5-bac4-c00aa30c619c" path="/var/lib/kubelet/pods/56635e0b-7a0a-46f5-bac4-c00aa30c619c/volumes"
Jul 14 07:58:50.891853 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.891817    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"]
Jul 14 07:58:50.892319 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.892218    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56635e0b-7a0a-46f5-bac4-c00aa30c619c" containerName="manager"
Jul 14 07:58:50.892319 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.892229    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="56635e0b-7a0a-46f5-bac4-c00aa30c619c" containerName="manager"
Jul 14 07:58:50.892319 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.892306    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="56635e0b-7a0a-46f5-bac4-c00aa30c619c" containerName="manager"
Jul 14 07:58:50.900622 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.898773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:50.903301 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.903275    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 14 07:58:50.903432 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.903284    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jl2l2\""
Jul 14 07:58:50.912854 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.912835    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"]
Jul 14 07:58:50.986535 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.986501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9cf006-5781-4dff-8c95-9f6c00265cae-openshift-service-ca\") pod \"maas-api-697f5878b5-hjrq6\" (UID: \"0a9cf006-5781-4dff-8c95-9f6c00265cae\") " pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:50.986706 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.986551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a9cf006-5781-4dff-8c95-9f6c00265cae-maas-api-tls\") pod \"maas-api-697f5878b5-hjrq6\" (UID: \"0a9cf006-5781-4dff-8c95-9f6c00265cae\") " pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:50.986706 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:50.986648    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stbvm\" (UniqueName: \"kubernetes.io/projected/0a9cf006-5781-4dff-8c95-9f6c00265cae-kube-api-access-stbvm\") pod \"maas-api-697f5878b5-hjrq6\" (UID: \"0a9cf006-5781-4dff-8c95-9f6c00265cae\") " pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:51.087661 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.087617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9cf006-5781-4dff-8c95-9f6c00265cae-openshift-service-ca\") pod \"maas-api-697f5878b5-hjrq6\" (UID: \"0a9cf006-5781-4dff-8c95-9f6c00265cae\") " pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:51.087864 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.087682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a9cf006-5781-4dff-8c95-9f6c00265cae-maas-api-tls\") pod \"maas-api-697f5878b5-hjrq6\" (UID: \"0a9cf006-5781-4dff-8c95-9f6c00265cae\") " pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:51.087864 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.087753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stbvm\" (UniqueName: \"kubernetes.io/projected/0a9cf006-5781-4dff-8c95-9f6c00265cae-kube-api-access-stbvm\") pod \"maas-api-697f5878b5-hjrq6\" (UID: \"0a9cf006-5781-4dff-8c95-9f6c00265cae\") " pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:51.088437 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.088416    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9cf006-5781-4dff-8c95-9f6c00265cae-openshift-service-ca\") pod \"maas-api-697f5878b5-hjrq6\" (UID: \"0a9cf006-5781-4dff-8c95-9f6c00265cae\") " pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:51.090190 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.090171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a9cf006-5781-4dff-8c95-9f6c00265cae-maas-api-tls\") pod \"maas-api-697f5878b5-hjrq6\" (UID: \"0a9cf006-5781-4dff-8c95-9f6c00265cae\") " pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:51.115522 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.115487    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stbvm\" (UniqueName: \"kubernetes.io/projected/0a9cf006-5781-4dff-8c95-9f6c00265cae-kube-api-access-stbvm\") pod \"maas-api-697f5878b5-hjrq6\" (UID: \"0a9cf006-5781-4dff-8c95-9f6c00265cae\") " pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:51.211712 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.211621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:51.379822 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.379791    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"]
Jul 14 07:58:51.382549 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:58:51.382521    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9cf006_5781_4dff_8c95_9f6c00265cae.slice/crio-d0a86054418153f1250014263dd773eb3f0e1c0b785752f5f4fc684b685f530a WatchSource:0}: Error finding container d0a86054418153f1250014263dd773eb3f0e1c0b785752f5f4fc684b685f530a: Status 404 returned error can't find the container with id d0a86054418153f1250014263dd773eb3f0e1c0b785752f5f4fc684b685f530a
Jul 14 07:58:51.645990 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.645950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6" event={"ID":"0a9cf006-5781-4dff-8c95-9f6c00265cae","Type":"ContainerStarted","Data":"d0a86054418153f1250014263dd773eb3f0e1c0b785752f5f4fc684b685f530a"}
Jul 14 07:58:51.789530 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.789492    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"]
Jul 14 07:58:51.793844 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.793819    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:58:51.800976 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.800952    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4rzkq\""
Jul 14 07:58:51.802437 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.802417    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 14 07:58:51.861846 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.861814    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"]
Jul 14 07:58:51.883353 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.883319    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"]
Jul 14 07:58:51.886811 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.886785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:58:51.895195 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.894876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxwdk\" (UniqueName: \"kubernetes.io/projected/9cd89e91-4e74-4394-9480-0348ccb12c89-kube-api-access-nxwdk\") pod \"payload-pre-processing-74584bb9f8-hpmjh\" (UID: \"9cd89e91-4e74-4394-9480-0348ccb12c89\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:58:51.895195 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.895050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cd89e91-4e74-4394-9480-0348ccb12c89-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-hpmjh\" (UID: \"9cd89e91-4e74-4394-9480-0348ccb12c89\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:58:51.916268 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.916187    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"]
Jul 14 07:58:51.996540 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.996490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cd89e91-4e74-4394-9480-0348ccb12c89-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-hpmjh\" (UID: \"9cd89e91-4e74-4394-9480-0348ccb12c89\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:58:51.996735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.996579    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxwdk\" (UniqueName: \"kubernetes.io/projected/9cd89e91-4e74-4394-9480-0348ccb12c89-kube-api-access-nxwdk\") pod \"payload-pre-processing-74584bb9f8-hpmjh\" (UID: \"9cd89e91-4e74-4394-9480-0348ccb12c89\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:58:51.996735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.996618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a6fec6d-1707-417b-a2a4-6486ff916560-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-v5xx4\" (UID: \"3a6fec6d-1707-417b-a2a4-6486ff916560\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:58:51.996735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.996663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfvzj\" (UniqueName: \"kubernetes.io/projected/3a6fec6d-1707-417b-a2a4-6486ff916560-kube-api-access-zfvzj\") pod \"payload-processing-f9b8d9b9b-v5xx4\" (UID: \"3a6fec6d-1707-417b-a2a4-6486ff916560\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:58:51.997388 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:51.997365    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cd89e91-4e74-4394-9480-0348ccb12c89-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-hpmjh\" (UID: \"9cd89e91-4e74-4394-9480-0348ccb12c89\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:58:52.031273 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.031243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxwdk\" (UniqueName: \"kubernetes.io/projected/9cd89e91-4e74-4394-9480-0348ccb12c89-kube-api-access-nxwdk\") pod \"payload-pre-processing-74584bb9f8-hpmjh\" (UID: \"9cd89e91-4e74-4394-9480-0348ccb12c89\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:58:52.097761 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.097708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a6fec6d-1707-417b-a2a4-6486ff916560-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-v5xx4\" (UID: \"3a6fec6d-1707-417b-a2a4-6486ff916560\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:58:52.097993 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.097796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfvzj\" (UniqueName: \"kubernetes.io/projected/3a6fec6d-1707-417b-a2a4-6486ff916560-kube-api-access-zfvzj\") pod \"payload-processing-f9b8d9b9b-v5xx4\" (UID: \"3a6fec6d-1707-417b-a2a4-6486ff916560\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:58:52.099598 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.099537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a6fec6d-1707-417b-a2a4-6486ff916560-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-v5xx4\" (UID: \"3a6fec6d-1707-417b-a2a4-6486ff916560\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:58:52.104637 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.104606    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:58:52.117067 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.116988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfvzj\" (UniqueName: \"kubernetes.io/projected/3a6fec6d-1707-417b-a2a4-6486ff916560-kube-api-access-zfvzj\") pod \"payload-processing-f9b8d9b9b-v5xx4\" (UID: \"3a6fec6d-1707-417b-a2a4-6486ff916560\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:58:52.198769 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.198730    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:58:52.308610 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.308579    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"]
Jul 14 07:58:52.309370 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:58:52.309334    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd89e91_4e74_4394_9480_0348ccb12c89.slice/crio-b40ba58f33799a2ddda28c9cbb18629e0f4c757eb488c35e6b5153781ff7381d WatchSource:0}: Error finding container b40ba58f33799a2ddda28c9cbb18629e0f4c757eb488c35e6b5153781ff7381d: Status 404 returned error can't find the container with id b40ba58f33799a2ddda28c9cbb18629e0f4c757eb488c35e6b5153781ff7381d
Jul 14 07:58:52.430089 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.415327    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"]
Jul 14 07:58:52.443988 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:58:52.443777    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6fec6d_1707_417b_a2a4_6486ff916560.slice/crio-f7ed2303e0cc8dd3a2a6b2983433632b705099900aeb59199d5c487cdf50052a WatchSource:0}: Error finding container f7ed2303e0cc8dd3a2a6b2983433632b705099900aeb59199d5c487cdf50052a: Status 404 returned error can't find the container with id f7ed2303e0cc8dd3a2a6b2983433632b705099900aeb59199d5c487cdf50052a
Jul 14 07:58:52.652165 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.652125    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4" event={"ID":"3a6fec6d-1707-417b-a2a4-6486ff916560","Type":"ContainerStarted","Data":"f7ed2303e0cc8dd3a2a6b2983433632b705099900aeb59199d5c487cdf50052a"}
Jul 14 07:58:52.653447 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:52.653419    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh" event={"ID":"9cd89e91-4e74-4394-9480-0348ccb12c89","Type":"ContainerStarted","Data":"b40ba58f33799a2ddda28c9cbb18629e0f4c757eb488c35e6b5153781ff7381d"}
Jul 14 07:58:53.665333 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:53.664433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6" event={"ID":"0a9cf006-5781-4dff-8c95-9f6c00265cae","Type":"ContainerStarted","Data":"9a6ceb131f0d588c4bd12e9c1b1be707b33375464d0b7757fae4ac8c0999ee66"}
Jul 14 07:58:53.665333 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:53.665234    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:58:53.692644 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:53.692575    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6" podStartSLOduration=1.82591926 podStartE2EDuration="3.692552891s" totalImagesPullingTime="1.866633631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:58:53.689383354 +0000 UTC m=+556.431301224" watchObservedRunningTime="2026-07-14 07:58:53.692552891 +0000 UTC m=+556.434470761"
Jul 14 07:58:54.677507 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:54.677418    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4" event={"ID":"3a6fec6d-1707-417b-a2a4-6486ff916560","Type":"ContainerStarted","Data":"438ce12f654cfa4d3a8f71b26e1a79014a4df601bb4931deeb808e123f224aed"}
Jul 14 07:58:54.677894 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:54.677538    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:58:54.679164 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:54.679138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh" event={"ID":"9cd89e91-4e74-4394-9480-0348ccb12c89","Type":"ContainerStarted","Data":"5524fa4a607002e5811355385b303cc6c642c0a10c5c03dfa655b409c6498110"}
Jul 14 07:58:54.679294 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:54.679269    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:58:54.700478 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:54.700433    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4" podStartSLOduration=1.744658767 podStartE2EDuration="3.70041713s" totalImagesPullingTime="1.955758363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:58:54.698558786 +0000 UTC m=+557.440476653" watchObservedRunningTime="2026-07-14 07:58:54.70041713 +0000 UTC m=+557.442334998"
Jul 14 07:58:59.706339 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:59.706242    2562 generic.go:356] "Generic (PLEG): container finished" podID="666d1f3a-e7e0-4abe-9171-75707dcfe080" containerID="de2de41cc60977342ffd1f4769a09e1667af0888608b273e9e450a99c4c6a99c" exitCode=0
Jul 14 07:58:59.706339 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:59.706308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs" event={"ID":"666d1f3a-e7e0-4abe-9171-75707dcfe080","Type":"ContainerDied","Data":"de2de41cc60977342ffd1f4769a09e1667af0888608b273e9e450a99c4c6a99c"}
Jul 14 07:58:59.706747 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:59.706721    2562 scope.go:117] "RemoveContainer" containerID="de2de41cc60977342ffd1f4769a09e1667af0888608b273e9e450a99c4c6a99c"
Jul 14 07:58:59.707699 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:59.707668    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 07:58:59.707751 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:59.707741    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 07:58:59.707792 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:59.707779    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 07:58:59.733325 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:58:59.733284    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh" podStartSLOduration=6.644682995 podStartE2EDuration="8.733268797s" totalImagesPullingTime="2.088585802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:58:54.725971931 +0000 UTC m=+557.467889800" watchObservedRunningTime="2026-07-14 07:58:59.733268797 +0000 UTC m=+562.475186665"
Jul 14 07:59:00.690974 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:00.690945    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-697f5878b5-hjrq6"
Jul 14 07:59:00.714209 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:00.714163    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs" event={"ID":"666d1f3a-e7e0-4abe-9171-75707dcfe080","Type":"ContainerStarted","Data":"c22d4ecfbe145b08bd578d29bcc2fc1a4846163fbb4f5de7fe2202558a899a76"}
Jul 14 07:59:00.966263 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:00.966232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:59:00.966485 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:00.966459    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ts8gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 14 07:59:00.966531 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:00.966516    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs" podUID="666d1f3a-e7e0-4abe-9171-75707dcfe080" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 14 07:59:01.966340 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:01.966301    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ts8gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 14 07:59:01.966789 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:01.966362    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs" podUID="666d1f3a-e7e0-4abe-9171-75707dcfe080" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 14 07:59:02.966276 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:02.966243    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ts8gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 14 07:59:02.966466 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:02.966299    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs" podUID="666d1f3a-e7e0-4abe-9171-75707dcfe080" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 14 07:59:03.966391 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:03.966356    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ts8gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 14 07:59:03.966573 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:03.966420    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs" podUID="666d1f3a-e7e0-4abe-9171-75707dcfe080" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 14 07:59:04.970107 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:04.970072    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:59:04.970512 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:04.970457    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:59:04.971194 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:04.971176    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ts8gs"
Jul 14 07:59:05.686696 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:05.686665    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-v5xx4"
Jul 14 07:59:05.686877 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:05.686791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hpmjh"
Jul 14 07:59:14.568984 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.568946    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"]
Jul 14 07:59:14.572908 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.572885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.575693 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.575674    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 14 07:59:14.575804 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.575747    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 07:59:14.576834 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.576821    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mpldq\""
Jul 14 07:59:14.576895 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.576846    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 07:59:14.581902 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.581882    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"]
Jul 14 07:59:14.625154 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.625122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.625314 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.625161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15ab50c8-4532-430e-9ff6-f936e1d18e8c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.625314 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.625231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.625314 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.625303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8crtf\" (UniqueName: \"kubernetes.io/projected/15ab50c8-4532-430e-9ff6-f936e1d18e8c-kube-api-access-8crtf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.625428 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.625354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.625428 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.625380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.726111 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.726072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.726293 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.726117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8crtf\" (UniqueName: \"kubernetes.io/projected/15ab50c8-4532-430e-9ff6-f936e1d18e8c-kube-api-access-8crtf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.726293 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.726147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.726293 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.726172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.726293 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.726202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.726293 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.726224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15ab50c8-4532-430e-9ff6-f936e1d18e8c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.726580 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.726529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.726580 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.726541    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.726695 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.726647    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.728512 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.728490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15ab50c8-4532-430e-9ff6-f936e1d18e8c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.728696 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.728659    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15ab50c8-4532-430e-9ff6-f936e1d18e8c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.735255 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.735228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8crtf\" (UniqueName: \"kubernetes.io/projected/15ab50c8-4532-430e-9ff6-f936e1d18e8c-kube-api-access-8crtf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7\" (UID: \"15ab50c8-4532-430e-9ff6-f936e1d18e8c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:14.884057 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:14.883941    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:15.033719 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:15.033685    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"]
Jul 14 07:59:15.035761 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:59:15.035731    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ab50c8_4532_430e_9ff6_f936e1d18e8c.slice/crio-03ab5998e45af1c1f1b10156b42f40189c146ea64d870755f3c2acd1187a4a17 WatchSource:0}: Error finding container 03ab5998e45af1c1f1b10156b42f40189c146ea64d870755f3c2acd1187a4a17: Status 404 returned error can't find the container with id 03ab5998e45af1c1f1b10156b42f40189c146ea64d870755f3c2acd1187a4a17
Jul 14 07:59:15.803106 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:15.803064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7" event={"ID":"15ab50c8-4532-430e-9ff6-f936e1d18e8c","Type":"ContainerStarted","Data":"03ab5998e45af1c1f1b10156b42f40189c146ea64d870755f3c2acd1187a4a17"}
Jul 14 07:59:16.809665 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:16.809623    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7" event={"ID":"15ab50c8-4532-430e-9ff6-f936e1d18e8c","Type":"ContainerStarted","Data":"9b6241dc84c07feae0ae4aa4b0fd32d1b1604f31069ed14a150838ae645d8f1f"}
Jul 14 07:59:16.832586 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:16.832531    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7" podStartSLOduration=1.560922695 podStartE2EDuration="2.832515003s" totalImagesPullingTime="1.271592308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:59:16.829730952 +0000 UTC m=+579.571648819" watchObservedRunningTime="2026-07-14 07:59:16.832515003 +0000 UTC m=+579.574432871"
Jul 14 07:59:24.884960 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:24.884922    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:24.885445 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:24.884978    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:24.897421 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:24.897392    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:25.866800 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:25.866771    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7"
Jul 14 07:59:37.601701 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:37.601669    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 07:59:37.605432 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:37.605412    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 07:59:37.606385 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:37.606366    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 07:59:37.610106 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:37.610089    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 07:59:46.574988 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.574955    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"]
Jul 14 07:59:46.579260 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.579238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.582235 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.582214    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 14 07:59:46.588553 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.588266    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"]
Jul 14 07:59:46.613851 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.613815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.613851 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.613854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc5e7897-eca3-4628-8ac0-d14a87654b98-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.614089 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.613917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sc7h\" (UniqueName: \"kubernetes.io/projected/bc5e7897-eca3-4628-8ac0-d14a87654b98-kube-api-access-9sc7h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.614089 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.613997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.614089 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.614055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.614195 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.614119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.715601 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.715547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.715794 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.715629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.715794 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.715658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc5e7897-eca3-4628-8ac0-d14a87654b98-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.715794 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.715694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sc7h\" (UniqueName: \"kubernetes.io/projected/bc5e7897-eca3-4628-8ac0-d14a87654b98-kube-api-access-9sc7h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.715794 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.715786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.716057 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.715811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.716497 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.716465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.716606 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.716517    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.716788 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.716763    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.718238 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.718218    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc5e7897-eca3-4628-8ac0-d14a87654b98-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.718572 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.718554    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc5e7897-eca3-4628-8ac0-d14a87654b98-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.725198 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.725178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sc7h\" (UniqueName: \"kubernetes.io/projected/bc5e7897-eca3-4628-8ac0-d14a87654b98-kube-api-access-9sc7h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b\" (UID: \"bc5e7897-eca3-4628-8ac0-d14a87654b98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:46.892735 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:46.892624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:47.330800 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:47.330770    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"]
Jul 14 07:59:47.332822 ip-10-0-129-164 kubenswrapper[2562]: W0714 07:59:47.332796    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5e7897_eca3_4628_8ac0_d14a87654b98.slice/crio-514107e9e9ec78e3bd1ce89f4557c450db0f1c1ce2d24dd6f2ed2b074670c7a0 WatchSource:0}: Error finding container 514107e9e9ec78e3bd1ce89f4557c450db0f1c1ce2d24dd6f2ed2b074670c7a0: Status 404 returned error can't find the container with id 514107e9e9ec78e3bd1ce89f4557c450db0f1c1ce2d24dd6f2ed2b074670c7a0
Jul 14 07:59:47.975802 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:47.975770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b" event={"ID":"bc5e7897-eca3-4628-8ac0-d14a87654b98","Type":"ContainerStarted","Data":"cf5ccad1f298e7331d9295769f6eae6d899ad91baeaf102bfc79b91f17464bd8"}
Jul 14 07:59:47.976223 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:47.975826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b" event={"ID":"bc5e7897-eca3-4628-8ac0-d14a87654b98","Type":"ContainerStarted","Data":"514107e9e9ec78e3bd1ce89f4557c450db0f1c1ce2d24dd6f2ed2b074670c7a0"}
Jul 14 07:59:47.995826 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:47.995775    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b" podStartSLOduration=1.796085379 podStartE2EDuration="1.995760547s" totalImagesPullingTime="199.675168ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:59:47.99307294 +0000 UTC m=+610.734990807" watchObservedRunningTime="2026-07-14 07:59:47.995760547 +0000 UTC m=+610.737678446"
Jul 14 07:59:56.893407 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:56.893366    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:56.893807 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:56.893453    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:56.905979 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:56.905947    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 07:59:57.039782 ip-10-0-129-164 kubenswrapper[2562]: I0714 07:59:57.039755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b"
Jul 14 08:01:12.404576 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.404540    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-689867f56f-fbbpz"]
Jul 14 08:01:12.408300 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.408277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-689867f56f-fbbpz"
Jul 14 08:01:12.412214 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.412186    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 14 08:01:12.412338 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.412223    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8fmc5\""
Jul 14 08:01:12.415936 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.415559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-689867f56f-fbbpz"]
Jul 14 08:01:12.422146 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.422119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqtx5\" (UniqueName: \"kubernetes.io/projected/8e60a5dd-73e9-4877-ae4b-ea260b2b5597-kube-api-access-jqtx5\") pod \"authorino-689867f56f-fbbpz\" (UID: \"8e60a5dd-73e9-4877-ae4b-ea260b2b5597\") " pod="kuadrant-system/authorino-689867f56f-fbbpz"
Jul 14 08:01:12.422275 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.422180    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e60a5dd-73e9-4877-ae4b-ea260b2b5597-tls-cert\") pod \"authorino-689867f56f-fbbpz\" (UID: \"8e60a5dd-73e9-4877-ae4b-ea260b2b5597\") " pod="kuadrant-system/authorino-689867f56f-fbbpz"
Jul 14 08:01:12.523676 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.523629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqtx5\" (UniqueName: \"kubernetes.io/projected/8e60a5dd-73e9-4877-ae4b-ea260b2b5597-kube-api-access-jqtx5\") pod \"authorino-689867f56f-fbbpz\" (UID: \"8e60a5dd-73e9-4877-ae4b-ea260b2b5597\") " pod="kuadrant-system/authorino-689867f56f-fbbpz"
Jul 14 08:01:12.523861 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.523712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e60a5dd-73e9-4877-ae4b-ea260b2b5597-tls-cert\") pod \"authorino-689867f56f-fbbpz\" (UID: \"8e60a5dd-73e9-4877-ae4b-ea260b2b5597\") " pod="kuadrant-system/authorino-689867f56f-fbbpz"
Jul 14 08:01:12.526348 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.526322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e60a5dd-73e9-4877-ae4b-ea260b2b5597-tls-cert\") pod \"authorino-689867f56f-fbbpz\" (UID: \"8e60a5dd-73e9-4877-ae4b-ea260b2b5597\") " pod="kuadrant-system/authorino-689867f56f-fbbpz"
Jul 14 08:01:12.531906 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.531881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqtx5\" (UniqueName: \"kubernetes.io/projected/8e60a5dd-73e9-4877-ae4b-ea260b2b5597-kube-api-access-jqtx5\") pod \"authorino-689867f56f-fbbpz\" (UID: \"8e60a5dd-73e9-4877-ae4b-ea260b2b5597\") " pod="kuadrant-system/authorino-689867f56f-fbbpz"
Jul 14 08:01:12.724825 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.724788    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-689867f56f-fbbpz"
Jul 14 08:01:12.869969 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.869945    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-689867f56f-fbbpz"]
Jul 14 08:01:12.872178 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:01:12.872140    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e60a5dd_73e9_4877_ae4b_ea260b2b5597.slice/crio-f91aca5456dc9943a10e2ee9878cbd3ffe974e5a609f66114fd3551cc883245a WatchSource:0}: Error finding container f91aca5456dc9943a10e2ee9878cbd3ffe974e5a609f66114fd3551cc883245a: Status 404 returned error can't find the container with id f91aca5456dc9943a10e2ee9878cbd3ffe974e5a609f66114fd3551cc883245a
Jul 14 08:01:12.873888 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:12.873870    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 08:01:13.430573 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:13.430544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-689867f56f-fbbpz" event={"ID":"8e60a5dd-73e9-4877-ae4b-ea260b2b5597","Type":"ContainerStarted","Data":"f91aca5456dc9943a10e2ee9878cbd3ffe974e5a609f66114fd3551cc883245a"}
Jul 14 08:01:14.438517 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:14.438481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-689867f56f-fbbpz" event={"ID":"8e60a5dd-73e9-4877-ae4b-ea260b2b5597","Type":"ContainerStarted","Data":"f2a20ac0d5d809c1d461dcc2957dc39adc41bf02d88314379a1ca6b0f9ce8ca8"}
Jul 14 08:01:14.467410 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:01:14.467357    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-689867f56f-fbbpz" podStartSLOduration=1.966870825 podStartE2EDuration="2.467334497s" totalImagesPullingTime="500.463672ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:01:14.465160446 +0000 UTC m=+697.207078313" watchObservedRunningTime="2026-07-14 08:01:14.467334497 +0000 UTC m=+697.209252428"
Jul 14 08:02:24.445583 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.445544    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56f8f76b54-r78t5"]
Jul 14 08:02:24.446065 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.445799    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-56f8f76b54-r78t5" podUID="a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b" containerName="manager" containerID="cri-o://0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c" gracePeriod=30
Jul 14 08:02:24.707546 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.707481    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 08:02:24.785662 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.785633    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-webhook-cert\") pod \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\" (UID: \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\") "
Jul 14 08:02:24.785845 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.785738    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-966bl\" (UniqueName: \"kubernetes.io/projected/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-kube-api-access-966bl\") pod \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\" (UID: \"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b\") "
Jul 14 08:02:24.787789 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.787759    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-kube-api-access-966bl" (OuterVolumeSpecName: "kube-api-access-966bl") pod "a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b" (UID: "a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b"). InnerVolumeSpecName "kube-api-access-966bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:02:24.787897 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.787796    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b" (UID: "a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:02:24.823498 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.823461    2562 generic.go:356] "Generic (PLEG): container finished" podID="a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b" containerID="0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c" exitCode=0
Jul 14 08:02:24.823695 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.823502    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f8f76b54-r78t5"
Jul 14 08:02:24.823695 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.823537    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f8f76b54-r78t5" event={"ID":"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b","Type":"ContainerDied","Data":"0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c"}
Jul 14 08:02:24.823695 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.823603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f8f76b54-r78t5" event={"ID":"a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b","Type":"ContainerDied","Data":"87be4bcbfe9792eb2315ddeab6a49f4cac9f76288578a6c95ef16f972c1d8c24"}
Jul 14 08:02:24.823695 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.823633    2562 scope.go:117] "RemoveContainer" containerID="0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c"
Jul 14 08:02:24.834611 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.834590    2562 scope.go:117] "RemoveContainer" containerID="0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c"
Jul 14 08:02:24.834890 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:02:24.834871    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c\": container with ID starting with 0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c not found: ID does not exist" containerID="0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c"
Jul 14 08:02:24.834952 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.834901    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c"} err="failed to get container status \"0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c\": rpc error: code = NotFound desc = could not find container \"0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c\": container with ID starting with 0c795eb45f5594a722f55643b4e65622f1fee61db3166059211e7fcb0ff0048c not found: ID does not exist"
Jul 14 08:02:24.848304 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.848276    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56f8f76b54-r78t5"]
Jul 14 08:02:24.851344 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.851315    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56f8f76b54-r78t5"]
Jul 14 08:02:24.887319 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.887292    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-webhook-cert\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:02:24.887319 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:24.887316    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-966bl\" (UniqueName: \"kubernetes.io/projected/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b-kube-api-access-966bl\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:02:25.701839 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.701800    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b" path="/var/lib/kubelet/pods/a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b/volumes"
Jul 14 08:02:25.706922 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.706899    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56f8f76b54-rh84h"]
Jul 14 08:02:25.707322 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.707309    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b" containerName="manager"
Jul 14 08:02:25.707369 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.707324    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b" containerName="manager"
Jul 14 08:02:25.707404 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.707394    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3af86b4-84d6-4033-a7a0-3bfbc5ce3b2b" containerName="manager"
Jul 14 08:02:25.711726 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.711710    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:02:25.715689 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.715668    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 08:02:25.715799 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.715723    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 08:02:25.715799 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.715758    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rslgb\""
Jul 14 08:02:25.720839 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.720816    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f8f76b54-rh84h"]
Jul 14 08:02:25.796804 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.796768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b3fba97-e44f-46d2-89ac-82dfd1608b66-webhook-cert\") pod \"maas-controller-56f8f76b54-rh84h\" (UID: \"2b3fba97-e44f-46d2-89ac-82dfd1608b66\") " pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:02:25.796984 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.796826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpbx8\" (UniqueName: \"kubernetes.io/projected/2b3fba97-e44f-46d2-89ac-82dfd1608b66-kube-api-access-xpbx8\") pod \"maas-controller-56f8f76b54-rh84h\" (UID: \"2b3fba97-e44f-46d2-89ac-82dfd1608b66\") " pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:02:25.897404 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.897371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b3fba97-e44f-46d2-89ac-82dfd1608b66-webhook-cert\") pod \"maas-controller-56f8f76b54-rh84h\" (UID: \"2b3fba97-e44f-46d2-89ac-82dfd1608b66\") " pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:02:25.897582 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.897425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpbx8\" (UniqueName: \"kubernetes.io/projected/2b3fba97-e44f-46d2-89ac-82dfd1608b66-kube-api-access-xpbx8\") pod \"maas-controller-56f8f76b54-rh84h\" (UID: \"2b3fba97-e44f-46d2-89ac-82dfd1608b66\") " pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:02:25.899838 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.899815    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b3fba97-e44f-46d2-89ac-82dfd1608b66-webhook-cert\") pod \"maas-controller-56f8f76b54-rh84h\" (UID: \"2b3fba97-e44f-46d2-89ac-82dfd1608b66\") " pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:02:25.907787 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:25.907764    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpbx8\" (UniqueName: \"kubernetes.io/projected/2b3fba97-e44f-46d2-89ac-82dfd1608b66-kube-api-access-xpbx8\") pod \"maas-controller-56f8f76b54-rh84h\" (UID: \"2b3fba97-e44f-46d2-89ac-82dfd1608b66\") " pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:02:26.023320 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:26.023280    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:02:26.162746 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:26.162720    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f8f76b54-rh84h"]
Jul 14 08:02:26.164782 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:02:26.164749    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3fba97_e44f_46d2_89ac_82dfd1608b66.slice/crio-8a5b0f40c8f55d6bdf36d1035fe14019acc480bac7e03d7b906f91595ae3da0f WatchSource:0}: Error finding container 8a5b0f40c8f55d6bdf36d1035fe14019acc480bac7e03d7b906f91595ae3da0f: Status 404 returned error can't find the container with id 8a5b0f40c8f55d6bdf36d1035fe14019acc480bac7e03d7b906f91595ae3da0f
Jul 14 08:02:26.839301 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:26.839268    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f8f76b54-rh84h" event={"ID":"2b3fba97-e44f-46d2-89ac-82dfd1608b66","Type":"ContainerStarted","Data":"4903e40e27341276cb4cf543c28cf71cfabe4798511b982f5bc9beed2931c418"}
Jul 14 08:02:26.839680 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:26.839319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f8f76b54-rh84h" event={"ID":"2b3fba97-e44f-46d2-89ac-82dfd1608b66","Type":"ContainerStarted","Data":"8a5b0f40c8f55d6bdf36d1035fe14019acc480bac7e03d7b906f91595ae3da0f"}
Jul 14 08:02:26.839680 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:26.839357    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:02:26.860064 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:26.860014    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56f8f76b54-rh84h" podStartSLOduration=1.31780123 podStartE2EDuration="1.859982905s" totalImagesPullingTime="542.181675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:02:26.856918658 +0000 UTC m=+769.598836527" watchObservedRunningTime="2026-07-14 08:02:26.859982905 +0000 UTC m=+769.601900773"
Jul 14 08:02:37.846797 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:02:37.846770    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56f8f76b54-rh84h"
Jul 14 08:03:37.675101 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:03:37.675066    2562 scope.go:117] "RemoveContainer" containerID="8651f795968c64e02103a29a50e52d2f56f1061c5d168270c7c6fbc0dc27e4d6"
Jul 14 08:04:37.640976 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:04:37.640895    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:04:37.642417 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:04:37.642397    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:04:37.644781 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:04:37.644763    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:04:37.646053 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:04:37.646033    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:07:24.758803 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:24.758763    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"]
Jul 14 08:07:24.759483 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:24.759076    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc" podUID="696736aa-a47f-4871-954e-c202ac38000f" containerName="manager" containerID="cri-o://0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc" gracePeriod=10
Jul 14 08:07:28.038208 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.038177    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 08:07:28.129949 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.129859    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njwlp\" (UniqueName: \"kubernetes.io/projected/696736aa-a47f-4871-954e-c202ac38000f-kube-api-access-njwlp\") pod \"696736aa-a47f-4871-954e-c202ac38000f\" (UID: \"696736aa-a47f-4871-954e-c202ac38000f\") "
Jul 14 08:07:28.129949 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.129945    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/696736aa-a47f-4871-954e-c202ac38000f-extensions-socket-volume\") pod \"696736aa-a47f-4871-954e-c202ac38000f\" (UID: \"696736aa-a47f-4871-954e-c202ac38000f\") "
Jul 14 08:07:28.130339 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.130311    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696736aa-a47f-4871-954e-c202ac38000f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "696736aa-a47f-4871-954e-c202ac38000f" (UID: "696736aa-a47f-4871-954e-c202ac38000f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:07:28.132047 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.132021    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696736aa-a47f-4871-954e-c202ac38000f-kube-api-access-njwlp" (OuterVolumeSpecName: "kube-api-access-njwlp") pod "696736aa-a47f-4871-954e-c202ac38000f" (UID: "696736aa-a47f-4871-954e-c202ac38000f"). InnerVolumeSpecName "kube-api-access-njwlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:07:28.231637 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.231599    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/696736aa-a47f-4871-954e-c202ac38000f-extensions-socket-volume\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:07:28.231637 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.231628    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njwlp\" (UniqueName: \"kubernetes.io/projected/696736aa-a47f-4871-954e-c202ac38000f-kube-api-access-njwlp\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:07:28.475812 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.475777    2562 generic.go:356] "Generic (PLEG): container finished" podID="696736aa-a47f-4871-954e-c202ac38000f" containerID="0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc" exitCode=0
Jul 14 08:07:28.475988 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.475825    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"
Jul 14 08:07:28.475988 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.475857    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc" event={"ID":"696736aa-a47f-4871-954e-c202ac38000f","Type":"ContainerDied","Data":"0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc"}
Jul 14 08:07:28.475988 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.475912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc" event={"ID":"696736aa-a47f-4871-954e-c202ac38000f","Type":"ContainerDied","Data":"35128f34848d1bcedcda0532f3026755c5d35ba0293bf84d6f33ae50ffc83f57"}
Jul 14 08:07:28.475988 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.475935    2562 scope.go:117] "RemoveContainer" containerID="0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc"
Jul 14 08:07:28.486320 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.486302    2562 scope.go:117] "RemoveContainer" containerID="0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc"
Jul 14 08:07:28.486575 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:07:28.486554    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc\": container with ID starting with 0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc not found: ID does not exist" containerID="0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc"
Jul 14 08:07:28.486623 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.486585    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc"} err="failed to get container status \"0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc\": rpc error: code = NotFound desc = could not find container \"0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc\": container with ID starting with 0c5c26eb8e0b8119b90388eabe4e13facc562f31ffad401a7d488ff8b27dc6cc not found: ID does not exist"
Jul 14 08:07:28.498443 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.498413    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"]
Jul 14 08:07:28.503976 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:28.503948    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7k4cc"]
Jul 14 08:07:29.701992 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:07:29.701910    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="696736aa-a47f-4871-954e-c202ac38000f" path="/var/lib/kubelet/pods/696736aa-a47f-4871-954e-c202ac38000f/volumes"
Jul 14 08:08:25.885122 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:25.885085    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"]
Jul 14 08:08:25.885612 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:25.885496    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696736aa-a47f-4871-954e-c202ac38000f" containerName="manager"
Jul 14 08:08:25.885612 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:25.885507    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="696736aa-a47f-4871-954e-c202ac38000f" containerName="manager"
Jul 14 08:08:25.885612 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:25.885571    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="696736aa-a47f-4871-954e-c202ac38000f" containerName="manager"
Jul 14 08:08:25.888664 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:25.888646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:08:25.891611 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:25.891586    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-brnjk\""
Jul 14 08:08:25.901040 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:25.900987    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"]
Jul 14 08:08:26.070198 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.070161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/400ab776-eeca-41d9-98ec-a2528e50199b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pz2s8\" (UID: \"400ab776-eeca-41d9-98ec-a2528e50199b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:08:26.070408 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.070222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6vb6\" (UniqueName: \"kubernetes.io/projected/400ab776-eeca-41d9-98ec-a2528e50199b-kube-api-access-v6vb6\") pod \"kuadrant-operator-controller-manager-86878c769f-pz2s8\" (UID: \"400ab776-eeca-41d9-98ec-a2528e50199b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:08:26.171593 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.171494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/400ab776-eeca-41d9-98ec-a2528e50199b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pz2s8\" (UID: \"400ab776-eeca-41d9-98ec-a2528e50199b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:08:26.171593 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.171562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6vb6\" (UniqueName: \"kubernetes.io/projected/400ab776-eeca-41d9-98ec-a2528e50199b-kube-api-access-v6vb6\") pod \"kuadrant-operator-controller-manager-86878c769f-pz2s8\" (UID: \"400ab776-eeca-41d9-98ec-a2528e50199b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:08:26.171890 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.171869    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/400ab776-eeca-41d9-98ec-a2528e50199b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pz2s8\" (UID: \"400ab776-eeca-41d9-98ec-a2528e50199b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:08:26.180703 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.180672    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6vb6\" (UniqueName: \"kubernetes.io/projected/400ab776-eeca-41d9-98ec-a2528e50199b-kube-api-access-v6vb6\") pod \"kuadrant-operator-controller-manager-86878c769f-pz2s8\" (UID: \"400ab776-eeca-41d9-98ec-a2528e50199b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:08:26.199971 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.199941    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:08:26.342369 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.342346    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"]
Jul 14 08:08:26.344762 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:08:26.344725    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400ab776_eeca_41d9_98ec_a2528e50199b.slice/crio-c690de9e327056b0823d54ce3816393e82e9cc0e7e902674326d65edf507bba2 WatchSource:0}: Error finding container c690de9e327056b0823d54ce3816393e82e9cc0e7e902674326d65edf507bba2: Status 404 returned error can't find the container with id c690de9e327056b0823d54ce3816393e82e9cc0e7e902674326d65edf507bba2
Jul 14 08:08:26.774543 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.774504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8" event={"ID":"400ab776-eeca-41d9-98ec-a2528e50199b","Type":"ContainerStarted","Data":"ac40f08b176c3989ec3166dac155be28cc65e520bbe74c5094c9e0a232e05663"}
Jul 14 08:08:26.774751 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.774560    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8" event={"ID":"400ab776-eeca-41d9-98ec-a2528e50199b","Type":"ContainerStarted","Data":"c690de9e327056b0823d54ce3816393e82e9cc0e7e902674326d65edf507bba2"}
Jul 14 08:08:26.774751 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.774662    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:08:26.795369 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:26.795320    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8" podStartSLOduration=1.795303129 podStartE2EDuration="1.795303129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:08:26.793657882 +0000 UTC m=+1129.535575789" watchObservedRunningTime="2026-07-14 08:08:26.795303129 +0000 UTC m=+1129.537220996"
Jul 14 08:08:37.782897 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:08:37.782868    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz2s8"
Jul 14 08:09:37.678704 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:09:37.678678    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:09:37.681279 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:09:37.679879    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:09:37.682692 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:09:37.682673    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:09:37.683650 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:09:37.683634    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:14:37.715767 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:37.715740    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:14:37.718425 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:37.716789    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:14:37.719644 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:37.719626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:14:37.720645 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:37.720629    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:14:39.944153 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:39.944118    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"]
Jul 14 08:14:39.948493 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:39.948468    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:39.952163 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:39.952139    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b1c5cd00-serving-cert\""
Jul 14 08:14:39.976221 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:39.976192    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"]
Jul 14 08:14:39.986628 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:39.986601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6bd6bc-d848-47e2-8c93-684c19572f22-openshift-service-ca\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:39.986765 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:39.986643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx8pz\" (UniqueName: \"kubernetes.io/projected/5f6bd6bc-d848-47e2-8c93-684c19572f22-kube-api-access-nx8pz\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:39.986765 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:39.986737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f6bd6bc-d848-47e2-8c93-684c19572f22-maas-api-tls\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:40.087501 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:40.087465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6bd6bc-d848-47e2-8c93-684c19572f22-openshift-service-ca\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:40.087697 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:40.087517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx8pz\" (UniqueName: \"kubernetes.io/projected/5f6bd6bc-d848-47e2-8c93-684c19572f22-kube-api-access-nx8pz\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:40.087697 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:40.087566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f6bd6bc-d848-47e2-8c93-684c19572f22-maas-api-tls\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:40.087697 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:14:40.087681    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-serving-cert: secret "maas-api-e2e-ait-b1c5cd00-serving-cert" not found
Jul 14 08:14:40.087865 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:14:40.087751    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6bd6bc-d848-47e2-8c93-684c19572f22-maas-api-tls podName:5f6bd6bc-d848-47e2-8c93-684c19572f22 nodeName:}" failed. No retries permitted until 2026-07-14 08:14:40.587729549 +0000 UTC m=+1503.329647395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f6bd6bc-d848-47e2-8c93-684c19572f22-maas-api-tls") pod "maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28" (UID: "5f6bd6bc-d848-47e2-8c93-684c19572f22") : secret "maas-api-e2e-ait-b1c5cd00-serving-cert" not found
Jul 14 08:14:40.088263 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:40.088240    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6bd6bc-d848-47e2-8c93-684c19572f22-openshift-service-ca\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:40.105739 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:40.105713    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx8pz\" (UniqueName: \"kubernetes.io/projected/5f6bd6bc-d848-47e2-8c93-684c19572f22-kube-api-access-nx8pz\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:40.593026 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:40.592974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f6bd6bc-d848-47e2-8c93-684c19572f22-maas-api-tls\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:40.595423 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:40.595402    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f6bd6bc-d848-47e2-8c93-684c19572f22-maas-api-tls\") pod \"maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:40.860545 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:40.860449    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:41.012259 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:41.011377    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"]
Jul 14 08:14:41.013638 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:41.013618    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 08:14:41.789821 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:41.789778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28" event={"ID":"5f6bd6bc-d848-47e2-8c93-684c19572f22","Type":"ContainerStarted","Data":"8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81"}
Jul 14 08:14:41.789997 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:41.789917    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:14:41.789997 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:41.789945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28" event={"ID":"5f6bd6bc-d848-47e2-8c93-684c19572f22","Type":"ContainerStarted","Data":"1a4871383cc3b5494906a16b48a68b8dc4ceb97faeb478a8c4dadfdcc74e6801"}
Jul 14 08:14:41.807621 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:41.807575    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28" podStartSLOduration=2.230646937 podStartE2EDuration="2.807559436s" totalImagesPullingTime="576.912499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:14:41.807154408 +0000 UTC m=+1504.549072277" watchObservedRunningTime="2026-07-14 08:14:41.807559436 +0000 UTC m=+1504.549477304"
Jul 14 08:14:47.800457 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:14:47.800425    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:15:55.162784 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.162747    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"]
Jul 14 08:15:55.163404 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.162991    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28" podUID="5f6bd6bc-d848-47e2-8c93-684c19572f22" containerName="maas-api" containerID="cri-o://8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81" gracePeriod=30
Jul 14 08:15:55.427205 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.427136    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:15:55.596424 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.596369    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f6bd6bc-d848-47e2-8c93-684c19572f22-maas-api-tls\") pod \"5f6bd6bc-d848-47e2-8c93-684c19572f22\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") "
Jul 14 08:15:55.596424 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.596429    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6bd6bc-d848-47e2-8c93-684c19572f22-openshift-service-ca\") pod \"5f6bd6bc-d848-47e2-8c93-684c19572f22\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") "
Jul 14 08:15:55.596698 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.596476    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx8pz\" (UniqueName: \"kubernetes.io/projected/5f6bd6bc-d848-47e2-8c93-684c19572f22-kube-api-access-nx8pz\") pod \"5f6bd6bc-d848-47e2-8c93-684c19572f22\" (UID: \"5f6bd6bc-d848-47e2-8c93-684c19572f22\") "
Jul 14 08:15:55.596828 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.596799    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f6bd6bc-d848-47e2-8c93-684c19572f22-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f6bd6bc-d848-47e2-8c93-684c19572f22" (UID: "5f6bd6bc-d848-47e2-8c93-684c19572f22"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:15:55.598634 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.598602    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f6bd6bc-d848-47e2-8c93-684c19572f22-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f6bd6bc-d848-47e2-8c93-684c19572f22" (UID: "5f6bd6bc-d848-47e2-8c93-684c19572f22"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:15:55.598793 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.598772    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f6bd6bc-d848-47e2-8c93-684c19572f22-kube-api-access-nx8pz" (OuterVolumeSpecName: "kube-api-access-nx8pz") pod "5f6bd6bc-d848-47e2-8c93-684c19572f22" (UID: "5f6bd6bc-d848-47e2-8c93-684c19572f22"). InnerVolumeSpecName "kube-api-access-nx8pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:15:55.697265 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.697176    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx8pz\" (UniqueName: \"kubernetes.io/projected/5f6bd6bc-d848-47e2-8c93-684c19572f22-kube-api-access-nx8pz\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:15:55.697265 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.697204    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f6bd6bc-d848-47e2-8c93-684c19572f22-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:15:55.697265 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:55.697213    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6bd6bc-d848-47e2-8c93-684c19572f22-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:15:56.192840 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:56.192805    2562 generic.go:356] "Generic (PLEG): container finished" podID="5f6bd6bc-d848-47e2-8c93-684c19572f22" containerID="8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81" exitCode=0
Jul 14 08:15:56.193344 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:56.192852    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"
Jul 14 08:15:56.193344 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:56.192891    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28" event={"ID":"5f6bd6bc-d848-47e2-8c93-684c19572f22","Type":"ContainerDied","Data":"8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81"}
Jul 14 08:15:56.193344 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:56.192950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28" event={"ID":"5f6bd6bc-d848-47e2-8c93-684c19572f22","Type":"ContainerDied","Data":"1a4871383cc3b5494906a16b48a68b8dc4ceb97faeb478a8c4dadfdcc74e6801"}
Jul 14 08:15:56.193344 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:56.192989    2562 scope.go:117] "RemoveContainer" containerID="8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81"
Jul 14 08:15:56.202377 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:56.202359    2562 scope.go:117] "RemoveContainer" containerID="8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81"
Jul 14 08:15:56.202647 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:15:56.202624    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81\": container with ID starting with 8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81 not found: ID does not exist" containerID="8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81"
Jul 14 08:15:56.202714 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:56.202659    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81"} err="failed to get container status \"8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81\": rpc error: code = NotFound desc = could not find container \"8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81\": container with ID starting with 8afe949c06566bb1a7fb10bf6968dcf66a279283e5c5e621d7a501451ab03d81 not found: ID does not exist"
Jul 14 08:15:56.210119 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:56.210086    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"]
Jul 14 08:15:56.214215 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:56.214194    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1c5cd00-77fbc55b5b-kcz28"]
Jul 14 08:15:57.701074 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:15:57.701036    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f6bd6bc-d848-47e2-8c93-684c19572f22" path="/var/lib/kubelet/pods/5f6bd6bc-d848-47e2-8c93-684c19572f22/volumes"
Jul 14 08:16:11.974204 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:11.974167    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"]
Jul 14 08:16:11.974747 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:11.974680    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f6bd6bc-d848-47e2-8c93-684c19572f22" containerName="maas-api"
Jul 14 08:16:11.974747 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:11.974699    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f6bd6bc-d848-47e2-8c93-684c19572f22" containerName="maas-api"
Jul 14 08:16:11.974881 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:11.974835    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f6bd6bc-d848-47e2-8c93-684c19572f22" containerName="maas-api"
Jul 14 08:16:11.978261 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:11.978239    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:11.982787 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:11.982763    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-b0c3e934-serving-cert\""
Jul 14 08:16:11.990978 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:11.990952    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"]
Jul 14 08:16:12.046987 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.046945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c24644a-852d-4677-9680-a49802d2b72b-openshift-service-ca\") pod \"maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.047192 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.047101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzlq5\" (UniqueName: \"kubernetes.io/projected/2c24644a-852d-4677-9680-a49802d2b72b-kube-api-access-dzlq5\") pod \"maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.047192 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.047155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c24644a-852d-4677-9680-a49802d2b72b-maas-api-tls\") pod \"maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.148379 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.148338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c24644a-852d-4677-9680-a49802d2b72b-maas-api-tls\") pod \"maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.148544 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.148390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c24644a-852d-4677-9680-a49802d2b72b-openshift-service-ca\") pod \"maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.148544 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.148480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzlq5\" (UniqueName: \"kubernetes.io/projected/2c24644a-852d-4677-9680-a49802d2b72b-kube-api-access-dzlq5\") pod \"maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.149335 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.149306    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c24644a-852d-4677-9680-a49802d2b72b-openshift-service-ca\") pod \"maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.150889 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.150855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c24644a-852d-4677-9680-a49802d2b72b-maas-api-tls\") pod \"maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.157293 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.157273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzlq5\" (UniqueName: \"kubernetes.io/projected/2c24644a-852d-4677-9680-a49802d2b72b-kube-api-access-dzlq5\") pod \"maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.295077 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.294983    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:12.448170 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:12.448143    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"]
Jul 14 08:16:12.450087 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:16:12.449987    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c24644a_852d_4677_9680_a49802d2b72b.slice/crio-0951459987eea95471bba576028833834bac1918aabae3a55ebb0c454107b86b WatchSource:0}: Error finding container 0951459987eea95471bba576028833834bac1918aabae3a55ebb0c454107b86b: Status 404 returned error can't find the container with id 0951459987eea95471bba576028833834bac1918aabae3a55ebb0c454107b86b
Jul 14 08:16:13.285546 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:13.285512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r" event={"ID":"2c24644a-852d-4677-9680-a49802d2b72b","Type":"ContainerStarted","Data":"e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2"}
Jul 14 08:16:13.286050 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:13.285562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r" event={"ID":"2c24644a-852d-4677-9680-a49802d2b72b","Type":"ContainerStarted","Data":"0951459987eea95471bba576028833834bac1918aabae3a55ebb0c454107b86b"}
Jul 14 08:16:13.286050 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:13.285607    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:19.296206 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:19.296174    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:16:19.314683 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:16:19.314636    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r" podStartSLOduration=7.816233063 podStartE2EDuration="8.314619543s" totalImagesPullingTime="498.38648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:16:13.312837368 +0000 UTC m=+1596.054755235" watchObservedRunningTime="2026-07-14 08:16:19.314619543 +0000 UTC m=+1602.056537447"
Jul 14 08:17:16.913191 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:16.913145    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"]
Jul 14 08:17:16.913826 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:16.913391    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r" podUID="2c24644a-852d-4677-9680-a49802d2b72b" containerName="maas-api" containerID="cri-o://e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2" gracePeriod=30
Jul 14 08:17:17.177537 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.177477    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:17:17.344723 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.344685    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c24644a-852d-4677-9680-a49802d2b72b-openshift-service-ca\") pod \"2c24644a-852d-4677-9680-a49802d2b72b\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") "
Jul 14 08:17:17.344922 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.344745    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c24644a-852d-4677-9680-a49802d2b72b-maas-api-tls\") pod \"2c24644a-852d-4677-9680-a49802d2b72b\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") "
Jul 14 08:17:17.344922 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.344796    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzlq5\" (UniqueName: \"kubernetes.io/projected/2c24644a-852d-4677-9680-a49802d2b72b-kube-api-access-dzlq5\") pod \"2c24644a-852d-4677-9680-a49802d2b72b\" (UID: \"2c24644a-852d-4677-9680-a49802d2b72b\") "
Jul 14 08:17:17.345153 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.345129    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c24644a-852d-4677-9680-a49802d2b72b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c24644a-852d-4677-9680-a49802d2b72b" (UID: "2c24644a-852d-4677-9680-a49802d2b72b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:17:17.346868 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.346839    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c24644a-852d-4677-9680-a49802d2b72b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c24644a-852d-4677-9680-a49802d2b72b" (UID: "2c24644a-852d-4677-9680-a49802d2b72b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:17:17.346977 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.346889    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c24644a-852d-4677-9680-a49802d2b72b-kube-api-access-dzlq5" (OuterVolumeSpecName: "kube-api-access-dzlq5") pod "2c24644a-852d-4677-9680-a49802d2b72b" (UID: "2c24644a-852d-4677-9680-a49802d2b72b"). InnerVolumeSpecName "kube-api-access-dzlq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:17:17.446067 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.445952    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzlq5\" (UniqueName: \"kubernetes.io/projected/2c24644a-852d-4677-9680-a49802d2b72b-kube-api-access-dzlq5\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:17:17.446067 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.445981    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c24644a-852d-4677-9680-a49802d2b72b-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:17:17.446067 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.445994    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c24644a-852d-4677-9680-a49802d2b72b-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:17:17.623610 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.623573    2562 generic.go:356] "Generic (PLEG): container finished" podID="2c24644a-852d-4677-9680-a49802d2b72b" containerID="e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2" exitCode=0
Jul 14 08:17:17.623794 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.623623    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"
Jul 14 08:17:17.623794 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.623652    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r" event={"ID":"2c24644a-852d-4677-9680-a49802d2b72b","Type":"ContainerDied","Data":"e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2"}
Jul 14 08:17:17.623794 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.623698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r" event={"ID":"2c24644a-852d-4677-9680-a49802d2b72b","Type":"ContainerDied","Data":"0951459987eea95471bba576028833834bac1918aabae3a55ebb0c454107b86b"}
Jul 14 08:17:17.623794 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.623720    2562 scope.go:117] "RemoveContainer" containerID="e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2"
Jul 14 08:17:17.633686 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.633671    2562 scope.go:117] "RemoveContainer" containerID="e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2"
Jul 14 08:17:17.633940 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:17:17.633922    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2\": container with ID starting with e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2 not found: ID does not exist" containerID="e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2"
Jul 14 08:17:17.634041 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.633948    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2"} err="failed to get container status \"e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2\": rpc error: code = NotFound desc = could not find container \"e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2\": container with ID starting with e9c1c2630c838d9273b1b7e7eac256d22980dce77c1a8a1a32dd9abf3657bae2 not found: ID does not exist"
Jul 14 08:17:17.646537 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.646514    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"]
Jul 14 08:17:17.648625 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.648606    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b0c3e934-84dcf68dd4-2978r"]
Jul 14 08:17:17.700661 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:17.700588    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c24644a-852d-4677-9680-a49802d2b72b" path="/var/lib/kubelet/pods/2c24644a-852d-4677-9680-a49802d2b72b/volumes"
Jul 14 08:17:23.950030 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:23.949980    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"]
Jul 14 08:17:23.950654 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:23.950638    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c24644a-852d-4677-9680-a49802d2b72b" containerName="maas-api"
Jul 14 08:17:23.950702 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:23.950657    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c24644a-852d-4677-9680-a49802d2b72b" containerName="maas-api"
Jul 14 08:17:23.950761 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:23.950750    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c24644a-852d-4677-9680-a49802d2b72b" containerName="maas-api"
Jul 14 08:17:23.955703 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:23.955681    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:23.958474 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:23.958453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c0f2014a-serving-cert\""
Jul 14 08:17:23.963152 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:23.963132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"]
Jul 14 08:17:24.109288 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.109249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322651d2-805a-4262-a2f8-4d408d2d3463-openshift-service-ca\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.109489 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.109298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj9zr\" (UniqueName: \"kubernetes.io/projected/322651d2-805a-4262-a2f8-4d408d2d3463-kube-api-access-xj9zr\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.109489 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.109316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322651d2-805a-4262-a2f8-4d408d2d3463-maas-api-tls\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.210234 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.210131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322651d2-805a-4262-a2f8-4d408d2d3463-openshift-service-ca\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.210234 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.210190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj9zr\" (UniqueName: \"kubernetes.io/projected/322651d2-805a-4262-a2f8-4d408d2d3463-kube-api-access-xj9zr\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.210234 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.210216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322651d2-805a-4262-a2f8-4d408d2d3463-maas-api-tls\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.210531 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:17:24.210367    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-serving-cert: secret "maas-api-e2e-ait-c0f2014a-serving-cert" not found
Jul 14 08:17:24.210531 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:17:24.210448    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/322651d2-805a-4262-a2f8-4d408d2d3463-maas-api-tls podName:322651d2-805a-4262-a2f8-4d408d2d3463 nodeName:}" failed. No retries permitted until 2026-07-14 08:17:24.71042571 +0000 UTC m=+1667.452343556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/322651d2-805a-4262-a2f8-4d408d2d3463-maas-api-tls") pod "maas-api-e2e-ait-c0f2014a-7498694f77-7pd24" (UID: "322651d2-805a-4262-a2f8-4d408d2d3463") : secret "maas-api-e2e-ait-c0f2014a-serving-cert" not found
Jul 14 08:17:24.210845 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.210824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322651d2-805a-4262-a2f8-4d408d2d3463-openshift-service-ca\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.241655 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.241625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj9zr\" (UniqueName: \"kubernetes.io/projected/322651d2-805a-4262-a2f8-4d408d2d3463-kube-api-access-xj9zr\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.716192 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.716154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322651d2-805a-4262-a2f8-4d408d2d3463-maas-api-tls\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.719311 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.719275    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322651d2-805a-4262-a2f8-4d408d2d3463-maas-api-tls\") pod \"maas-api-e2e-ait-c0f2014a-7498694f77-7pd24\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:24.869897 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:24.869859    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:25.018470 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:25.018439    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"]
Jul 14 08:17:25.020224 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:17:25.020199    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322651d2_805a_4262_a2f8_4d408d2d3463.slice/crio-0a1d6cc2154573129aae6bac365faf7864532e1e586751603b1ad6130c16d7ea WatchSource:0}: Error finding container 0a1d6cc2154573129aae6bac365faf7864532e1e586751603b1ad6130c16d7ea: Status 404 returned error can't find the container with id 0a1d6cc2154573129aae6bac365faf7864532e1e586751603b1ad6130c16d7ea
Jul 14 08:17:25.668982 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:25.668945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24" event={"ID":"322651d2-805a-4262-a2f8-4d408d2d3463","Type":"ContainerStarted","Data":"5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8"}
Jul 14 08:17:25.669168 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:25.669000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24" event={"ID":"322651d2-805a-4262-a2f8-4d408d2d3463","Type":"ContainerStarted","Data":"0a1d6cc2154573129aae6bac365faf7864532e1e586751603b1ad6130c16d7ea"}
Jul 14 08:17:25.669168 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:25.669039    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:17:25.690927 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:25.690874    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24" podStartSLOduration=2.231560883 podStartE2EDuration="2.690857156s" totalImagesPullingTime="459.296273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:17:25.688766669 +0000 UTC m=+1668.430684552" watchObservedRunningTime="2026-07-14 08:17:25.690857156 +0000 UTC m=+1668.432775023"
Jul 14 08:17:31.680740 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:17:31.680709    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:18:29.393831 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.393797    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"]
Jul 14 08:18:29.394985 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.394800    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24" podUID="322651d2-805a-4262-a2f8-4d408d2d3463" containerName="maas-api" containerID="cri-o://5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8" gracePeriod=30
Jul 14 08:18:29.660042 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.659965    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:18:29.704930 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.704893    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj9zr\" (UniqueName: \"kubernetes.io/projected/322651d2-805a-4262-a2f8-4d408d2d3463-kube-api-access-xj9zr\") pod \"322651d2-805a-4262-a2f8-4d408d2d3463\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") "
Jul 14 08:18:29.705125 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.704986    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322651d2-805a-4262-a2f8-4d408d2d3463-maas-api-tls\") pod \"322651d2-805a-4262-a2f8-4d408d2d3463\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") "
Jul 14 08:18:29.705125 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.705095    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322651d2-805a-4262-a2f8-4d408d2d3463-openshift-service-ca\") pod \"322651d2-805a-4262-a2f8-4d408d2d3463\" (UID: \"322651d2-805a-4262-a2f8-4d408d2d3463\") "
Jul 14 08:18:29.705469 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.705437    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/322651d2-805a-4262-a2f8-4d408d2d3463-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "322651d2-805a-4262-a2f8-4d408d2d3463" (UID: "322651d2-805a-4262-a2f8-4d408d2d3463"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:18:29.707073 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.707047    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/322651d2-805a-4262-a2f8-4d408d2d3463-kube-api-access-xj9zr" (OuterVolumeSpecName: "kube-api-access-xj9zr") pod "322651d2-805a-4262-a2f8-4d408d2d3463" (UID: "322651d2-805a-4262-a2f8-4d408d2d3463"). InnerVolumeSpecName "kube-api-access-xj9zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:18:29.707073 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.707065    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322651d2-805a-4262-a2f8-4d408d2d3463-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "322651d2-805a-4262-a2f8-4d408d2d3463" (UID: "322651d2-805a-4262-a2f8-4d408d2d3463"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:18:29.806750 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.806715    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj9zr\" (UniqueName: \"kubernetes.io/projected/322651d2-805a-4262-a2f8-4d408d2d3463-kube-api-access-xj9zr\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:18:29.806750 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.806744    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322651d2-805a-4262-a2f8-4d408d2d3463-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:18:29.806750 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:29.806756    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322651d2-805a-4262-a2f8-4d408d2d3463-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:18:30.014236 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:30.014194    2562 generic.go:356] "Generic (PLEG): container finished" podID="322651d2-805a-4262-a2f8-4d408d2d3463" containerID="5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8" exitCode=0
Jul 14 08:18:30.014410 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:30.014242    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"
Jul 14 08:18:30.014410 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:30.014274    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24" event={"ID":"322651d2-805a-4262-a2f8-4d408d2d3463","Type":"ContainerDied","Data":"5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8"}
Jul 14 08:18:30.014410 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:30.014327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24" event={"ID":"322651d2-805a-4262-a2f8-4d408d2d3463","Type":"ContainerDied","Data":"0a1d6cc2154573129aae6bac365faf7864532e1e586751603b1ad6130c16d7ea"}
Jul 14 08:18:30.014410 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:30.014360    2562 scope.go:117] "RemoveContainer" containerID="5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8"
Jul 14 08:18:30.024948 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:30.024923    2562 scope.go:117] "RemoveContainer" containerID="5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8"
Jul 14 08:18:30.025261 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:18:30.025241    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8\": container with ID starting with 5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8 not found: ID does not exist" containerID="5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8"
Jul 14 08:18:30.025331 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:30.025270    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8"} err="failed to get container status \"5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8\": rpc error: code = NotFound desc = could not find container \"5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8\": container with ID starting with 5c25731c7ef2226b40d3d3568ac0058f3285f325b11fd6bc9c65a0fe337423b8 not found: ID does not exist"
Jul 14 08:18:30.040217 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:30.040189    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"]
Jul 14 08:18:30.044227 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:30.044204    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f2014a-7498694f77-7pd24"]
Jul 14 08:18:31.702290 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:31.702259    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="322651d2-805a-4262-a2f8-4d408d2d3463" path="/var/lib/kubelet/pods/322651d2-805a-4262-a2f8-4d408d2d3463/volumes"
Jul 14 08:18:46.781038 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.780988    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"]
Jul 14 08:18:46.781628 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.781608    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="322651d2-805a-4262-a2f8-4d408d2d3463" containerName="maas-api"
Jul 14 08:18:46.781711 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.781631    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="322651d2-805a-4262-a2f8-4d408d2d3463" containerName="maas-api"
Jul 14 08:18:46.781764 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.781726    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="322651d2-805a-4262-a2f8-4d408d2d3463" containerName="maas-api"
Jul 14 08:18:46.784846 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.784825    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:46.787518 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.787487    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-98e5d5c2-serving-cert\""
Jul 14 08:18:46.797684 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.797663    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"]
Jul 14 08:18:46.864702 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.864666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ch4t\" (UniqueName: \"kubernetes.io/projected/f9879e33-5e75-4304-b8aa-5f7df675f172-kube-api-access-2ch4t\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:46.864879 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.864721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9879e33-5e75-4304-b8aa-5f7df675f172-maas-api-tls\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:46.864879 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.864778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9879e33-5e75-4304-b8aa-5f7df675f172-openshift-service-ca\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:46.965771 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.965737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9879e33-5e75-4304-b8aa-5f7df675f172-maas-api-tls\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:46.965985 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.965801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9879e33-5e75-4304-b8aa-5f7df675f172-openshift-service-ca\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:46.965985 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.965876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ch4t\" (UniqueName: \"kubernetes.io/projected/f9879e33-5e75-4304-b8aa-5f7df675f172-kube-api-access-2ch4t\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:46.965985 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:18:46.965888    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-serving-cert: secret "maas-api-e2e-derive-98e5d5c2-serving-cert" not found
Jul 14 08:18:46.965985 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:18:46.965965    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9879e33-5e75-4304-b8aa-5f7df675f172-maas-api-tls podName:f9879e33-5e75-4304-b8aa-5f7df675f172 nodeName:}" failed. No retries permitted until 2026-07-14 08:18:47.465947017 +0000 UTC m=+1750.207864866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f9879e33-5e75-4304-b8aa-5f7df675f172-maas-api-tls") pod "maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb" (UID: "f9879e33-5e75-4304-b8aa-5f7df675f172") : secret "maas-api-e2e-derive-98e5d5c2-serving-cert" not found
Jul 14 08:18:46.966526 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.966505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9879e33-5e75-4304-b8aa-5f7df675f172-openshift-service-ca\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:46.976901 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:46.976875    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ch4t\" (UniqueName: \"kubernetes.io/projected/f9879e33-5e75-4304-b8aa-5f7df675f172-kube-api-access-2ch4t\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:47.470227 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:47.470193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9879e33-5e75-4304-b8aa-5f7df675f172-maas-api-tls\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:47.472681 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:47.472649    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9879e33-5e75-4304-b8aa-5f7df675f172-maas-api-tls\") pod \"maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:47.695557 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:47.695521    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:47.844304 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:47.844273    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"]
Jul 14 08:18:47.846440 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:18:47.846413    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9879e33_5e75_4304_b8aa_5f7df675f172.slice/crio-d3e5dfe30b2e22dcdc2aa821c98cd57cfc007b1683a425104b53ebc3a120bc60 WatchSource:0}: Error finding container d3e5dfe30b2e22dcdc2aa821c98cd57cfc007b1683a425104b53ebc3a120bc60: Status 404 returned error can't find the container with id d3e5dfe30b2e22dcdc2aa821c98cd57cfc007b1683a425104b53ebc3a120bc60
Jul 14 08:18:48.116399 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:48.116298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb" event={"ID":"f9879e33-5e75-4304-b8aa-5f7df675f172","Type":"ContainerStarted","Data":"d3e5dfe30b2e22dcdc2aa821c98cd57cfc007b1683a425104b53ebc3a120bc60"}
Jul 14 08:18:49.124753 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:49.124717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb" event={"ID":"f9879e33-5e75-4304-b8aa-5f7df675f172","Type":"ContainerStarted","Data":"2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f"}
Jul 14 08:18:49.125142 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:49.124800    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:18:49.143175 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:49.143122    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb" podStartSLOduration=2.781262761 podStartE2EDuration="3.143106255s" totalImagesPullingTime="361.843494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:18:49.141847554 +0000 UTC m=+1751.883765438" watchObservedRunningTime="2026-07-14 08:18:49.143106255 +0000 UTC m=+1751.885024123"
Jul 14 08:18:55.135418 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:18:55.135389    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:19:37.751889 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:37.751783    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:19:37.757892 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:37.754728    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:19:37.757892 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:37.755923    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:19:37.758520 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:37.758504    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:19:51.375955 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.375921    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"]
Jul 14 08:19:51.377512 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.377461    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb" podUID="f9879e33-5e75-4304-b8aa-5f7df675f172" containerName="maas-api" containerID="cri-o://2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f" gracePeriod=30
Jul 14 08:19:51.646901 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.646827    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:19:51.670278 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.670247    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9879e33-5e75-4304-b8aa-5f7df675f172-maas-api-tls\") pod \"f9879e33-5e75-4304-b8aa-5f7df675f172\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") "
Jul 14 08:19:51.670483 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.670294    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ch4t\" (UniqueName: \"kubernetes.io/projected/f9879e33-5e75-4304-b8aa-5f7df675f172-kube-api-access-2ch4t\") pod \"f9879e33-5e75-4304-b8aa-5f7df675f172\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") "
Jul 14 08:19:51.670483 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.670360    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9879e33-5e75-4304-b8aa-5f7df675f172-openshift-service-ca\") pod \"f9879e33-5e75-4304-b8aa-5f7df675f172\" (UID: \"f9879e33-5e75-4304-b8aa-5f7df675f172\") "
Jul 14 08:19:51.670968 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.670939    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9879e33-5e75-4304-b8aa-5f7df675f172-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f9879e33-5e75-4304-b8aa-5f7df675f172" (UID: "f9879e33-5e75-4304-b8aa-5f7df675f172"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:19:51.672799 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.672774    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9879e33-5e75-4304-b8aa-5f7df675f172-kube-api-access-2ch4t" (OuterVolumeSpecName: "kube-api-access-2ch4t") pod "f9879e33-5e75-4304-b8aa-5f7df675f172" (UID: "f9879e33-5e75-4304-b8aa-5f7df675f172"). InnerVolumeSpecName "kube-api-access-2ch4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:19:51.672799 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.672792    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9879e33-5e75-4304-b8aa-5f7df675f172-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f9879e33-5e75-4304-b8aa-5f7df675f172" (UID: "f9879e33-5e75-4304-b8aa-5f7df675f172"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:19:51.771033 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.770988    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9879e33-5e75-4304-b8aa-5f7df675f172-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:19:51.771033 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.771031    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9879e33-5e75-4304-b8aa-5f7df675f172-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:19:51.771033 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:51.771041    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ch4t\" (UniqueName: \"kubernetes.io/projected/f9879e33-5e75-4304-b8aa-5f7df675f172-kube-api-access-2ch4t\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:19:52.450897 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:52.450867    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9879e33-5e75-4304-b8aa-5f7df675f172" containerID="2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f" exitCode=0
Jul 14 08:19:52.451324 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:52.450914    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"
Jul 14 08:19:52.451324 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:52.450930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb" event={"ID":"f9879e33-5e75-4304-b8aa-5f7df675f172","Type":"ContainerDied","Data":"2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f"}
Jul 14 08:19:52.451324 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:52.450973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb" event={"ID":"f9879e33-5e75-4304-b8aa-5f7df675f172","Type":"ContainerDied","Data":"d3e5dfe30b2e22dcdc2aa821c98cd57cfc007b1683a425104b53ebc3a120bc60"}
Jul 14 08:19:52.451324 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:52.450996    2562 scope.go:117] "RemoveContainer" containerID="2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f"
Jul 14 08:19:52.460358 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:52.460338    2562 scope.go:117] "RemoveContainer" containerID="2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f"
Jul 14 08:19:52.460620 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:19:52.460600    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f\": container with ID starting with 2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f not found: ID does not exist" containerID="2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f"
Jul 14 08:19:52.460687 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:52.460629    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f"} err="failed to get container status \"2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f\": rpc error: code = NotFound desc = could not find container \"2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f\": container with ID starting with 2def9064655fcae36bc8506223d66ae47dfec0129da6e185428a6816d084c10f not found: ID does not exist"
Jul 14 08:19:52.467921 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:52.467899    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"]
Jul 14 08:19:52.471432 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:52.471413    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-98e5d5c2-76778fc95d-w9hlb"]
Jul 14 08:19:53.700571 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:19:53.700535    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9879e33-5e75-4304-b8aa-5f7df675f172" path="/var/lib/kubelet/pods/f9879e33-5e75-4304-b8aa-5f7df675f172/volumes"
Jul 14 08:21:46.274720 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.274688    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"]
Jul 14 08:21:46.275310 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.275211    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9879e33-5e75-4304-b8aa-5f7df675f172" containerName="maas-api"
Jul 14 08:21:46.275310 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.275226    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9879e33-5e75-4304-b8aa-5f7df675f172" containerName="maas-api"
Jul 14 08:21:46.275310 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.275292    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9879e33-5e75-4304-b8aa-5f7df675f172" containerName="maas-api"
Jul 14 08:21:46.278667 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.278646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.281424 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.281399    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b112a181-serving-cert\""
Jul 14 08:21:46.293923 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.293894    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"]
Jul 14 08:21:46.426902 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.426858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkwb6\" (UniqueName: \"kubernetes.io/projected/674bd9b1-7024-446b-b5b7-b04246272303-kube-api-access-nkwb6\") pod \"maas-api-e2e-mt-b112a181-5d5b9464b-92mts\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.427103 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.426933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/674bd9b1-7024-446b-b5b7-b04246272303-maas-api-tls\") pod \"maas-api-e2e-mt-b112a181-5d5b9464b-92mts\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.427103 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.426984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/674bd9b1-7024-446b-b5b7-b04246272303-openshift-service-ca\") pod \"maas-api-e2e-mt-b112a181-5d5b9464b-92mts\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.528453 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.528373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkwb6\" (UniqueName: \"kubernetes.io/projected/674bd9b1-7024-446b-b5b7-b04246272303-kube-api-access-nkwb6\") pod \"maas-api-e2e-mt-b112a181-5d5b9464b-92mts\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.528453 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.528418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/674bd9b1-7024-446b-b5b7-b04246272303-maas-api-tls\") pod \"maas-api-e2e-mt-b112a181-5d5b9464b-92mts\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.528453 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.528452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/674bd9b1-7024-446b-b5b7-b04246272303-openshift-service-ca\") pod \"maas-api-e2e-mt-b112a181-5d5b9464b-92mts\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.529075 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.529055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/674bd9b1-7024-446b-b5b7-b04246272303-openshift-service-ca\") pod \"maas-api-e2e-mt-b112a181-5d5b9464b-92mts\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.530842 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.530817    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/674bd9b1-7024-446b-b5b7-b04246272303-maas-api-tls\") pod \"maas-api-e2e-mt-b112a181-5d5b9464b-92mts\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.537987 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.537964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkwb6\" (UniqueName: \"kubernetes.io/projected/674bd9b1-7024-446b-b5b7-b04246272303-kube-api-access-nkwb6\") pod \"maas-api-e2e-mt-b112a181-5d5b9464b-92mts\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.590066 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.590034    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:46.730950 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.730920    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"]
Jul 14 08:21:46.733514 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:21:46.733483    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674bd9b1_7024_446b_b5b7_b04246272303.slice/crio-717396b6be27486820b7a386aeb78c3e43246b6865032068c60715c04d43a4a9 WatchSource:0}: Error finding container 717396b6be27486820b7a386aeb78c3e43246b6865032068c60715c04d43a4a9: Status 404 returned error can't find the container with id 717396b6be27486820b7a386aeb78c3e43246b6865032068c60715c04d43a4a9
Jul 14 08:21:46.735468 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:46.735449    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 08:21:47.056505 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:47.056465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts" event={"ID":"674bd9b1-7024-446b-b5b7-b04246272303","Type":"ContainerStarted","Data":"717396b6be27486820b7a386aeb78c3e43246b6865032068c60715c04d43a4a9"}
Jul 14 08:21:48.063649 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:48.063608    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts" event={"ID":"674bd9b1-7024-446b-b5b7-b04246272303","Type":"ContainerStarted","Data":"373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a"}
Jul 14 08:21:48.064133 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:48.063693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:21:48.083334 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:48.083281    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts" podStartSLOduration=1.272302922 podStartE2EDuration="2.083264445s" totalImagesPullingTime="810.961523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:21:48.081499643 +0000 UTC m=+1930.823417531" watchObservedRunningTime="2026-07-14 08:21:48.083264445 +0000 UTC m=+1930.825182313"
Jul 14 08:21:54.075282 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:21:54.075250    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:22:08.489284 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.489239    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"]
Jul 14 08:22:08.489760 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.489561    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts" podUID="674bd9b1-7024-446b-b5b7-b04246272303" containerName="maas-api" containerID="cri-o://373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a" gracePeriod=30
Jul 14 08:22:08.749755 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.749689    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:22:08.836261 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.836230    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/674bd9b1-7024-446b-b5b7-b04246272303-maas-api-tls\") pod \"674bd9b1-7024-446b-b5b7-b04246272303\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") "
Jul 14 08:22:08.836450 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.836276    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkwb6\" (UniqueName: \"kubernetes.io/projected/674bd9b1-7024-446b-b5b7-b04246272303-kube-api-access-nkwb6\") pod \"674bd9b1-7024-446b-b5b7-b04246272303\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") "
Jul 14 08:22:08.836450 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.836336    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/674bd9b1-7024-446b-b5b7-b04246272303-openshift-service-ca\") pod \"674bd9b1-7024-446b-b5b7-b04246272303\" (UID: \"674bd9b1-7024-446b-b5b7-b04246272303\") "
Jul 14 08:22:08.836785 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.836760    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674bd9b1-7024-446b-b5b7-b04246272303-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "674bd9b1-7024-446b-b5b7-b04246272303" (UID: "674bd9b1-7024-446b-b5b7-b04246272303"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:22:08.838476 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.838451    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674bd9b1-7024-446b-b5b7-b04246272303-kube-api-access-nkwb6" (OuterVolumeSpecName: "kube-api-access-nkwb6") pod "674bd9b1-7024-446b-b5b7-b04246272303" (UID: "674bd9b1-7024-446b-b5b7-b04246272303"). InnerVolumeSpecName "kube-api-access-nkwb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:22:08.838542 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.838455    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/674bd9b1-7024-446b-b5b7-b04246272303-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "674bd9b1-7024-446b-b5b7-b04246272303" (UID: "674bd9b1-7024-446b-b5b7-b04246272303"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:22:08.937998 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.937962    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/674bd9b1-7024-446b-b5b7-b04246272303-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:22:08.937998 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.937991    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/674bd9b1-7024-446b-b5b7-b04246272303-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:22:08.937998 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:08.938026    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkwb6\" (UniqueName: \"kubernetes.io/projected/674bd9b1-7024-446b-b5b7-b04246272303-kube-api-access-nkwb6\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:22:09.175368 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.175272    2562 generic.go:356] "Generic (PLEG): container finished" podID="674bd9b1-7024-446b-b5b7-b04246272303" containerID="373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a" exitCode=0
Jul 14 08:22:09.175368 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.175324    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"
Jul 14 08:22:09.175368 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.175353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts" event={"ID":"674bd9b1-7024-446b-b5b7-b04246272303","Type":"ContainerDied","Data":"373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a"}
Jul 14 08:22:09.175609 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.175412    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts" event={"ID":"674bd9b1-7024-446b-b5b7-b04246272303","Type":"ContainerDied","Data":"717396b6be27486820b7a386aeb78c3e43246b6865032068c60715c04d43a4a9"}
Jul 14 08:22:09.175609 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.175434    2562 scope.go:117] "RemoveContainer" containerID="373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a"
Jul 14 08:22:09.185390 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.185371    2562 scope.go:117] "RemoveContainer" containerID="373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a"
Jul 14 08:22:09.185700 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:22:09.185680    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a\": container with ID starting with 373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a not found: ID does not exist" containerID="373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a"
Jul 14 08:22:09.185755 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.185710    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a"} err="failed to get container status \"373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a\": rpc error: code = NotFound desc = could not find container \"373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a\": container with ID starting with 373014c7b0b3cdb5c04e7bf2edec369ae516b36d88c7ef6c34007b625defad6a not found: ID does not exist"
Jul 14 08:22:09.198976 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.198948    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"]
Jul 14 08:22:09.203769 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.203745    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b112a181-5d5b9464b-92mts"]
Jul 14 08:22:09.701111 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:09.701079    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674bd9b1-7024-446b-b5b7-b04246272303" path="/var/lib/kubelet/pods/674bd9b1-7024-446b-b5b7-b04246272303/volumes"
Jul 14 08:22:46.319704 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.319667    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"]
Jul 14 08:22:46.320362 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.320344    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674bd9b1-7024-446b-b5b7-b04246272303" containerName="maas-api"
Jul 14 08:22:46.320426 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.320366    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="674bd9b1-7024-446b-b5b7-b04246272303" containerName="maas-api"
Jul 14 08:22:46.320503 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.320485    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="674bd9b1-7024-446b-b5b7-b04246272303" containerName="maas-api"
Jul 14 08:22:46.330992 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.330957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.335416 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.335388    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9a0f7fb2-serving-cert\""
Jul 14 08:22:46.337822 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.337781    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"]
Jul 14 08:22:46.388828 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.388793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpkms\" (UniqueName: \"kubernetes.io/projected/0e096c9d-891f-4b77-9fcf-7646983f00cb-kube-api-access-bpkms\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.389034 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.388890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e096c9d-891f-4b77-9fcf-7646983f00cb-openshift-service-ca\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.389034 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.388942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e096c9d-891f-4b77-9fcf-7646983f00cb-maas-api-tls\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.489606 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.489565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpkms\" (UniqueName: \"kubernetes.io/projected/0e096c9d-891f-4b77-9fcf-7646983f00cb-kube-api-access-bpkms\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.489816 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.489649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e096c9d-891f-4b77-9fcf-7646983f00cb-openshift-service-ca\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.489816 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.489701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e096c9d-891f-4b77-9fcf-7646983f00cb-maas-api-tls\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.489953 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:22:46.489848    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-serving-cert: secret "maas-api-e2e-mt-9a0f7fb2-serving-cert" not found
Jul 14 08:22:46.489953 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:22:46.489930    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e096c9d-891f-4b77-9fcf-7646983f00cb-maas-api-tls podName:0e096c9d-891f-4b77-9fcf-7646983f00cb nodeName:}" failed. No retries permitted until 2026-07-14 08:22:46.989907705 +0000 UTC m=+1989.731825551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e096c9d-891f-4b77-9fcf-7646983f00cb-maas-api-tls") pod "maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf" (UID: "0e096c9d-891f-4b77-9fcf-7646983f00cb") : secret "maas-api-e2e-mt-9a0f7fb2-serving-cert" not found
Jul 14 08:22:46.490316 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.490293    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e096c9d-891f-4b77-9fcf-7646983f00cb-openshift-service-ca\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.502279 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.502248    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpkms\" (UniqueName: \"kubernetes.io/projected/0e096c9d-891f-4b77-9fcf-7646983f00cb-kube-api-access-bpkms\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.994118 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.994083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e096c9d-891f-4b77-9fcf-7646983f00cb-maas-api-tls\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:46.996472 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:46.996448    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e096c9d-891f-4b77-9fcf-7646983f00cb-maas-api-tls\") pod \"maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:47.245919 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:47.245840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:47.398440 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:47.398415    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"]
Jul 14 08:22:47.400441 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:22:47.400413    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e096c9d_891f_4b77_9fcf_7646983f00cb.slice/crio-08f14cf5ded79c779b9018fc976e2ba27bbe108aa77bb47836bc11729ce69447 WatchSource:0}: Error finding container 08f14cf5ded79c779b9018fc976e2ba27bbe108aa77bb47836bc11729ce69447: Status 404 returned error can't find the container with id 08f14cf5ded79c779b9018fc976e2ba27bbe108aa77bb47836bc11729ce69447
Jul 14 08:22:48.385124 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:48.385032    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf" event={"ID":"0e096c9d-891f-4b77-9fcf-7646983f00cb","Type":"ContainerStarted","Data":"8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8"}
Jul 14 08:22:48.385124 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:48.385096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf" event={"ID":"0e096c9d-891f-4b77-9fcf-7646983f00cb","Type":"ContainerStarted","Data":"08f14cf5ded79c779b9018fc976e2ba27bbe108aa77bb47836bc11729ce69447"}
Jul 14 08:22:48.385362 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:48.385128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:22:48.405987 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:48.405932    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf" podStartSLOduration=1.736491165 podStartE2EDuration="2.405916455s" totalImagesPullingTime="669.42529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:22:48.403978612 +0000 UTC m=+1991.145896480" watchObservedRunningTime="2026-07-14 08:22:48.405916455 +0000 UTC m=+1991.147834323"
Jul 14 08:22:54.397469 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:22:54.397437    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:23:34.358055 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.358015    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"]
Jul 14 08:23:34.358546 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.358278    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf" podUID="0e096c9d-891f-4b77-9fcf-7646983f00cb" containerName="maas-api" containerID="cri-o://8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8" gracePeriod=30
Jul 14 08:23:34.392855 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.392806    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf" podUID="0e096c9d-891f-4b77-9fcf-7646983f00cb" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.61:8443/health\": dial tcp 10.132.0.61:8443: connect: connection refused"
Jul 14 08:23:34.603731 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.603708    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:23:34.637511 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.637414    2562 generic.go:356] "Generic (PLEG): container finished" podID="0e096c9d-891f-4b77-9fcf-7646983f00cb" containerID="8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8" exitCode=0
Jul 14 08:23:34.637511 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.637462    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"
Jul 14 08:23:34.637511 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.637460    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf" event={"ID":"0e096c9d-891f-4b77-9fcf-7646983f00cb","Type":"ContainerDied","Data":"8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8"}
Jul 14 08:23:34.637799 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.637535    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf" event={"ID":"0e096c9d-891f-4b77-9fcf-7646983f00cb","Type":"ContainerDied","Data":"08f14cf5ded79c779b9018fc976e2ba27bbe108aa77bb47836bc11729ce69447"}
Jul 14 08:23:34.637799 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.637560    2562 scope.go:117] "RemoveContainer" containerID="8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8"
Jul 14 08:23:34.647099 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.647078    2562 scope.go:117] "RemoveContainer" containerID="8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8"
Jul 14 08:23:34.647383 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:23:34.647366    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8\": container with ID starting with 8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8 not found: ID does not exist" containerID="8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8"
Jul 14 08:23:34.647437 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.647391    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8"} err="failed to get container status \"8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8\": rpc error: code = NotFound desc = could not find container \"8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8\": container with ID starting with 8cf1d125682308de100fb315e330b6cce370f0a71ab30d4ec37d1986b5e4afd8 not found: ID does not exist"
Jul 14 08:23:34.737754 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.737723    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e096c9d-891f-4b77-9fcf-7646983f00cb-maas-api-tls\") pod \"0e096c9d-891f-4b77-9fcf-7646983f00cb\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") "
Jul 14 08:23:34.737929 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.737857    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e096c9d-891f-4b77-9fcf-7646983f00cb-openshift-service-ca\") pod \"0e096c9d-891f-4b77-9fcf-7646983f00cb\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") "
Jul 14 08:23:34.737929 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.737883    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpkms\" (UniqueName: \"kubernetes.io/projected/0e096c9d-891f-4b77-9fcf-7646983f00cb-kube-api-access-bpkms\") pod \"0e096c9d-891f-4b77-9fcf-7646983f00cb\" (UID: \"0e096c9d-891f-4b77-9fcf-7646983f00cb\") "
Jul 14 08:23:34.738293 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.738269    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e096c9d-891f-4b77-9fcf-7646983f00cb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e096c9d-891f-4b77-9fcf-7646983f00cb" (UID: "0e096c9d-891f-4b77-9fcf-7646983f00cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:23:34.739927 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.739903    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e096c9d-891f-4b77-9fcf-7646983f00cb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e096c9d-891f-4b77-9fcf-7646983f00cb" (UID: "0e096c9d-891f-4b77-9fcf-7646983f00cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:23:34.739996 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.739943    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e096c9d-891f-4b77-9fcf-7646983f00cb-kube-api-access-bpkms" (OuterVolumeSpecName: "kube-api-access-bpkms") pod "0e096c9d-891f-4b77-9fcf-7646983f00cb" (UID: "0e096c9d-891f-4b77-9fcf-7646983f00cb"). InnerVolumeSpecName "kube-api-access-bpkms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:23:34.839750 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.839707    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e096c9d-891f-4b77-9fcf-7646983f00cb-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:23:34.839750 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.839741    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpkms\" (UniqueName: \"kubernetes.io/projected/0e096c9d-891f-4b77-9fcf-7646983f00cb-kube-api-access-bpkms\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:23:34.839750 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.839755    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e096c9d-891f-4b77-9fcf-7646983f00cb-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:23:34.962108 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.962059    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"]
Jul 14 08:23:34.966310 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:34.966283    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a0f7fb2-c7957974d-45tlf"]
Jul 14 08:23:35.701436 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:23:35.701404    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e096c9d-891f-4b77-9fcf-7646983f00cb" path="/var/lib/kubelet/pods/0e096c9d-891f-4b77-9fcf-7646983f00cb/volumes"
Jul 14 08:24:37.790845 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:24:37.790731    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:24:37.795044 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:24:37.793822    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:24:37.795732 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:24:37.795712    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:24:37.797809 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:24:37.797788    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:25:29.190320 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.190235    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"]
Jul 14 08:25:29.190930 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.190915    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e096c9d-891f-4b77-9fcf-7646983f00cb" containerName="maas-api"
Jul 14 08:25:29.190975 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.190933    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e096c9d-891f-4b77-9fcf-7646983f00cb" containerName="maas-api"
Jul 14 08:25:29.191079 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.191068    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e096c9d-891f-4b77-9fcf-7646983f00cb" containerName="maas-api"
Jul 14 08:25:29.194607 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.194585    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.197432 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.197405    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-5ae22d-serving-cert\""
Jul 14 08:25:29.204941 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.204913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"]
Jul 14 08:25:29.309218 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.309174    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.309429 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.309315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrqgr\" (UniqueName: \"kubernetes.io/projected/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-kube-api-access-nrqgr\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.309429 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.309357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-maas-api-tls\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.409841 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.409802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrqgr\" (UniqueName: \"kubernetes.io/projected/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-kube-api-access-nrqgr\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.410055 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.409853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-maas-api-tls\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.410055 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.409901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.410055 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:25:29.409948    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-serving-cert: secret "maas-api-e2e-inf-a-5ae22d-serving-cert" not found
Jul 14 08:25:29.410055 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:25:29.410026    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-maas-api-tls podName:2a31c307-7e21-4a42-aa8d-bf4cd18c419c nodeName:}" failed. No retries permitted until 2026-07-14 08:25:29.909992418 +0000 UTC m=+2152.651910265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-maas-api-tls") pod "maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw" (UID: "2a31c307-7e21-4a42-aa8d-bf4cd18c419c") : secret "maas-api-e2e-inf-a-5ae22d-serving-cert" not found
Jul 14 08:25:29.410715 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.410691    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.422383 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.422343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrqgr\" (UniqueName: \"kubernetes.io/projected/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-kube-api-access-nrqgr\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.915446 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.915393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-maas-api-tls\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:29.918667 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:29.918636    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-maas-api-tls\") pod \"maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:30.106558 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:30.106521    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:30.272427 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:30.272398    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"]
Jul 14 08:25:30.274150 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:25:30.274120    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a31c307_7e21_4a42_aa8d_bf4cd18c419c.slice/crio-88c514906171843852601bdfa013f6f0567494d3972ddd908d4f5e68f5e4fb9e WatchSource:0}: Error finding container 88c514906171843852601bdfa013f6f0567494d3972ddd908d4f5e68f5e4fb9e: Status 404 returned error can't find the container with id 88c514906171843852601bdfa013f6f0567494d3972ddd908d4f5e68f5e4fb9e
Jul 14 08:25:31.247787 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:31.247756    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw" event={"ID":"2a31c307-7e21-4a42-aa8d-bf4cd18c419c","Type":"ContainerStarted","Data":"88c514906171843852601bdfa013f6f0567494d3972ddd908d4f5e68f5e4fb9e"}
Jul 14 08:25:32.254787 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:32.254748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw" event={"ID":"2a31c307-7e21-4a42-aa8d-bf4cd18c419c","Type":"ContainerStarted","Data":"a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc"}
Jul 14 08:25:32.255300 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:32.254853    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:32.276998 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:32.276947    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw" podStartSLOduration=2.360296338 podStartE2EDuration="3.276929587s" totalImagesPullingTime="916.633249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:25:32.27477011 +0000 UTC m=+2155.016687980" watchObservedRunningTime="2026-07-14 08:25:32.276929587 +0000 UTC m=+2155.018847454"
Jul 14 08:25:37.380096 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.380062    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"]
Jul 14 08:25:37.384128 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.384096    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:37.387051 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.386992    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-bf6952-serving-cert\""
Jul 14 08:25:37.397067 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.397040    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"]
Jul 14 08:25:37.488615 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.488582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0b9552-7e06-40cb-9250-e46c3deffa14-maas-api-tls\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:37.488797 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.488623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0b9552-7e06-40cb-9250-e46c3deffa14-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:37.488797 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.488648    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bnmz\" (UniqueName: \"kubernetes.io/projected/cd0b9552-7e06-40cb-9250-e46c3deffa14-kube-api-access-8bnmz\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:37.590170 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.590135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0b9552-7e06-40cb-9250-e46c3deffa14-maas-api-tls\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:37.590345 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.590175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0b9552-7e06-40cb-9250-e46c3deffa14-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:37.590345 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.590240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bnmz\" (UniqueName: \"kubernetes.io/projected/cd0b9552-7e06-40cb-9250-e46c3deffa14-kube-api-access-8bnmz\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:37.590785 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.590768    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0b9552-7e06-40cb-9250-e46c3deffa14-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:37.593217 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.593197    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-bf6952-serving-cert\""
Jul 14 08:25:37.600981 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:25:37.600958    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-serving-cert: secret "maas-api-e2e-inf-b-bf6952-serving-cert" not found
Jul 14 08:25:37.601104 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:25:37.601040    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0b9552-7e06-40cb-9250-e46c3deffa14-maas-api-tls podName:cd0b9552-7e06-40cb-9250-e46c3deffa14 nodeName:}" failed. No retries permitted until 2026-07-14 08:25:38.100999752 +0000 UTC m=+2160.842917598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd0b9552-7e06-40cb-9250-e46c3deffa14-maas-api-tls") pod "maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k" (UID: "cd0b9552-7e06-40cb-9250-e46c3deffa14") : secret "maas-api-e2e-inf-b-bf6952-serving-cert" not found
Jul 14 08:25:37.602047 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:37.601998    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bnmz\" (UniqueName: \"kubernetes.io/projected/cd0b9552-7e06-40cb-9250-e46c3deffa14-kube-api-access-8bnmz\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:38.196517 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:38.196480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0b9552-7e06-40cb-9250-e46c3deffa14-maas-api-tls\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:38.198919 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:38.198895    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0b9552-7e06-40cb-9250-e46c3deffa14-maas-api-tls\") pod \"maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:38.265459 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:38.265427    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:25:38.297717 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:38.297689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:38.460076 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:38.455732    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"]
Jul 14 08:25:38.462232 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:25:38.462188    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0b9552_7e06_40cb_9250_e46c3deffa14.slice/crio-5b21ae53813ac3093a44a93ffaed2e3f7580655ad65413af8b03a1971750686d WatchSource:0}: Error finding container 5b21ae53813ac3093a44a93ffaed2e3f7580655ad65413af8b03a1971750686d: Status 404 returned error can't find the container with id 5b21ae53813ac3093a44a93ffaed2e3f7580655ad65413af8b03a1971750686d
Jul 14 08:25:39.299614 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:39.299575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k" event={"ID":"cd0b9552-7e06-40cb-9250-e46c3deffa14","Type":"ContainerStarted","Data":"7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708"}
Jul 14 08:25:39.299803 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:39.299636    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k" event={"ID":"cd0b9552-7e06-40cb-9250-e46c3deffa14","Type":"ContainerStarted","Data":"5b21ae53813ac3093a44a93ffaed2e3f7580655ad65413af8b03a1971750686d"}
Jul 14 08:25:39.299803 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:39.299658    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:25:39.318672 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:39.318604    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k" podStartSLOduration=1.902491676 podStartE2EDuration="2.318583679s" totalImagesPullingTime="416.092003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:25:39.316981488 +0000 UTC m=+2162.058899358" watchObservedRunningTime="2026-07-14 08:25:39.318583679 +0000 UTC m=+2162.060501550"
Jul 14 08:25:45.310258 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:25:45.310226    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:27:07.082518 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.082423    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"]
Jul 14 08:27:07.083175 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.082684    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw" podUID="2a31c307-7e21-4a42-aa8d-bf4cd18c419c" containerName="maas-api" containerID="cri-o://a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc" gracePeriod=30
Jul 14 08:27:07.346034 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.345940    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:27:07.443191 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.443159    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrqgr\" (UniqueName: \"kubernetes.io/projected/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-kube-api-access-nrqgr\") pod \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") "
Jul 14 08:27:07.443363 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.443260    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-openshift-service-ca\") pod \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") "
Jul 14 08:27:07.443363 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.443292    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-maas-api-tls\") pod \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\" (UID: \"2a31c307-7e21-4a42-aa8d-bf4cd18c419c\") "
Jul 14 08:27:07.443625 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.443597    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a31c307-7e21-4a42-aa8d-bf4cd18c419c" (UID: "2a31c307-7e21-4a42-aa8d-bf4cd18c419c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:27:07.445319 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.445297    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a31c307-7e21-4a42-aa8d-bf4cd18c419c" (UID: "2a31c307-7e21-4a42-aa8d-bf4cd18c419c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:27:07.445436 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.445415    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-kube-api-access-nrqgr" (OuterVolumeSpecName: "kube-api-access-nrqgr") pod "2a31c307-7e21-4a42-aa8d-bf4cd18c419c" (UID: "2a31c307-7e21-4a42-aa8d-bf4cd18c419c"). InnerVolumeSpecName "kube-api-access-nrqgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:27:07.544900 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.544870    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrqgr\" (UniqueName: \"kubernetes.io/projected/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-kube-api-access-nrqgr\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:27:07.544900 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.544898    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:27:07.544900 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.544908    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a31c307-7e21-4a42-aa8d-bf4cd18c419c-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:27:07.778441 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.778409    2562 generic.go:356] "Generic (PLEG): container finished" podID="2a31c307-7e21-4a42-aa8d-bf4cd18c419c" containerID="a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc" exitCode=0
Jul 14 08:27:07.778645 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.778473    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"
Jul 14 08:27:07.778645 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.778498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw" event={"ID":"2a31c307-7e21-4a42-aa8d-bf4cd18c419c","Type":"ContainerDied","Data":"a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc"}
Jul 14 08:27:07.778645 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.778553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw" event={"ID":"2a31c307-7e21-4a42-aa8d-bf4cd18c419c","Type":"ContainerDied","Data":"88c514906171843852601bdfa013f6f0567494d3972ddd908d4f5e68f5e4fb9e"}
Jul 14 08:27:07.778645 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.778575    2562 scope.go:117] "RemoveContainer" containerID="a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc"
Jul 14 08:27:07.787863 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.787846    2562 scope.go:117] "RemoveContainer" containerID="a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc"
Jul 14 08:27:07.788166 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:27:07.788146    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc\": container with ID starting with a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc not found: ID does not exist" containerID="a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc"
Jul 14 08:27:07.788228 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.788176    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc"} err="failed to get container status \"a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc\": rpc error: code = NotFound desc = could not find container \"a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc\": container with ID starting with a875930ed3ba52bf65fd54e3ba7f8d9d814fb602f10f20aca15546a26b322fcc not found: ID does not exist"
Jul 14 08:27:07.796683 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.796660    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"]
Jul 14 08:27:07.800280 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:07.800260    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ae22d-5d5bb5644d-5kvlw"]
Jul 14 08:27:09.701458 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:09.701425    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a31c307-7e21-4a42-aa8d-bf4cd18c419c" path="/var/lib/kubelet/pods/2a31c307-7e21-4a42-aa8d-bf4cd18c419c/volumes"
Jul 14 08:27:33.233890 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.233850    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"]
Jul 14 08:27:33.234418 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.234178    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k" podUID="cd0b9552-7e06-40cb-9250-e46c3deffa14" containerName="maas-api" containerID="cri-o://7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708" gracePeriod=30
Jul 14 08:27:33.490241 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.490170    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:27:33.591498 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.591464    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bnmz\" (UniqueName: \"kubernetes.io/projected/cd0b9552-7e06-40cb-9250-e46c3deffa14-kube-api-access-8bnmz\") pod \"cd0b9552-7e06-40cb-9250-e46c3deffa14\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") "
Jul 14 08:27:33.591684 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.591535    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0b9552-7e06-40cb-9250-e46c3deffa14-maas-api-tls\") pod \"cd0b9552-7e06-40cb-9250-e46c3deffa14\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") "
Jul 14 08:27:33.591684 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.591571    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0b9552-7e06-40cb-9250-e46c3deffa14-openshift-service-ca\") pod \"cd0b9552-7e06-40cb-9250-e46c3deffa14\" (UID: \"cd0b9552-7e06-40cb-9250-e46c3deffa14\") "
Jul 14 08:27:33.592033 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.591977    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd0b9552-7e06-40cb-9250-e46c3deffa14-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd0b9552-7e06-40cb-9250-e46c3deffa14" (UID: "cd0b9552-7e06-40cb-9250-e46c3deffa14"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:27:33.593609 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.593577    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0b9552-7e06-40cb-9250-e46c3deffa14-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd0b9552-7e06-40cb-9250-e46c3deffa14" (UID: "cd0b9552-7e06-40cb-9250-e46c3deffa14"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:27:33.593609 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.593595    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd0b9552-7e06-40cb-9250-e46c3deffa14-kube-api-access-8bnmz" (OuterVolumeSpecName: "kube-api-access-8bnmz") pod "cd0b9552-7e06-40cb-9250-e46c3deffa14" (UID: "cd0b9552-7e06-40cb-9250-e46c3deffa14"). InnerVolumeSpecName "kube-api-access-8bnmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:27:33.692705 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.692667    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bnmz\" (UniqueName: \"kubernetes.io/projected/cd0b9552-7e06-40cb-9250-e46c3deffa14-kube-api-access-8bnmz\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:27:33.692705 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.692698    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0b9552-7e06-40cb-9250-e46c3deffa14-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:27:33.692705 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.692709    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0b9552-7e06-40cb-9250-e46c3deffa14-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:27:33.917165 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.917075    2562 generic.go:356] "Generic (PLEG): container finished" podID="cd0b9552-7e06-40cb-9250-e46c3deffa14" containerID="7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708" exitCode=0
Jul 14 08:27:33.917165 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.917127    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"
Jul 14 08:27:33.917398 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.917166    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k" event={"ID":"cd0b9552-7e06-40cb-9250-e46c3deffa14","Type":"ContainerDied","Data":"7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708"}
Jul 14 08:27:33.917398 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.917236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k" event={"ID":"cd0b9552-7e06-40cb-9250-e46c3deffa14","Type":"ContainerDied","Data":"5b21ae53813ac3093a44a93ffaed2e3f7580655ad65413af8b03a1971750686d"}
Jul 14 08:27:33.917398 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.917267    2562 scope.go:117] "RemoveContainer" containerID="7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708"
Jul 14 08:27:33.926455 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.926436    2562 scope.go:117] "RemoveContainer" containerID="7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708"
Jul 14 08:27:33.926703 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:27:33.926686    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708\": container with ID starting with 7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708 not found: ID does not exist" containerID="7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708"
Jul 14 08:27:33.926778 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.926711    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708"} err="failed to get container status \"7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708\": rpc error: code = NotFound desc = could not find container \"7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708\": container with ID starting with 7e6b52d1f986fbbb9a168f1054c4cc214754367af99636870fb74b9edcfe6708 not found: ID does not exist"
Jul 14 08:27:33.937107 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.937083    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"]
Jul 14 08:27:33.941285 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:33.941264    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bf6952-dd98b5b46-8g98k"]
Jul 14 08:27:35.701317 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:35.701285    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd0b9552-7e06-40cb-9250-e46c3deffa14" path="/var/lib/kubelet/pods/cd0b9552-7e06-40cb-9250-e46c3deffa14/volumes"
Jul 14 08:27:53.245849 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.245805    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"]
Jul 14 08:27:53.246466 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.246446    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a31c307-7e21-4a42-aa8d-bf4cd18c419c" containerName="maas-api"
Jul 14 08:27:53.246547 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.246470    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a31c307-7e21-4a42-aa8d-bf4cd18c419c" containerName="maas-api"
Jul 14 08:27:53.246547 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.246507    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0b9552-7e06-40cb-9250-e46c3deffa14" containerName="maas-api"
Jul 14 08:27:53.246547 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.246517    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0b9552-7e06-40cb-9250-e46c3deffa14" containerName="maas-api"
Jul 14 08:27:53.246695 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.246664    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0b9552-7e06-40cb-9250-e46c3deffa14" containerName="maas-api"
Jul 14 08:27:53.246695 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.246679    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a31c307-7e21-4a42-aa8d-bf4cd18c419c" containerName="maas-api"
Jul 14 08:27:53.250051 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.250029    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.253653 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.253633    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2198a8-serving-cert\""
Jul 14 08:27:53.273266 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.273236    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"]
Jul 14 08:27:53.280704 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.280673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856da283-5aee-4193-adae-e53107c3e0bb-openshift-service-ca\") pod \"maas-api-e2e-api-a-2198a8-766bccf599-wpvl5\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.280871 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.280731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856da283-5aee-4193-adae-e53107c3e0bb-maas-api-tls\") pod \"maas-api-e2e-api-a-2198a8-766bccf599-wpvl5\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.280871 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.280754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqfpb\" (UniqueName: \"kubernetes.io/projected/856da283-5aee-4193-adae-e53107c3e0bb-kube-api-access-jqfpb\") pod \"maas-api-e2e-api-a-2198a8-766bccf599-wpvl5\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.381329 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.381292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856da283-5aee-4193-adae-e53107c3e0bb-maas-api-tls\") pod \"maas-api-e2e-api-a-2198a8-766bccf599-wpvl5\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.381329 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.381329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfpb\" (UniqueName: \"kubernetes.io/projected/856da283-5aee-4193-adae-e53107c3e0bb-kube-api-access-jqfpb\") pod \"maas-api-e2e-api-a-2198a8-766bccf599-wpvl5\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.381599 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.381409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856da283-5aee-4193-adae-e53107c3e0bb-openshift-service-ca\") pod \"maas-api-e2e-api-a-2198a8-766bccf599-wpvl5\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.382071 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.382050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856da283-5aee-4193-adae-e53107c3e0bb-openshift-service-ca\") pod \"maas-api-e2e-api-a-2198a8-766bccf599-wpvl5\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.383756 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.383737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856da283-5aee-4193-adae-e53107c3e0bb-maas-api-tls\") pod \"maas-api-e2e-api-a-2198a8-766bccf599-wpvl5\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.391726 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.391699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqfpb\" (UniqueName: \"kubernetes.io/projected/856da283-5aee-4193-adae-e53107c3e0bb-kube-api-access-jqfpb\") pod \"maas-api-e2e-api-a-2198a8-766bccf599-wpvl5\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.560304 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.560208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:53.708182 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.708147    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"]
Jul 14 08:27:53.712543 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:27:53.712518    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856da283_5aee_4193_adae_e53107c3e0bb.slice/crio-907bf1f51efdb35d49ba4462c3a0ac56014310d9f9490609442710b651c1f179 WatchSource:0}: Error finding container 907bf1f51efdb35d49ba4462c3a0ac56014310d9f9490609442710b651c1f179: Status 404 returned error can't find the container with id 907bf1f51efdb35d49ba4462c3a0ac56014310d9f9490609442710b651c1f179
Jul 14 08:27:53.718116 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:53.718091    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 08:27:54.025211 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:54.025171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5" event={"ID":"856da283-5aee-4193-adae-e53107c3e0bb","Type":"ContainerStarted","Data":"907bf1f51efdb35d49ba4462c3a0ac56014310d9f9490609442710b651c1f179"}
Jul 14 08:27:55.032718 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:55.032679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5" event={"ID":"856da283-5aee-4193-adae-e53107c3e0bb","Type":"ContainerStarted","Data":"55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a"}
Jul 14 08:27:55.033138 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:55.032759    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:27:55.051756 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:27:55.051699    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5" podStartSLOduration=1.5063218809999999 podStartE2EDuration="2.051682652s" totalImagesPullingTime="545.360771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:27:55.049585607 +0000 UTC m=+2297.791503476" watchObservedRunningTime="2026-07-14 08:27:55.051682652 +0000 UTC m=+2297.793600519"
Jul 14 08:28:01.044266 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.044225    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:28:01.065829 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.065794    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"]
Jul 14 08:28:01.069750 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.069728    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.072791 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.072773    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1851fc-serving-cert\""
Jul 14 08:28:01.089244 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.089220    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"]
Jul 14 08:28:01.144975 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.144943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.145178 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.145126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-maas-api-tls\") pod \"maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.145256 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.145185    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tnp7\" (UniqueName: \"kubernetes.io/projected/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-kube-api-access-8tnp7\") pod \"maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.246465 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.246426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.246670 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.246511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-maas-api-tls\") pod \"maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.246670 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.246570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tnp7\" (UniqueName: \"kubernetes.io/projected/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-kube-api-access-8tnp7\") pod \"maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.247117 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.247094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.248933 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.248895    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-maas-api-tls\") pod \"maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.257933 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.257909    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tnp7\" (UniqueName: \"kubernetes.io/projected/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-kube-api-access-8tnp7\") pod \"maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.381699 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.381614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:01.532186 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:01.532154    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"]
Jul 14 08:28:01.533366 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:28:01.533339    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285d3cf6_52c2_4d91_9f4a_f478ee38d2d8.slice/crio-334a439dfdb3e282ee0cb31d36f17ec250918f9c68b76682af637241fa283948 WatchSource:0}: Error finding container 334a439dfdb3e282ee0cb31d36f17ec250918f9c68b76682af637241fa283948: Status 404 returned error can't find the container with id 334a439dfdb3e282ee0cb31d36f17ec250918f9c68b76682af637241fa283948
Jul 14 08:28:02.070646 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:02.070613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr" event={"ID":"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8","Type":"ContainerStarted","Data":"334a439dfdb3e282ee0cb31d36f17ec250918f9c68b76682af637241fa283948"}
Jul 14 08:28:03.077598 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:03.077555    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr" event={"ID":"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8","Type":"ContainerStarted","Data":"87d85326b31e124f46968dcf7d99a3a9e7b7d7b8ee4f801e4f17d229c4c98822"}
Jul 14 08:28:03.078018 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:03.077631    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:03.098039 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:03.097951    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr" podStartSLOduration=1.551868307 podStartE2EDuration="2.097934721s" totalImagesPullingTime="546.066414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:28:03.095989477 +0000 UTC m=+2305.837907349" watchObservedRunningTime="2026-07-14 08:28:03.097934721 +0000 UTC m=+2305.839852588"
Jul 14 08:28:09.088211 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:09.088180    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:24.533275 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.533236    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"]
Jul 14 08:28:24.533781 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.533474    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5" podUID="856da283-5aee-4193-adae-e53107c3e0bb" containerName="maas-api" containerID="cri-o://55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a" gracePeriod=30
Jul 14 08:28:24.791734 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.791664    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:28:24.883193 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.883151    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856da283-5aee-4193-adae-e53107c3e0bb-openshift-service-ca\") pod \"856da283-5aee-4193-adae-e53107c3e0bb\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") "
Jul 14 08:28:24.883369 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.883237    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqfpb\" (UniqueName: \"kubernetes.io/projected/856da283-5aee-4193-adae-e53107c3e0bb-kube-api-access-jqfpb\") pod \"856da283-5aee-4193-adae-e53107c3e0bb\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") "
Jul 14 08:28:24.883433 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.883418    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856da283-5aee-4193-adae-e53107c3e0bb-maas-api-tls\") pod \"856da283-5aee-4193-adae-e53107c3e0bb\" (UID: \"856da283-5aee-4193-adae-e53107c3e0bb\") "
Jul 14 08:28:24.883619 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.883596    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/856da283-5aee-4193-adae-e53107c3e0bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "856da283-5aee-4193-adae-e53107c3e0bb" (UID: "856da283-5aee-4193-adae-e53107c3e0bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:28:24.883734 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.883720    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856da283-5aee-4193-adae-e53107c3e0bb-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:28:24.885480 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.885444    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/856da283-5aee-4193-adae-e53107c3e0bb-kube-api-access-jqfpb" (OuterVolumeSpecName: "kube-api-access-jqfpb") pod "856da283-5aee-4193-adae-e53107c3e0bb" (UID: "856da283-5aee-4193-adae-e53107c3e0bb"). InnerVolumeSpecName "kube-api-access-jqfpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:28:24.885654 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.885585    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856da283-5aee-4193-adae-e53107c3e0bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "856da283-5aee-4193-adae-e53107c3e0bb" (UID: "856da283-5aee-4193-adae-e53107c3e0bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:28:24.984621 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.984584    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqfpb\" (UniqueName: \"kubernetes.io/projected/856da283-5aee-4193-adae-e53107c3e0bb-kube-api-access-jqfpb\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:28:24.984621 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:24.984615    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856da283-5aee-4193-adae-e53107c3e0bb-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:28:25.198274 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.198186    2562 generic.go:356] "Generic (PLEG): container finished" podID="856da283-5aee-4193-adae-e53107c3e0bb" containerID="55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a" exitCode=0
Jul 14 08:28:25.198274 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.198234    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"
Jul 14 08:28:25.198274 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.198262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5" event={"ID":"856da283-5aee-4193-adae-e53107c3e0bb","Type":"ContainerDied","Data":"55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a"}
Jul 14 08:28:25.198504 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.198304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5" event={"ID":"856da283-5aee-4193-adae-e53107c3e0bb","Type":"ContainerDied","Data":"907bf1f51efdb35d49ba4462c3a0ac56014310d9f9490609442710b651c1f179"}
Jul 14 08:28:25.198504 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.198328    2562 scope.go:117] "RemoveContainer" containerID="55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a"
Jul 14 08:28:25.208137 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.208116    2562 scope.go:117] "RemoveContainer" containerID="55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a"
Jul 14 08:28:25.208403 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:28:25.208383    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a\": container with ID starting with 55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a not found: ID does not exist" containerID="55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a"
Jul 14 08:28:25.208476 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.208415    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a"} err="failed to get container status \"55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a\": rpc error: code = NotFound desc = could not find container \"55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a\": container with ID starting with 55776a6887315e1198aedb3534452b5f8f64989487bdb38206f4f013092c0b2a not found: ID does not exist"
Jul 14 08:28:25.222386 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.222353    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"]
Jul 14 08:28:25.226661 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.226631    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2198a8-766bccf599-wpvl5"]
Jul 14 08:28:25.702855 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:25.702808    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="856da283-5aee-4193-adae-e53107c3e0bb" path="/var/lib/kubelet/pods/856da283-5aee-4193-adae-e53107c3e0bb/volumes"
Jul 14 08:28:50.210038 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.209983    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"]
Jul 14 08:28:50.210467 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.210248    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr" podUID="285d3cf6-52c2-4d91-9f4a-f478ee38d2d8" containerName="maas-api" containerID="cri-o://87d85326b31e124f46968dcf7d99a3a9e7b7d7b8ee4f801e4f17d229c4c98822" gracePeriod=30
Jul 14 08:28:50.333819 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.333785    2562 generic.go:356] "Generic (PLEG): container finished" podID="285d3cf6-52c2-4d91-9f4a-f478ee38d2d8" containerID="87d85326b31e124f46968dcf7d99a3a9e7b7d7b8ee4f801e4f17d229c4c98822" exitCode=0
Jul 14 08:28:50.333958 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.333837    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr" event={"ID":"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8","Type":"ContainerDied","Data":"87d85326b31e124f46968dcf7d99a3a9e7b7d7b8ee4f801e4f17d229c4c98822"}
Jul 14 08:28:50.466255 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.466227    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:50.530853 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.530817    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tnp7\" (UniqueName: \"kubernetes.io/projected/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-kube-api-access-8tnp7\") pod \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") "
Jul 14 08:28:50.531048 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.530915    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-openshift-service-ca\") pod \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") "
Jul 14 08:28:50.531048 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.530965    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-maas-api-tls\") pod \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\" (UID: \"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8\") "
Jul 14 08:28:50.531351 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.531318    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "285d3cf6-52c2-4d91-9f4a-f478ee38d2d8" (UID: "285d3cf6-52c2-4d91-9f4a-f478ee38d2d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:28:50.533127 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.533096    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-kube-api-access-8tnp7" (OuterVolumeSpecName: "kube-api-access-8tnp7") pod "285d3cf6-52c2-4d91-9f4a-f478ee38d2d8" (UID: "285d3cf6-52c2-4d91-9f4a-f478ee38d2d8"). InnerVolumeSpecName "kube-api-access-8tnp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:28:50.533236 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.533130    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "285d3cf6-52c2-4d91-9f4a-f478ee38d2d8" (UID: "285d3cf6-52c2-4d91-9f4a-f478ee38d2d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:28:50.632546 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.632508    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:28:50.632546 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.632540    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:28:50.632546 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:50.632550    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tnp7\" (UniqueName: \"kubernetes.io/projected/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8-kube-api-access-8tnp7\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:28:51.340102 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:51.340076    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"
Jul 14 08:28:51.340576 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:51.340077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr" event={"ID":"285d3cf6-52c2-4d91-9f4a-f478ee38d2d8","Type":"ContainerDied","Data":"334a439dfdb3e282ee0cb31d36f17ec250918f9c68b76682af637241fa283948"}
Jul 14 08:28:51.340576 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:51.340207    2562 scope.go:117] "RemoveContainer" containerID="87d85326b31e124f46968dcf7d99a3a9e7b7d7b8ee4f801e4f17d229c4c98822"
Jul 14 08:28:51.362605 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:51.362580    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"]
Jul 14 08:28:51.366616 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:51.366595    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1851fc-5cdbd4d74f-z9jkr"]
Jul 14 08:28:51.701327 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:28:51.701243    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="285d3cf6-52c2-4d91-9f4a-f478ee38d2d8" path="/var/lib/kubelet/pods/285d3cf6-52c2-4d91-9f4a-f478ee38d2d8/volumes"
Jul 14 08:29:09.352306 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.352262    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"]
Jul 14 08:29:09.352786 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.352688    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285d3cf6-52c2-4d91-9f4a-f478ee38d2d8" containerName="maas-api"
Jul 14 08:29:09.352786 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.352699    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="285d3cf6-52c2-4d91-9f4a-f478ee38d2d8" containerName="maas-api"
Jul 14 08:29:09.352786 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.352717    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856da283-5aee-4193-adae-e53107c3e0bb" containerName="maas-api"
Jul 14 08:29:09.352786 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.352723    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="856da283-5aee-4193-adae-e53107c3e0bb" containerName="maas-api"
Jul 14 08:29:09.353740 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.353702    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="285d3cf6-52c2-4d91-9f4a-f478ee38d2d8" containerName="maas-api"
Jul 14 08:29:09.353869 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.353764    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="856da283-5aee-4193-adae-e53107c3e0bb" containerName="maas-api"
Jul 14 08:29:09.363434 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.363385    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.368102 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.367979    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0324b2-serving-cert\""
Jul 14 08:29:09.368747 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.368719    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"]
Jul 14 08:29:09.509723 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.509682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m55kq\" (UniqueName: \"kubernetes.io/projected/888f4af3-4509-4a84-a938-1427a9f3c811-kube-api-access-m55kq\") pod \"maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.509959 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.509852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/888f4af3-4509-4a84-a938-1427a9f3c811-maas-api-tls\") pod \"maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.509959 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.509894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/888f4af3-4509-4a84-a938-1427a9f3c811-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.611188 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.611081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m55kq\" (UniqueName: \"kubernetes.io/projected/888f4af3-4509-4a84-a938-1427a9f3c811-kube-api-access-m55kq\") pod \"maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.611376 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.611200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/888f4af3-4509-4a84-a938-1427a9f3c811-maas-api-tls\") pod \"maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.611376 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.611235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/888f4af3-4509-4a84-a938-1427a9f3c811-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.611921 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.611897    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/888f4af3-4509-4a84-a938-1427a9f3c811-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.613767 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.613747    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/888f4af3-4509-4a84-a938-1427a9f3c811-maas-api-tls\") pod \"maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.621458 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.621432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m55kq\" (UniqueName: \"kubernetes.io/projected/888f4af3-4509-4a84-a938-1427a9f3c811-kube-api-access-m55kq\") pod \"maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.679223 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.679182    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:09.830345 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:09.830314    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"]
Jul 14 08:29:09.832726 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:29:09.832697    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888f4af3_4509_4a84_a938_1427a9f3c811.slice/crio-357bbdd5f9e4cb38004d8c6924787c73ef91e9346a46d7b1c893d9d541830c33 WatchSource:0}: Error finding container 357bbdd5f9e4cb38004d8c6924787c73ef91e9346a46d7b1c893d9d541830c33: Status 404 returned error can't find the container with id 357bbdd5f9e4cb38004d8c6924787c73ef91e9346a46d7b1c893d9d541830c33
Jul 14 08:29:10.444942 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:10.444906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm" event={"ID":"888f4af3-4509-4a84-a938-1427a9f3c811","Type":"ContainerStarted","Data":"2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737"}
Jul 14 08:29:10.445376 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:10.444961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm" event={"ID":"888f4af3-4509-4a84-a938-1427a9f3c811","Type":"ContainerStarted","Data":"357bbdd5f9e4cb38004d8c6924787c73ef91e9346a46d7b1c893d9d541830c33"}
Jul 14 08:29:10.445376 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:10.444994    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:10.465337 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:10.465276    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm" podStartSLOduration=1.032159835 podStartE2EDuration="1.46525856s" totalImagesPullingTime="433.098725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:29:10.464305438 +0000 UTC m=+2373.206223308" watchObservedRunningTime="2026-07-14 08:29:10.46525856 +0000 UTC m=+2373.207176501"
Jul 14 08:29:16.456283 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:16.456249    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:29:17.436774 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.436737    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"]
Jul 14 08:29:17.440630 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.440609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.443681 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.443658    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b9c837-serving-cert\""
Jul 14 08:29:17.453102 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.453078    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"]
Jul 14 08:29:17.587905 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.587870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crtwq\" (UniqueName: \"kubernetes.io/projected/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-kube-api-access-crtwq\") pod \"maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.587905 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.587921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.588392 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.587945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.689137 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.689052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crtwq\" (UniqueName: \"kubernetes.io/projected/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-kube-api-access-crtwq\") pod \"maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.689137 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.689108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.689330 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.689148    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.689813 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.689784    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.691554 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.691526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.699882 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.699858    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crtwq\" (UniqueName: \"kubernetes.io/projected/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-kube-api-access-crtwq\") pod \"maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.752260 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.752223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:17.903710 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:17.903684    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"]
Jul 14 08:29:17.905864 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:29:17.905835    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d1b10f_6076_4c96_b485_fdc3dd5dd1d9.slice/crio-adc155c5593b4cc05343947409b4f6459cad70e06bc78efdd68d5792d2d11563 WatchSource:0}: Error finding container adc155c5593b4cc05343947409b4f6459cad70e06bc78efdd68d5792d2d11563: Status 404 returned error can't find the container with id adc155c5593b4cc05343947409b4f6459cad70e06bc78efdd68d5792d2d11563
Jul 14 08:29:18.489903 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:18.489862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j" event={"ID":"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9","Type":"ContainerStarted","Data":"47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4"}
Jul 14 08:29:18.490147 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:18.489934    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j" event={"ID":"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9","Type":"ContainerStarted","Data":"adc155c5593b4cc05343947409b4f6459cad70e06bc78efdd68d5792d2d11563"}
Jul 14 08:29:18.490147 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:18.489962    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:18.526582 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:18.526527    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j" podStartSLOduration=1.226349527 podStartE2EDuration="1.526508271s" totalImagesPullingTime="300.158744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:29:18.523178205 +0000 UTC m=+2381.265096074" watchObservedRunningTime="2026-07-14 08:29:18.526508271 +0000 UTC m=+2381.268426252"
Jul 14 08:29:24.501850 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:24.501818    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:29:37.829973 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:37.829867    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:29:37.846927 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:37.833742    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:29:37.846927 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:37.834341    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:29:37.846927 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:29:37.838067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:34:37.861339 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:34:37.861234    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:34:37.865275 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:34:37.865251    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:34:37.867201 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:34:37.867174    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:34:37.870698 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:34:37.870674    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnv2c_237827e0-c948-4a42-93bb-ee77c3ef7e17/ovn-acl-logging/0.log"
Jul 14 08:35:28.015557 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.015516    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7345-140181609111600"]
Jul 14 08:35:28.019280 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.019259    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181609111600"
Jul 14 08:35:28.023716 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.023690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-fdsqh\""
Jul 14 08:35:28.025107 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.025085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181609111600"]
Jul 14 08:35:28.170505 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.170465    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frkgm\" (UniqueName: \"kubernetes.io/projected/e723a55f-01d4-4db0-8b65-0d7481bb3950-kube-api-access-frkgm\") pod \"test-curl-7345-140181609111600\" (UID: \"e723a55f-01d4-4db0-8b65-0d7481bb3950\") " pod="openshift-ingress/test-curl-7345-140181609111600"
Jul 14 08:35:28.278218 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.272469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frkgm\" (UniqueName: \"kubernetes.io/projected/e723a55f-01d4-4db0-8b65-0d7481bb3950-kube-api-access-frkgm\") pod \"test-curl-7345-140181609111600\" (UID: \"e723a55f-01d4-4db0-8b65-0d7481bb3950\") " pod="openshift-ingress/test-curl-7345-140181609111600"
Jul 14 08:35:28.282439 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.282410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frkgm\" (UniqueName: \"kubernetes.io/projected/e723a55f-01d4-4db0-8b65-0d7481bb3950-kube-api-access-frkgm\") pod \"test-curl-7345-140181609111600\" (UID: \"e723a55f-01d4-4db0-8b65-0d7481bb3950\") " pod="openshift-ingress/test-curl-7345-140181609111600"
Jul 14 08:35:28.330786 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.330749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181609111600"
Jul 14 08:35:28.474952 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.474925    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181609111600"]
Jul 14 08:35:28.477027 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:35:28.476980    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode723a55f_01d4_4db0_8b65_0d7481bb3950.slice/crio-e5f89aeba0ec26329954e3b8f13e055d6905834813cff2d2045591ff99a37605 WatchSource:0}: Error finding container e5f89aeba0ec26329954e3b8f13e055d6905834813cff2d2045591ff99a37605: Status 404 returned error can't find the container with id e5f89aeba0ec26329954e3b8f13e055d6905834813cff2d2045591ff99a37605
Jul 14 08:35:28.478250 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.478233    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 08:35:28.489625 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:28.489594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181609111600" event={"ID":"e723a55f-01d4-4db0-8b65-0d7481bb3950","Type":"ContainerStarted","Data":"e5f89aeba0ec26329954e3b8f13e055d6905834813cff2d2045591ff99a37605"}
Jul 14 08:35:29.496820 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:29.496779    2562 generic.go:356] "Generic (PLEG): container finished" podID="e723a55f-01d4-4db0-8b65-0d7481bb3950" containerID="eb4920e9bc76ae136e079cd868d1e03097133603da23d7e58a3d8184de4a5402" exitCode=0
Jul 14 08:35:29.497308 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:29.496863    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181609111600" event={"ID":"e723a55f-01d4-4db0-8b65-0d7481bb3950","Type":"ContainerDied","Data":"eb4920e9bc76ae136e079cd868d1e03097133603da23d7e58a3d8184de4a5402"}
Jul 14 08:35:30.657949 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.657924    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181609111600"
Jul 14 08:35:30.712291 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.712258    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7345-140181609111600_e723a55f-01d4-4db0-8b65-0d7481bb3950/test-curl-7345-140181609111600/0.log"
Jul 14 08:35:30.748085 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.748050    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7345-140181609111600"]
Jul 14 08:35:30.754102 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.754035    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7345-140181609111600"]
Jul 14 08:35:30.796886 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.796852    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frkgm\" (UniqueName: \"kubernetes.io/projected/e723a55f-01d4-4db0-8b65-0d7481bb3950-kube-api-access-frkgm\") pod \"e723a55f-01d4-4db0-8b65-0d7481bb3950\" (UID: \"e723a55f-01d4-4db0-8b65-0d7481bb3950\") "
Jul 14 08:35:30.798987 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.798963    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e723a55f-01d4-4db0-8b65-0d7481bb3950-kube-api-access-frkgm" (OuterVolumeSpecName: "kube-api-access-frkgm") pod "e723a55f-01d4-4db0-8b65-0d7481bb3950" (UID: "e723a55f-01d4-4db0-8b65-0d7481bb3950"). InnerVolumeSpecName "kube-api-access-frkgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:35:30.898474 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.898418    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frkgm\" (UniqueName: \"kubernetes.io/projected/e723a55f-01d4-4db0-8b65-0d7481bb3950-kube-api-access-frkgm\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:35:30.930653 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.930617    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:30.931082 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.931068    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e723a55f-01d4-4db0-8b65-0d7481bb3950" containerName="test-curl-7345-140181609111600"
Jul 14 08:35:30.931140 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.931083    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e723a55f-01d4-4db0-8b65-0d7481bb3950" containerName="test-curl-7345-140181609111600"
Jul 14 08:35:30.931188 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.931179    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e723a55f-01d4-4db0-8b65-0d7481bb3950" containerName="test-curl-7345-140181609111600"
Jul 14 08:35:30.934295 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.934278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:30.943352 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:30.943324    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:31.100664 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:31.100560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvhb8\" (UniqueName: \"kubernetes.io/projected/22dbc89c-68ff-4a79-b02b-7e8ed4e73669-kube-api-access-kvhb8\") pod \"test-curl-7345-140181608867568\" (UID: \"22dbc89c-68ff-4a79-b02b-7e8ed4e73669\") " pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:31.201767 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:31.201720    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvhb8\" (UniqueName: \"kubernetes.io/projected/22dbc89c-68ff-4a79-b02b-7e8ed4e73669-kube-api-access-kvhb8\") pod \"test-curl-7345-140181608867568\" (UID: \"22dbc89c-68ff-4a79-b02b-7e8ed4e73669\") " pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:31.212152 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:31.212113    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvhb8\" (UniqueName: \"kubernetes.io/projected/22dbc89c-68ff-4a79-b02b-7e8ed4e73669-kube-api-access-kvhb8\") pod \"test-curl-7345-140181608867568\" (UID: \"22dbc89c-68ff-4a79-b02b-7e8ed4e73669\") " pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:31.243758 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:31.243720    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:31.385899 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:31.385844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:31.388163 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:35:31.388135    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22dbc89c_68ff_4a79_b02b_7e8ed4e73669.slice/crio-79c8bb87aa1e16040bb251c74a03b45c5bf334e6069eee4d94c21a8b7c422ae2 WatchSource:0}: Error finding container 79c8bb87aa1e16040bb251c74a03b45c5bf334e6069eee4d94c21a8b7c422ae2: Status 404 returned error can't find the container with id 79c8bb87aa1e16040bb251c74a03b45c5bf334e6069eee4d94c21a8b7c422ae2
Jul 14 08:35:31.508751 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:31.508714    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181608867568" event={"ID":"22dbc89c-68ff-4a79-b02b-7e8ed4e73669","Type":"ContainerStarted","Data":"79c8bb87aa1e16040bb251c74a03b45c5bf334e6069eee4d94c21a8b7c422ae2"}
Jul 14 08:35:31.510057 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:31.510036    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5f89aeba0ec26329954e3b8f13e055d6905834813cff2d2045591ff99a37605"
Jul 14 08:35:31.510057 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:31.510041    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181609111600"
Jul 14 08:35:31.522210 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:35:31.522178    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7345-140181609111600\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="e723a55f-01d4-4db0-8b65-0d7481bb3950" pod="openshift-ingress/test-curl-7345-140181609111600"
Jul 14 08:35:31.701395 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:31.701365    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e723a55f-01d4-4db0-8b65-0d7481bb3950" path="/var/lib/kubelet/pods/e723a55f-01d4-4db0-8b65-0d7481bb3950/volumes"
Jul 14 08:35:32.517483 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:32.517447    2562 generic.go:356] "Generic (PLEG): container finished" podID="22dbc89c-68ff-4a79-b02b-7e8ed4e73669" containerID="12be7515a332dff981f87a23f70beed6439057157bcf398aff834acc45cb0108" exitCode=0
Jul 14 08:35:32.517678 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:32.517541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181608867568" event={"ID":"22dbc89c-68ff-4a79-b02b-7e8ed4e73669","Type":"ContainerDied","Data":"12be7515a332dff981f87a23f70beed6439057157bcf398aff834acc45cb0108"}
Jul 14 08:35:33.684170 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.684135    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:33.704893 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.704864    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7345-140181608867568_22dbc89c-68ff-4a79-b02b-7e8ed4e73669/test-curl-7345-140181608867568/0.log"
Jul 14 08:35:33.726106 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.726081    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvhb8\" (UniqueName: \"kubernetes.io/projected/22dbc89c-68ff-4a79-b02b-7e8ed4e73669-kube-api-access-kvhb8\") pod \"22dbc89c-68ff-4a79-b02b-7e8ed4e73669\" (UID: \"22dbc89c-68ff-4a79-b02b-7e8ed4e73669\") "
Jul 14 08:35:33.728804 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.728778    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:33.729290 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.729262    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22dbc89c-68ff-4a79-b02b-7e8ed4e73669-kube-api-access-kvhb8" (OuterVolumeSpecName: "kube-api-access-kvhb8") pod "22dbc89c-68ff-4a79-b02b-7e8ed4e73669" (UID: "22dbc89c-68ff-4a79-b02b-7e8ed4e73669"). InnerVolumeSpecName "kube-api-access-kvhb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:35:33.734065 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.734039    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:33.827694 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.827603    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvhb8\" (UniqueName: \"kubernetes.io/projected/22dbc89c-68ff-4a79-b02b-7e8ed4e73669-kube-api-access-kvhb8\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:35:33.853647 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.853613    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:33.854156 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.854139    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22dbc89c-68ff-4a79-b02b-7e8ed4e73669" containerName="test-curl-7345-140181608867568"
Jul 14 08:35:33.854156 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.854157    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="22dbc89c-68ff-4a79-b02b-7e8ed4e73669" containerName="test-curl-7345-140181608867568"
Jul 14 08:35:33.854280 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.854238    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="22dbc89c-68ff-4a79-b02b-7e8ed4e73669" containerName="test-curl-7345-140181608867568"
Jul 14 08:35:33.857579 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.857560    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:33.867548 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.867516    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:33.928455 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:33.928407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b9d7\" (UniqueName: \"kubernetes.io/projected/246730a8-91c8-4233-b2e1-2606d9506fd5-kube-api-access-6b9d7\") pod \"test-curl-7345-140181608867568\" (UID: \"246730a8-91c8-4233-b2e1-2606d9506fd5\") " pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:34.029927 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:34.029890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b9d7\" (UniqueName: \"kubernetes.io/projected/246730a8-91c8-4233-b2e1-2606d9506fd5-kube-api-access-6b9d7\") pod \"test-curl-7345-140181608867568\" (UID: \"246730a8-91c8-4233-b2e1-2606d9506fd5\") " pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:34.038210 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:34.038185    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b9d7\" (UniqueName: \"kubernetes.io/projected/246730a8-91c8-4233-b2e1-2606d9506fd5-kube-api-access-6b9d7\") pod \"test-curl-7345-140181608867568\" (UID: \"246730a8-91c8-4233-b2e1-2606d9506fd5\") " pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:34.172273 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:34.172179    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:34.313193 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:34.313163    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:34.314907 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:35:34.314882    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod246730a8_91c8_4233_b2e1_2606d9506fd5.slice/crio-96227697e1e09dee74357b754a82c70042d3f7661d91d4159dba9212a35d56c5 WatchSource:0}: Error finding container 96227697e1e09dee74357b754a82c70042d3f7661d91d4159dba9212a35d56c5: Status 404 returned error can't find the container with id 96227697e1e09dee74357b754a82c70042d3f7661d91d4159dba9212a35d56c5
Jul 14 08:35:34.529331 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:34.529302    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:34.529516 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:34.529304    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79c8bb87aa1e16040bb251c74a03b45c5bf334e6069eee4d94c21a8b7c422ae2"
Jul 14 08:35:34.530616 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:34.530587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181608867568" event={"ID":"246730a8-91c8-4233-b2e1-2606d9506fd5","Type":"ContainerStarted","Data":"96227697e1e09dee74357b754a82c70042d3f7661d91d4159dba9212a35d56c5"}
Jul 14 08:35:34.541338 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:34.541292    2562 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7345-140181608867568" oldPodUID="22dbc89c-68ff-4a79-b02b-7e8ed4e73669" podUID="246730a8-91c8-4233-b2e1-2606d9506fd5"
Jul 14 08:35:35.537828 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:35.537793    2562 generic.go:356] "Generic (PLEG): container finished" podID="246730a8-91c8-4233-b2e1-2606d9506fd5" containerID="7eb08848304696d4db12642c685701a6167bd7554d56b7fcbd564bc9e741375a" exitCode=0
Jul 14 08:35:35.538246 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:35.537883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181608867568" event={"ID":"246730a8-91c8-4233-b2e1-2606d9506fd5","Type":"ContainerDied","Data":"7eb08848304696d4db12642c685701a6167bd7554d56b7fcbd564bc9e741375a"}
Jul 14 08:35:35.701587 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:35.701549    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22dbc89c-68ff-4a79-b02b-7e8ed4e73669" path="/var/lib/kubelet/pods/22dbc89c-68ff-4a79-b02b-7e8ed4e73669/volumes"
Jul 14 08:35:36.708572 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:36.708546    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:36.728928 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:36.728858    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7345-140181608867568_246730a8-91c8-4233-b2e1-2606d9506fd5/test-curl-7345-140181608867568/0.log"
Jul 14 08:35:36.752049 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:36.751992    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:36.754607 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:36.754581    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7345-140181608867568"]
Jul 14 08:35:36.754872 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:36.754854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b9d7\" (UniqueName: \"kubernetes.io/projected/246730a8-91c8-4233-b2e1-2606d9506fd5-kube-api-access-6b9d7\") pod \"246730a8-91c8-4233-b2e1-2606d9506fd5\" (UID: \"246730a8-91c8-4233-b2e1-2606d9506fd5\") "
Jul 14 08:35:36.756874 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:36.756844    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/246730a8-91c8-4233-b2e1-2606d9506fd5-kube-api-access-6b9d7" (OuterVolumeSpecName: "kube-api-access-6b9d7") pod "246730a8-91c8-4233-b2e1-2606d9506fd5" (UID: "246730a8-91c8-4233-b2e1-2606d9506fd5"). InnerVolumeSpecName "kube-api-access-6b9d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:35:36.855563 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:36.855468    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b9d7\" (UniqueName: \"kubernetes.io/projected/246730a8-91c8-4233-b2e1-2606d9506fd5-kube-api-access-6b9d7\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:35:37.549284 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:37.549252    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:37.549473 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:37.549290    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96227697e1e09dee74357b754a82c70042d3f7661d91d4159dba9212a35d56c5"
Jul 14 08:35:37.559928 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:35:37.559897    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7345-140181608867568\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="246730a8-91c8-4233-b2e1-2606d9506fd5" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:37.700662 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:35:37.700620    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7345-140181608867568\" is forbidden: User \"system:node:ip-10-0-129-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-164.ec2.internal' and this object" podUID="246730a8-91c8-4233-b2e1-2606d9506fd5" pod="openshift-ingress/test-curl-7345-140181608867568"
Jul 14 08:35:37.702516 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:37.702494    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="246730a8-91c8-4233-b2e1-2606d9506fd5" path="/var/lib/kubelet/pods/246730a8-91c8-4233-b2e1-2606d9506fd5/volumes"
Jul 14 08:35:52.717938 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:52.717902    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"]
Jul 14 08:35:52.718522 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:52.718206    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm" podUID="888f4af3-4509-4a84-a938-1427a9f3c811" containerName="maas-api" containerID="cri-o://2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737" gracePeriod=30
Jul 14 08:35:53.183270 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.183243    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:35:53.310633 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.310524    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m55kq\" (UniqueName: \"kubernetes.io/projected/888f4af3-4509-4a84-a938-1427a9f3c811-kube-api-access-m55kq\") pod \"888f4af3-4509-4a84-a938-1427a9f3c811\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") "
Jul 14 08:35:53.310814 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.310645    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/888f4af3-4509-4a84-a938-1427a9f3c811-openshift-service-ca\") pod \"888f4af3-4509-4a84-a938-1427a9f3c811\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") "
Jul 14 08:35:53.310814 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.310670    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/888f4af3-4509-4a84-a938-1427a9f3c811-maas-api-tls\") pod \"888f4af3-4509-4a84-a938-1427a9f3c811\" (UID: \"888f4af3-4509-4a84-a938-1427a9f3c811\") "
Jul 14 08:35:53.311103 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.311075    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/888f4af3-4509-4a84-a938-1427a9f3c811-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "888f4af3-4509-4a84-a938-1427a9f3c811" (UID: "888f4af3-4509-4a84-a938-1427a9f3c811"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:35:53.312815 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.312790    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/888f4af3-4509-4a84-a938-1427a9f3c811-kube-api-access-m55kq" (OuterVolumeSpecName: "kube-api-access-m55kq") pod "888f4af3-4509-4a84-a938-1427a9f3c811" (UID: "888f4af3-4509-4a84-a938-1427a9f3c811"). InnerVolumeSpecName "kube-api-access-m55kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:35:53.312891 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.312826    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/888f4af3-4509-4a84-a938-1427a9f3c811-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "888f4af3-4509-4a84-a938-1427a9f3c811" (UID: "888f4af3-4509-4a84-a938-1427a9f3c811"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:35:53.411912 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.411869    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/888f4af3-4509-4a84-a938-1427a9f3c811-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:35:53.411912 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.411905    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/888f4af3-4509-4a84-a938-1427a9f3c811-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:35:53.411912 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.411914    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m55kq\" (UniqueName: \"kubernetes.io/projected/888f4af3-4509-4a84-a938-1427a9f3c811-kube-api-access-m55kq\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:35:53.640852 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.640767    2562 generic.go:356] "Generic (PLEG): container finished" podID="888f4af3-4509-4a84-a938-1427a9f3c811" containerID="2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737" exitCode=0
Jul 14 08:35:53.640852 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.640819    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"
Jul 14 08:35:53.641032 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.640854    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm" event={"ID":"888f4af3-4509-4a84-a938-1427a9f3c811","Type":"ContainerDied","Data":"2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737"}
Jul 14 08:35:53.641032 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.640909    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm" event={"ID":"888f4af3-4509-4a84-a938-1427a9f3c811","Type":"ContainerDied","Data":"357bbdd5f9e4cb38004d8c6924787c73ef91e9346a46d7b1c893d9d541830c33"}
Jul 14 08:35:53.641032 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.640933    2562 scope.go:117] "RemoveContainer" containerID="2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737"
Jul 14 08:35:53.651166 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.651144    2562 scope.go:117] "RemoveContainer" containerID="2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737"
Jul 14 08:35:53.651422 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:35:53.651399    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737\": container with ID starting with 2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737 not found: ID does not exist" containerID="2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737"
Jul 14 08:35:53.651469 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.651430    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737"} err="failed to get container status \"2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737\": rpc error: code = NotFound desc = could not find container \"2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737\": container with ID starting with 2d203514cfc39ee7aed4eb40c3687d23cb791c29cbda33d08e41b25eb74f4737 not found: ID does not exist"
Jul 14 08:35:53.663502 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.663475    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"]
Jul 14 08:35:53.667183 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.667159    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0324b2-798cb475b8-52hrm"]
Jul 14 08:35:53.700688 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:35:53.700656    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="888f4af3-4509-4a84-a938-1427a9f3c811" path="/var/lib/kubelet/pods/888f4af3-4509-4a84-a938-1427a9f3c811/volumes"
Jul 14 08:36:19.066084 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.063974    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"]
Jul 14 08:36:19.068023 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.067964    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j" podUID="b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" containerName="maas-api" containerID="cri-o://47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4" gracePeriod=30
Jul 14 08:36:19.539838 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.539814    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:36:19.555717 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.555692    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crtwq\" (UniqueName: \"kubernetes.io/projected/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-kube-api-access-crtwq\") pod \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") "
Jul 14 08:36:19.555885 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.555744    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-openshift-service-ca\") pod \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") "
Jul 14 08:36:19.555885 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.555803    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-maas-api-tls\") pod \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\" (UID: \"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9\") "
Jul 14 08:36:19.556132 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.556109    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" (UID: "b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:36:19.558533 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.558493    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-kube-api-access-crtwq" (OuterVolumeSpecName: "kube-api-access-crtwq") pod "b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" (UID: "b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9"). InnerVolumeSpecName "kube-api-access-crtwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:36:19.559270 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.559244    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" (UID: "b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:36:19.656920 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.656830    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crtwq\" (UniqueName: \"kubernetes.io/projected/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-kube-api-access-crtwq\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:36:19.656920 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.656862    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-openshift-service-ca\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:36:19.656920 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.656873    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9-maas-api-tls\") on node \"ip-10-0-129-164.ec2.internal\" DevicePath \"\""
Jul 14 08:36:19.778070 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.778034    2562 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" containerID="47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4" exitCode=0
Jul 14 08:36:19.778251 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.778091    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"
Jul 14 08:36:19.778251 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.778108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j" event={"ID":"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9","Type":"ContainerDied","Data":"47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4"}
Jul 14 08:36:19.778251 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.778165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j" event={"ID":"b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9","Type":"ContainerDied","Data":"adc155c5593b4cc05343947409b4f6459cad70e06bc78efdd68d5792d2d11563"}
Jul 14 08:36:19.778251 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.778195    2562 scope.go:117] "RemoveContainer" containerID="47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4"
Jul 14 08:36:19.787536 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.787490    2562 scope.go:117] "RemoveContainer" containerID="47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4"
Jul 14 08:36:19.787764 ip-10-0-129-164 kubenswrapper[2562]: E0714 08:36:19.787744    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4\": container with ID starting with 47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4 not found: ID does not exist" containerID="47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4"
Jul 14 08:36:19.787829 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.787771    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4"} err="failed to get container status \"47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4\": rpc error: code = NotFound desc = could not find container \"47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4\": container with ID starting with 47e959d597cabeb786d28e83176e7a594b78e4b79e8a1658df8243db55e316e4 not found: ID does not exist"
Jul 14 08:36:19.795278 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.795245    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"]
Jul 14 08:36:19.797765 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:19.797739    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j"]
Jul 14 08:36:21.700835 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:21.700804    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" path="/var/lib/kubelet/pods/b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9/volumes"
Jul 14 08:36:22.497023 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:22.496944    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9c837-58d6dd8cc6-47s9j" podUID="b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.67:8443/health\": context deadline exceeded"
Jul 14 08:36:34.900488 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:34.900452    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-689867f56f-fbbpz_8e60a5dd-73e9-4877-ae4b-ea260b2b5597/authorino/0.log"
Jul 14 08:36:39.877134 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:39.877101    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l8kmz_6423a520-7044-4556-a277-d23dde708377/manager/0.log"
Jul 14 08:36:39.999699 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:39.999670    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56f8f76b54-rh84h_2b3fba97-e44f-46d2-89ac-82dfd1608b66/manager/0.log"
Jul 14 08:36:40.128929 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:40.128849    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-96rxz_600f7953-d367-4df7-9534-415ed48d88c4/server/0.log"
Jul 14 08:36:40.254384 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:40.254352    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mjxgs_53dbd3f7-821f-4aca-b64d-8b3179aae69f/manager/0.log"
Jul 14 08:36:40.518745 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:40.518714    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm_e124b782-ece2-45b2-9ea5-efe9f65ae4d2/copy-manifests/0.log"
Jul 14 08:36:40.525259 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:40.525230    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm_e124b782-ece2-45b2-9ea5-efe9f65ae4d2/manager/0.log"
Jul 14 08:36:41.037582 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:41.037551    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-697f5878b5-hjrq6_0a9cf006-5781-4dff-8c95-9f6c00265cae/maas-api/0.log"
Jul 14 08:36:42.914804 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:42.914775    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-npbcs_9c0d2b85-8a76-4dcf-a78b-c426e7af0be3/postgres/0.log"
Jul 14 08:36:44.268352 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:44.268317    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-689867f56f-fbbpz_8e60a5dd-73e9-4877-ae4b-ea260b2b5597/authorino/0.log"
Jul 14 08:36:44.386592 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:44.386562    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kvcc7_d7b9cb1c-2a51-48d0-bc43-a442578060da/manager/0.log"
Jul 14 08:36:44.501162 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:44.501119    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hmd4_c358115d-d67a-49d6-9443-58dedd885c3e/manager/0.log"
Jul 14 08:36:44.734663 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:44.734637    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l7hvd_581393fb-f6d2-4d43-9052-77f488bcf644/registry-server/0.log"
Jul 14 08:36:44.852860 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:44.852833    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pz2s8_400ab776-eeca-41d9-98ec-a2528e50199b/manager/0.log"
Jul 14 08:36:45.830588 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:45.830555    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b677bd8c7-mk4zk_7a6ac8ac-5c52-4838-8b31-86d62301b62a/kube-auth-proxy/0.log"
Jul 14 08:36:45.953601 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:45.953566    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ts8gs_666d1f3a-e7e0-4abe-9171-75707dcfe080/istio-proxy/1.log"
Jul 14 08:36:46.069275 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:46.069247    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-hpmjh_9cd89e91-4e74-4394-9480-0348ccb12c89/payload-pre-processing/0.log"
Jul 14 08:36:46.191228 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:46.191149    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-v5xx4_3a6fec6d-1707-417b-a2a4-6486ff916560/payload-processing/0.log"
Jul 14 08:36:46.308818 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:46.308789    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c79d46876-mj7tx_ee5e97bf-4810-415c-881a-0ab22e7d22b3/router/0.log"
Jul 14 08:36:46.656020 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:46.655968    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lw6s7_15ab50c8-4532-430e-9ff6-f936e1d18e8c/main/0.log"
Jul 14 08:36:46.985786 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:46.985754    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpjp7b_bc5e7897-eca3-4628-8ac0-d14a87654b98/main/0.log"
Jul 14 08:36:54.758606 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:54.758578    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-csf4v_c400d5dd-5e2f-42d2-98e6-8efb2140df6f/global-pull-secret-syncer/0.log"
Jul 14 08:36:54.982638 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:54.982609    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zh6z7_40da2252-37f7-4c05-8319-acb257da6539/konnectivity-agent/0.log"
Jul 14 08:36:55.099496 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:36:55.099414    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-164.ec2.internal_0c6b5fe5d9bd457c16dcc8ff1a1230d6/haproxy/0.log"
Jul 14 08:37:00.296853 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:00.296820    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-689867f56f-fbbpz_8e60a5dd-73e9-4877-ae4b-ea260b2b5597/authorino/0.log"
Jul 14 08:37:00.338857 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:00.338826    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kvcc7_d7b9cb1c-2a51-48d0-bc43-a442578060da/manager/0.log"
Jul 14 08:37:00.368521 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:00.368495    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hmd4_c358115d-d67a-49d6-9443-58dedd885c3e/manager/0.log"
Jul 14 08:37:00.443530 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:00.443501    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l7hvd_581393fb-f6d2-4d43-9052-77f488bcf644/registry-server/0.log"
Jul 14 08:37:00.561447 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:00.561357    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pz2s8_400ab776-eeca-41d9-98ec-a2528e50199b/manager/0.log"
Jul 14 08:37:02.673356 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:02.673326    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wpgfz_c00ad41c-67de-4cc6-951a-78f04f46bc7a/cluster-monitoring-operator/0.log"
Jul 14 08:37:03.012717 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:03.012691    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z8gg6_8a2d3227-e3d1-4d82-8885-8c04e1ce7993/node-exporter/0.log"
Jul 14 08:37:03.038216 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:03.038174    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z8gg6_8a2d3227-e3d1-4d82-8885-8c04e1ce7993/kube-rbac-proxy/0.log"
Jul 14 08:37:03.063343 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:03.063317    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z8gg6_8a2d3227-e3d1-4d82-8885-8c04e1ce7993/init-textfile/0.log"
Jul 14 08:37:04.838680 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:04.838652    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-fpvtl_e050bbe6-b0f6-4b14-b96c-15408e08fb00/networking-console-plugin/0.log"
Jul 14 08:37:05.403497 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.403463    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"]
Jul 14 08:37:05.403890 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.403878    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="888f4af3-4509-4a84-a938-1427a9f3c811" containerName="maas-api"
Jul 14 08:37:05.403941 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.403892    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="888f4af3-4509-4a84-a938-1427a9f3c811" containerName="maas-api"
Jul 14 08:37:05.403941 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.403910    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="246730a8-91c8-4233-b2e1-2606d9506fd5" containerName="test-curl-7345-140181608867568"
Jul 14 08:37:05.403941 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.403916    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="246730a8-91c8-4233-b2e1-2606d9506fd5" containerName="test-curl-7345-140181608867568"
Jul 14 08:37:05.403941 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.403933    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" containerName="maas-api"
Jul 14 08:37:05.403941 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.403939    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" containerName="maas-api"
Jul 14 08:37:05.404138 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.404039    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="888f4af3-4509-4a84-a938-1427a9f3c811" containerName="maas-api"
Jul 14 08:37:05.404138 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.404050    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d1b10f-6076-4c96-b485-fdc3dd5dd1d9" containerName="maas-api"
Jul 14 08:37:05.404138 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.404056    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="246730a8-91c8-4233-b2e1-2606d9506fd5" containerName="test-curl-7345-140181608867568"
Jul 14 08:37:05.407498 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.407477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.410233 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.410212    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxkpt\"/\"kube-root-ca.crt\""
Jul 14 08:37:05.410352 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.410260    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxkpt\"/\"openshift-service-ca.crt\""
Jul 14 08:37:05.411496 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.411474    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wxkpt\"/\"default-dockercfg-t94tj\""
Jul 14 08:37:05.417251 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.417229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"]
Jul 14 08:37:05.476745 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.476703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-proc\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.476948 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.476764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-sys\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.476948 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.476810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-podres\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.476948 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.476843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-lib-modules\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.476948 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.476907    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sbhf\" (UniqueName: \"kubernetes.io/projected/e663f789-f74b-4c6d-a87e-2ce2d86961e4-kube-api-access-9sbhf\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.522124 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.522090    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/1.log"
Jul 14 08:37:05.527304 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.527274    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nzn8l_d65da55a-a502-464f-8c67-f626a5b8cb04/console-operator/2.log"
Jul 14 08:37:05.577603 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.577572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-podres\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.577759 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.577613    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-lib-modules\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.577759 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.577662    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sbhf\" (UniqueName: \"kubernetes.io/projected/e663f789-f74b-4c6d-a87e-2ce2d86961e4-kube-api-access-9sbhf\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.577759 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.577686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-proc\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.577759 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.577728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-sys\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.577759 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.577742    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-podres\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.577927 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.577780    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-proc\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.577927 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.577807    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-lib-modules\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.577927 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.577825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e663f789-f74b-4c6d-a87e-2ce2d86961e4-sys\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.586323 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.586301    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sbhf\" (UniqueName: \"kubernetes.io/projected/e663f789-f74b-4c6d-a87e-2ce2d86961e4-kube-api-access-9sbhf\") pod \"perf-node-gather-daemonset-r46br\" (UID: \"e663f789-f74b-4c6d-a87e-2ce2d86961e4\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.718435 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.718409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:05.860327 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:05.860299    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"]
Jul 14 08:37:05.861833 ip-10-0-129-164 kubenswrapper[2562]: W0714 08:37:05.861806    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode663f789_f74b_4c6d_a87e_2ce2d86961e4.slice/crio-c36eec688fcedc5ff8f41f23f9d34eddcca33a191243b42756121c50b5cf1729 WatchSource:0}: Error finding container c36eec688fcedc5ff8f41f23f9d34eddcca33a191243b42756121c50b5cf1729: Status 404 returned error can't find the container with id c36eec688fcedc5ff8f41f23f9d34eddcca33a191243b42756121c50b5cf1729
Jul 14 08:37:06.031532 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:06.031443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br" event={"ID":"e663f789-f74b-4c6d-a87e-2ce2d86961e4","Type":"ContainerStarted","Data":"d7e32c078d15abfc099fa4777d1070afbfab7980c0f9d67e806cd5fbff9bc786"}
Jul 14 08:37:06.031532 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:06.031507    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:06.031532 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:06.031526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br" event={"ID":"e663f789-f74b-4c6d-a87e-2ce2d86961e4","Type":"ContainerStarted","Data":"c36eec688fcedc5ff8f41f23f9d34eddcca33a191243b42756121c50b5cf1729"}
Jul 14 08:37:06.050667 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:06.050619    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br" podStartSLOduration=1.050607013 podStartE2EDuration="1.050607013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 08:37:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:37:06.048732778 +0000 UTC m=+2848.790650647" watchObservedRunningTime="2026-07-14 08:37:06.050607013 +0000 UTC m=+2848.792524881"
Jul 14 08:37:06.089024 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:06.088991    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84c475986b-ncg8s_d1cb67da-ee00-4731-8418-e08a9c83901d/console/0.log"
Jul 14 08:37:06.122702 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:06.122671    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-d6c7m_25ddcf6d-2002-40b8-b101-fd5eb3225a69/download-server/0.log"
Jul 14 08:37:06.724327 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:06.724288    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-s6pzq_5b43906e-04b3-41e6-8cef-0c3e9c27d9ba/volume-data-source-validator/0.log"
Jul 14 08:37:07.975190 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:07.975164    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgdqw_54c6beae-ce14-49ed-b191-b072a7ab5c67/dns/0.log"
Jul 14 08:37:07.997093 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:07.997062    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgdqw_54c6beae-ce14-49ed-b191-b072a7ab5c67/kube-rbac-proxy/0.log"
Jul 14 08:37:08.045606 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:08.045572    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lclhv_afbbaeeb-642f-40e8-97b9-c40c37606c1c/dns-node-resolver/0.log"
Jul 14 08:37:08.688260 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:08.688233    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z622s_6467f114-153b-4368-8289-7acf7e0f3efc/node-ca/0.log"
Jul 14 08:37:09.901717 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:09.901687    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b677bd8c7-mk4zk_7a6ac8ac-5c52-4838-8b31-86d62301b62a/kube-auth-proxy/0.log"
Jul 14 08:37:09.933583 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:09.933522    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ts8gs_666d1f3a-e7e0-4abe-9171-75707dcfe080/istio-proxy/0.log"
Jul 14 08:37:09.966492 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:09.966463    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ts8gs_666d1f3a-e7e0-4abe-9171-75707dcfe080/istio-proxy/1.log"
Jul 14 08:37:09.996350 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:09.996321    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-hpmjh_9cd89e91-4e74-4394-9480-0348ccb12c89/payload-pre-processing/0.log"
Jul 14 08:37:10.027278 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:10.027252    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-v5xx4_3a6fec6d-1707-417b-a2a4-6486ff916560/payload-processing/0.log"
Jul 14 08:37:10.050686 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:10.050656    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c79d46876-mj7tx_ee5e97bf-4810-415c-881a-0ab22e7d22b3/router/0.log"
Jul 14 08:37:10.817421 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:10.817393    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dbsxm_b8d72dd8-efdb-4c85-b6cc-ffd58a507662/serve-healthcheck-canary/0.log"
Jul 14 08:37:11.331414 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:11.331385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-szw28_3d69459a-868a-4c7f-b665-9ce0d8a7d6b6/insights-operator/0.log"
Jul 14 08:37:11.332295 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:11.332276    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-szw28_3d69459a-868a-4c7f-b665-9ce0d8a7d6b6/insights-operator/1.log"
Jul 14 08:37:11.355283 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:11.355262    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjvtp_2e14ecd3-766a-45a3-9615-e881f7dac04f/kube-rbac-proxy/0.log"
Jul 14 08:37:11.380904 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:11.380880    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjvtp_2e14ecd3-766a-45a3-9615-e881f7dac04f/exporter/0.log"
Jul 14 08:37:11.404488 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:11.404464    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjvtp_2e14ecd3-766a-45a3-9615-e881f7dac04f/extractor/0.log"
Jul 14 08:37:12.050117 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:12.050084    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-r46br"
Jul 14 08:37:13.874790 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:13.874763    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l8kmz_6423a520-7044-4556-a277-d23dde708377/manager/0.log"
Jul 14 08:37:13.978060 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:13.978026    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56f8f76b54-rh84h_2b3fba97-e44f-46d2-89ac-82dfd1608b66/manager/0.log"
Jul 14 08:37:14.002514 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:14.002488    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-96rxz_600f7953-d367-4df7-9534-415ed48d88c4/server/0.log"
Jul 14 08:37:14.078716 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:14.078683    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mjxgs_53dbd3f7-821f-4aca-b64d-8b3179aae69f/manager/0.log"
Jul 14 08:37:14.163453 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:14.163370    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm_e124b782-ece2-45b2-9ea5-efe9f65ae4d2/manager/0.log"
Jul 14 08:37:14.187968 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:14.187942    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-jsmrm_e124b782-ece2-45b2-9ea5-efe9f65ae4d2/copy-manifests/0.log"
Jul 14 08:37:15.997834 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:15.997752    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b677bd8c7-mk4zk_7a6ac8ac-5c52-4838-8b31-86d62301b62a/kube-auth-proxy/0.log"
Jul 14 08:37:16.023119 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:16.023092    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ts8gs_666d1f3a-e7e0-4abe-9171-75707dcfe080/istio-proxy/0.log"
Jul 14 08:37:16.052321 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:16.052295    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ts8gs_666d1f3a-e7e0-4abe-9171-75707dcfe080/istio-proxy/1.log"
Jul 14 08:37:16.071247 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:16.071210    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-hpmjh_9cd89e91-4e74-4394-9480-0348ccb12c89/payload-pre-processing/0.log"
Jul 14 08:37:16.089573 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:16.089549    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-v5xx4_3a6fec6d-1707-417b-a2a4-6486ff916560/payload-processing/0.log"
Jul 14 08:37:16.101952 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:16.101929    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c79d46876-mj7tx_ee5e97bf-4810-415c-881a-0ab22e7d22b3/router/0.log"
Jul 14 08:37:17.635067 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:17.635036    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b677bd8c7-mk4zk_7a6ac8ac-5c52-4838-8b31-86d62301b62a/kube-auth-proxy/0.log"
Jul 14 08:37:17.655175 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:17.655094    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ts8gs_666d1f3a-e7e0-4abe-9171-75707dcfe080/istio-proxy/0.log"
Jul 14 08:37:17.686869 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:17.686829    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ts8gs_666d1f3a-e7e0-4abe-9171-75707dcfe080/istio-proxy/1.log"
Jul 14 08:37:17.708354 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:17.708319    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-hpmjh_9cd89e91-4e74-4394-9480-0348ccb12c89/payload-pre-processing/0.log"
Jul 14 08:37:17.729655 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:17.729605    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-v5xx4_3a6fec6d-1707-417b-a2a4-6486ff916560/payload-processing/0.log"
Jul 14 08:37:17.744126 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:17.744106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c79d46876-mj7tx_ee5e97bf-4810-415c-881a-0ab22e7d22b3/router/0.log"
Jul 14 08:37:21.064143 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:21.064102    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-prtg5_7335ac85-9560-499e-b6fa-7421068724bc/migrator/0.log"
Jul 14 08:37:21.097942 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:21.097918    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-prtg5_7335ac85-9560-499e-b6fa-7421068724bc/graceful-termination/0.log"
Jul 14 08:37:21.562686 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:21.562655    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-4jbz9_8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2/kube-storage-version-migrator-operator/1.log"
Jul 14 08:37:21.563416 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:21.563373    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-4jbz9_8ac33f3d-1fe0-4ad5-84ad-1d16f8a6abf2/kube-storage-version-migrator-operator/0.log"
Jul 14 08:37:23.055240 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:23.055209    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tntbw_047c7ea0-3c11-4754-a0dc-c08990ed4c09/kube-multus-additional-cni-plugins/0.log"
Jul 14 08:37:23.087406 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:23.087379    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tntbw_047c7ea0-3c11-4754-a0dc-c08990ed4c09/egress-router-binary-copy/0.log"
Jul 14 08:37:23.120746 ip-10-0-129-164 kubenswrapper[2562]: I0714 08:37:23.120720    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tntbw_047c7ea0-3c11-4754-a0dc-c08990ed4c09/cni-plugins/0.log"