Jul 15 12:11:12.915592 ip-10-0-142-29 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 12:11:13.350485 ip-10-0-142-29 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:11:13.350485 ip-10-0-142-29 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 12:11:13.350485 ip-10-0-142-29 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:11:13.350485 ip-10-0-142-29 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 12:11:13.350485 ip-10-0-142-29 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:11:13.351394 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.351310    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 12:11:13.355957 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355940    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:11:13.355957 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355958    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355963    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355966    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355970    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355973    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355977    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355979    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355982    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355985    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355988    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355990    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355993    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355996    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.355998    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356001    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356004    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356006    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356015    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356018    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356021    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:11:13.356024 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356024    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356028    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356031    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356035    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356040    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356043    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356046    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356048    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356051    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356055    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356057    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356060    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356062    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356065    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356067    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356070    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356073    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356075    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356078    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:11:13.356503 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356082    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356086    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356088    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356091    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356094    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356097    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356100    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356102    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356106    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356108    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356111    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356114    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356116    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356121    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356125    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356129    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356132    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356135    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356137    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356140    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:11:13.356963 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356143    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356146    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356148    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356151    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356153    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356156    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356158    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356161    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356164    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356167    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356169    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356172    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356174    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356177    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356179    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356181    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356184    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356187    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356189    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:11:13.357445 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356192    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356194    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356196    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356199    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356202    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356204    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356207    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356210    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356213    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356216    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356218    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356221    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356223    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356226    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356228    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356232    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356235    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356238    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356240    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:11:13.357869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.356243    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357727    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357734    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357738    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357742    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357744    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357749    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357753    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357756    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357759    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357762    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357765    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357768    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357771    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357773    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357776    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357778    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357781    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357784    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:11:13.358312 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357787    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357790    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357793    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357795    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357798    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357800    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357803    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357806    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357808    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357811    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357813    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357816    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357819    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357821    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357824    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357826    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357829    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357831    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357834    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357837    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:11:13.358774 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357839    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357843    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357845    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357848    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357850    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357853    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357855    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357858    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357860    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357863    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357866    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357869    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357872    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357882    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357885    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357888    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357890    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357893    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357896    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357898    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:11:13.359279 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357901    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357904    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357906    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357909    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357911    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357914    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357916    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357920    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357923    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357926    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357928    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357932    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357934    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357937    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357941    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357944    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357947    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357950    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357953    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357956    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:11:13.359783 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357959    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357961    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357964    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357968    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357971    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357974    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357976    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357978    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357981    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357983    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357986    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357989    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357992    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357994    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357997    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.357999    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358001    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358004    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358006    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358009    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:11:13.360243 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358011    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358423    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358428    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358431    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358434    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358437    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358440    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358444    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358447    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358450    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358453    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358456    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358459    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358462    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358466    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358470    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358473    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358476    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358479    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:11:13.360727 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358482    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358485    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358487    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358490    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358492    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358495    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358497    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358500    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358503    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358505    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358508    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358510    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358513    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358515    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358518    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358520    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358523    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358526    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358528    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358531    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:11:13.361166 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358534    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358537    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358539    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358541    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358544    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358546    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358549    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358552    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358555    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358558    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358560    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358563    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358566    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358569    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358571    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358574    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358576    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358579    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358581    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358584    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:11:13.361651 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358587    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358590    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358593    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358595    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358598    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358600    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358603    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358605    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358607    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358610    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358613    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358617    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358620    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358623    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358626    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358628    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358631    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358633    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358636    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:11:13.362117 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358640    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358642    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358645    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358648    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358651    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358653    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358656    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358659    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358661    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358664    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358667    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358669    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358672    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358674    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358677    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358679    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358682    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358684    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358687    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:11:13.362568 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358689    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358692    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.358694    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358777    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358786    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358797    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358804    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358808    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358811    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358816    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358820    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358823    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358830    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358834    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358837    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358840    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358843    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358846    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358849    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358852    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358855    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358859    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358862    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358865    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 12:11:13.363042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358868    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358871    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358875    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358878    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358881    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358884    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358887    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358890    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358893    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358896    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358899    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358903    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358907    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358910    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358913    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358916    2571 flags.go:64] FLAG: --enable-server="true"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358919    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358924    2571 flags.go:64] FLAG: --event-burst="100"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358928    2571 flags.go:64] FLAG: --event-qps="50"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358931    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358939    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358942    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358946    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358949    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358952    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 12:11:13.363625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358955    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358958    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358961    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358964    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358967    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358970    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358973    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358975    2571 flags.go:64] FLAG: --feature-gates=""
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358979    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358982    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358986    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358989    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358992    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358995    2571 flags.go:64] FLAG: --help="false"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.358998    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359001    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359004    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359006    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359010    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359013    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359016    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359019    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359022    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 12:11:13.364214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359025    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359028    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359031    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359034    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359040    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359043    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359046    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359049    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359051    2571 flags.go:64] FLAG: --lock-file=""
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359054    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359057    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359060    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359066    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359068    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359071    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359074    2571 flags.go:64] FLAG: --logging-format="text"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359077    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359080    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359083    2571 flags.go:64] FLAG: --manifest-url=""
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359086    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359090    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359093    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359097    2571 flags.go:64] FLAG: --max-pods="110"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359100    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359103    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 12:11:13.364838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359106    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359109    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359112    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359115    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359118    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359125    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359127    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359131    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359134    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359137    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359142    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359146    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359151    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359154    2571 flags.go:64] FLAG: --port="10250"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359157    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359159    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0634de8c021e5fcf7"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359163    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359166    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359169    2571 flags.go:64] FLAG: --register-node="true"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359172    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359175    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359178    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359181    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359184    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359188    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 12:11:13.365470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359191    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359194    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359196    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359199    2571 flags.go:64] FLAG: --runonce="false"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359202    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359205    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359208    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359211    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359213    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359216    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359219    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359222    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359225    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359228    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359230    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359234    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359237    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359239    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359243    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359251    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359254    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359257    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359261    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359263    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359266    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 12:11:13.366056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359269    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359272    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359275    2571 flags.go:64] FLAG: --v="2"
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359279    2571 flags.go:64] FLAG: --version="false"
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359283    2571 flags.go:64] FLAG: --vmodule=""
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359299    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.359302    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359419    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359423    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359426    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359429    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359431    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359433    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359436    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359439    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359441    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359444    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359447    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359449    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359452    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359455    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:11:13.366671 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359459    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359463    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359470    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359473    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359477    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359481    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359484    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359486    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359489    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359492    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359495    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359497    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359500    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359503    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359506    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359508    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359512    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359524    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359527    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359530    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:11:13.367440 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359533    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359536    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359539    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359541    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359544    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359546    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359549    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359551    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359554    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359556    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359559    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359562    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359565    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359568    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359570    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359574    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359577    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359581    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359583    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:11:13.368219 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359586    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359588    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359591    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359593    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359596    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359598    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359601    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359603    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359606    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359609    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359611    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359613    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359616    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359618    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359621    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359623    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359626    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359628    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359631    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359633    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:11:13.368734 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359637    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359640    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359642    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359644    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359647    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359650    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359652    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359654    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359657    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359660    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359664    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359666    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359669    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359671    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359674    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359676    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359680    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359684    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359686    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:11:13.369208 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359689    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359691    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359694    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359696    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359699    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359702    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.359704    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.360299    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.367059    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.367076    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.367099    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.367108    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367450    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367462    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367468    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:11:13.369676 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367472    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367477    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367483    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367489    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367494    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367504    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367509    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367546    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367552    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367556    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367561    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367565    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367572    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367578    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367583    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367588    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367592    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367600    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367605    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:11:13.370059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367609    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367614    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367619    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367623    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367628    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367632    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367637    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367643    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367647    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367652    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367662    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367666    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367670    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367675    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367679    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367684    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367688    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367692    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367697    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367701    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:11:13.370521 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367706    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367736    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367740    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367750    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367754    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367758    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367762    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367766    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367771    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367775    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367779    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367783    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367787    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367791    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367796    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367800    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367809    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367813    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367818    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367823    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:11:13.371044 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367827    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367832    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367836    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367841    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367845    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367849    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367854    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367858    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367883    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367985    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367990    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367993    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367996    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.367999    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368006    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368009    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368012    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368014    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368018    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:11:13.371560 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368020    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368023    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368026    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368029    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368032    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368034    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368037    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368040    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368043    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368045    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368048    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368051    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368054    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368058    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368062    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368065    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368069    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:11:13.372010 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368071    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.368077    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368249    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368253    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368256    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368260    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368263    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368266    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368270    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368272    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368275    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368278    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368281    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368284    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368308    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:11:13.372455 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368312    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368314    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368317    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368320    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368324    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368329    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368332    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368336    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368340    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368343    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368346    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368349    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368351    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368354    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368356    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368360    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368362    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368365    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368368    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:11:13.372810 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368370    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368373    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368375    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368378    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368381    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368384    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368387    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368390    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368394    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368397    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368400    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368403    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368406    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368409    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368412    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368414    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368417    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368420    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368422    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:11:13.373255 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368425    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368428    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368430    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368433    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368435    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368438    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368441    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368443    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368446    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368449    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368452    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368455    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368457    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368459    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368462    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368465    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368467    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368471    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368473    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368476    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:11:13.373724 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368478    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368481    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368483    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368486    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368488    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368491    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368493    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368503    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368506    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368508    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368511    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368513    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368516    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368518    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368521    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368523    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368526    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368528    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368530    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368533    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:11:13.374188 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368535    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368538    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368540    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368543    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368545    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368548    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368551    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:13.368553    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.368558    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.368683    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.370792    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.372129    2571 server.go:1019] "Starting client certificate rotation"
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.372223    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 12:11:13.374677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.372261    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 12:11:13.375023 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.374758    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 12:11:13.376119 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.376098    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 12:11:13.384732 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.384715    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 15 12:11:13.386874 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.386859    2571 log.go:25] "Validated CRI v1 image API"
Jul 15 12:11:13.387795 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.387777    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 12:11:13.390777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.390753    2571 fs.go:135] Filesystem UUIDs: map[21568ee0-2745-48c8-913e-460cc2ccf312:/dev/nvme0n1p3 3e55c577-ba82-4fd6-b012-790709c0c811:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 15 12:11:13.390838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.390777    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 12:11:13.396749 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.396624    2571 manager.go:216] Machine: {Timestamp:2026-07-15 12:11:13.395271241 +0000 UTC m=+0.343299883 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100231 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec220bd290ae095808497dea4ac93359 SystemUUID:ec220bd2-90ae-0958-0849-7dea4ac93359 BootID:581a1bf1-544a-4a65-9fc0-4f9b225304f6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8b:72:9e:f3:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8b:72:9e:f3:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:3c:c7:fc:3c:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 12:11:13.396749 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.396741    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 12:11:13.396870 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.396856    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 12:11:13.399322 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.399281    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 12:11:13.399493 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.399328    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-29.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 12:11:13.400135 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.400123    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 12:11:13.400198 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.400140    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 12:11:13.400198 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.400151    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 12:11:13.400679 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.400662    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 12:11:13.400892 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.400880    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 12:11:13.401657 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.401646    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 12:11:13.404575 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.404561    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 12:11:13.404719 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.404708    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 12:11:13.404775 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.404750    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 12:11:13.404775 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.404768    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 12:11:13.404877 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.404785    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 12:11:13.404877 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.404798    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 15 12:11:13.404877 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.404819    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 12:11:13.405388 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.405373    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 12:11:13.405458 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.405396    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 12:11:13.410483 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.410464    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 12:11:13.411776 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.411763    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 12:11:13.411822 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.411793    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 12:11:13.412439 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412429    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 12:11:13.412470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412445    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 12:11:13.412470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412451    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 12:11:13.412470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412456    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 12:11:13.412470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412465    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 12:11:13.412470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412471    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 12:11:13.412602 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412536    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 12:11:13.412602 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412542    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 12:11:13.412602 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412549    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 12:11:13.412602 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412555    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 12:11:13.412602 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412564    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 12:11:13.412602 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.412572    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 12:11:13.413784 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.413749    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 12:11:13.413784 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.413758    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 12:11:13.416932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.416917    2571 server.go:1268] "Started kubelet"
Jul 15 12:11:13.417032 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.416998    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 12:11:13.417334 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.417166    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 12:11:13.417334 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.417231    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 12:11:13.417816 ip-10-0-142-29 systemd[1]: Started Kubernetes Kubelet.
Jul 15 12:11:13.418025 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.417922    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-29.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 12:11:13.418530 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.418390    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 12:11:13.418607 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.418534    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 12:11:13.418607 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.418543    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 12:11:13.419582 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.419564    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 12:11:13.422649 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.422633    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 12:11:13.422725 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.422633    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 12:11:13.422792 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.422771    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:13.423313 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.423299    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 12:11:13.423397 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.423299    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 12:11:13.423397 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.423339    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 12:11:13.423493 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.423472    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 12:11:13.423493 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.423480    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 12:11:13.423782 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.423750    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 12:11:13.424372 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.424356    2571 factory.go:55] Registering systemd factory
Jul 15 12:11:13.424372 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.424375    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 15 12:11:13.424578 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.424565    2571 factory.go:153] Registering CRI-O factory
Jul 15 12:11:13.424578 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.424578    2571 factory.go:223] Registration of the crio container factory successfully
Jul 15 12:11:13.424720 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.424636    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 12:11:13.424720 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.424677    2571 factory.go:103] Registering Raw factory
Jul 15 12:11:13.424720 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.424691    2571 manager.go:1196] Started watching for new ooms in manager
Jul 15 12:11:13.424943 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.424918    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 12:11:13.425176 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.425156    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 12:11:13.425236 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.425184    2571 manager.go:349] Starting recovery of all containers
Jul 15 12:11:13.425949 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.424962    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-29.ec2.internal.18c27563b094afa2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-29.ec2.internal,UID:ip-10-0-142-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-29.ec2.internal,},FirstTimestamp:2026-07-15 12:11:13.41688413 +0000 UTC m=+0.364912774,LastTimestamp:2026-07-15 12:11:13.41688413 +0000 UTC m=+0.364912774,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-29.ec2.internal,}"
Jul 15 12:11:13.427880 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.427855    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5j26"
Jul 15 12:11:13.434814 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.434795    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5j26"
Jul 15 12:11:13.437249 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.437232    2571 manager.go:354] Recovery completed
Jul 15 12:11:13.438559 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.438543    2571 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 15 12:11:13.441486 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.441474    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:11:13.443213 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.443199    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:11:13.443274 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.443222    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:11:13.443274 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.443236    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:11:13.443857 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.443842    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 12:11:13.443857 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.443855    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 12:11:13.443974 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.443868    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 12:11:13.443974 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.443872    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:11:13.444596 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.444578    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:11:13.444678 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.444611    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:11:13.444678 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.444641    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:11:13.445117 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.445102    2571 policy_none.go:49] "None policy: Start"
Jul 15 12:11:13.445181 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.445126    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 12:11:13.445181 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.445137    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 12:11:13.446084 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.446014    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-29.ec2.internal.18c27563b2266ef6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-29.ec2.internal,UID:ip-10-0-142-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-29.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-29.ec2.internal,},FirstTimestamp:2026-07-15 12:11:13.443213046 +0000 UTC m=+0.391241687,LastTimestamp:2026-07-15 12:11:13.443213046 +0000 UTC m=+0.391241687,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-29.ec2.internal,}"
Jul 15 12:11:13.446379 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.446368    2571 policy_none.go:47] "Start"
Jul 15 12:11:13.476851 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.476830    2571 manager.go:337] "Starting Device Plugin manager"
Jul 15 12:11:13.476955 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.476861    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 12:11:13.476955 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.476871    2571 server.go:87] "Starting device plugin registration server"
Jul 15 12:11:13.477122 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.477112    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 12:11:13.477160 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.477125    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 12:11:13.477243 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.477226    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 12:11:13.477368 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.477325    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 12:11:13.477368 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.477336    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 12:11:13.478490 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.478107    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 12:11:13.478490 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.478156    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:13.577856 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.577698    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:11:13.578925 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.578830    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:11:13.578925 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.578862    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:11:13.578925 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.578873    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:11:13.578925 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.578902    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.585931 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.585915    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.585986 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.585938    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-29.ec2.internal\": node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:13.601465 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.601447    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:13.618977 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.618942    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 12:11:13.620199 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.620172    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 12:11:13.620270 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.620227    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 12:11:13.620316 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.620304    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 12:11:13.620390 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.620352    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 12:11:13.622435 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.622417    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:11:13.702313 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.702253    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:13.721876 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.721844    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal"]
Jul 15 12:11:13.721941 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.721927    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:11:13.723055 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.723035    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:11:13.723154 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.723072    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:11:13.723154 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.723087    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:11:13.724247 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.724229    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d549db6d156048ee269a1cdc2293048-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal\" (UID: \"1d549db6d156048ee269a1cdc2293048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.724304 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.724256    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d549db6d156048ee269a1cdc2293048-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal\" (UID: \"1d549db6d156048ee269a1cdc2293048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.724656 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.724645    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:11:13.724796 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.724781    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.724834 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.724822    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:11:13.725420 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.725401    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:11:13.725565 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.725438    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:11:13.725565 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.725450    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:11:13.725565 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.725408    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:11:13.725565 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.725514    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:11:13.725565 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.725529    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:11:13.726814 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.726799    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.726865 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.726824    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:11:13.727565 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.727543    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:11:13.727673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.727575    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:11:13.727673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.727586    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:11:13.752166 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.752144    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-29.ec2.internal\" not found" node="ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.757052 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.757036    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-29.ec2.internal\" not found" node="ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.803261 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.803236    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:13.824663 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.824637    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d549db6d156048ee269a1cdc2293048-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal\" (UID: \"1d549db6d156048ee269a1cdc2293048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.824751 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.824678    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d549db6d156048ee269a1cdc2293048-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal\" (UID: \"1d549db6d156048ee269a1cdc2293048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.824751 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.824707    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7803b45d5dbe62303a41ccd8fb6f0b0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-29.ec2.internal\" (UID: \"c7803b45d5dbe62303a41ccd8fb6f0b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.824835 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.824743    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d549db6d156048ee269a1cdc2293048-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal\" (UID: \"1d549db6d156048ee269a1cdc2293048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.824835 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.824779    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d549db6d156048ee269a1cdc2293048-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal\" (UID: \"1d549db6d156048ee269a1cdc2293048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.904561 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:13.904468    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:13.925485 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.925454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7803b45d5dbe62303a41ccd8fb6f0b0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-29.ec2.internal\" (UID: \"c7803b45d5dbe62303a41ccd8fb6f0b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:13.925606 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:13.925506    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7803b45d5dbe62303a41ccd8fb6f0b0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-29.ec2.internal\" (UID: \"c7803b45d5dbe62303a41ccd8fb6f0b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:14.010954 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.010907    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.055882 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.055851    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:14.060217 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.060088    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:14.111533 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.111494    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.216005 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.215922    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.293601 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.293567    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:11:14.316932 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.316893    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.372104 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.372056    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 12:11:14.372649 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.372221    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 12:11:14.372649 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.372287    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 12:11:14.418011 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.417969    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.438674 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.438624    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 12:06:13 +0000 UTC" deadline="2028-04-26 03:08:55.363461716 +0000 UTC"
Jul 15 12:11:14.438674 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.438671    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15614h57m40.924794312s"
Jul 15 12:11:14.521031 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.520955    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.621188 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.621146    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.722199 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.722170    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.822335 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.822262    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.835204 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.835172    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:11:14.872006 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:14.871973    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d549db6d156048ee269a1cdc2293048.slice/crio-0c45ccd99f3216a36045bfc2edbd53b9bb157d18862b1790f56705ae8ff941c5 WatchSource:0}: Error finding container 0c45ccd99f3216a36045bfc2edbd53b9bb157d18862b1790f56705ae8ff941c5: Status 404 returned error can't find the container with id 0c45ccd99f3216a36045bfc2edbd53b9bb157d18862b1790f56705ae8ff941c5
Jul 15 12:11:14.872506 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:14.872483    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7803b45d5dbe62303a41ccd8fb6f0b0.slice/crio-8f45328004d55a8efc0467bfe99b0309a1d08cb67d33a48002ef5c13088ac8f1 WatchSource:0}: Error finding container 8f45328004d55a8efc0467bfe99b0309a1d08cb67d33a48002ef5c13088ac8f1: Status 404 returned error can't find the container with id 8f45328004d55a8efc0467bfe99b0309a1d08cb67d33a48002ef5c13088ac8f1
Jul 15 12:11:14.880166 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.880146    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:11:14.923268 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:14.923227    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-29.ec2.internal\" not found"
Jul 15 12:11:14.933524 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:14.933499    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:11:15.025136 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.025099    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:15.036823 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.036798    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 12:11:15.038024 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.038011    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal"
Jul 15 12:11:15.045688 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.045672    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 12:11:15.382939 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.382903    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:11:15.408181 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.408157    2571 apiserver.go:52] "Watching apiserver"
Jul 15 12:11:15.417992 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.417968    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 12:11:15.418385 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.418364    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal","openshift-multus/multus-additional-cni-plugins-swsmv","openshift-multus/network-metrics-daemon-54zrq","openshift-ovn-kubernetes/ovnkube-node-lpdrc","kube-system/global-pull-secret-syncer-vhf9x","kube-system/konnectivity-agent-zbj2w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv","openshift-image-registry/node-ca-dtgm7","openshift-multus/multus-6754g","openshift-network-diagnostics/network-check-target-5vkzg","openshift-network-operator/iptables-alerter-qvlnl","kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal","openshift-cluster-node-tuning-operator/tuned-b2tgg","openshift-dns/node-resolver-wjqkf"]
Jul 15 12:11:15.422686 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.422667    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:15.422775 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.422751    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:15.422947 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.422931    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 12:11:15.424862 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.424847    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:15.427214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.427164    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.427621 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.427601    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 12:11:15.427743 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.427654    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vsb9j\""
Jul 15 12:11:15.427743 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.427656    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 12:11:15.429505 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.429488    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.430746 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.430728    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 12:11:15.431509 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.431490    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w5mcp\""
Jul 15 12:11:15.431841 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.431635    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 12:11:15.432128 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.432109    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.432220 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.432200    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 12:11:15.433161 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.433138    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8djs7\""
Jul 15 12:11:15.433161 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.433159    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 12:11:15.433324 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.433146    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 12:11:15.433324 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.433261    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 12:11:15.433460 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.433436    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 12:11:15.434605 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.434584    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:15.434768 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.434650    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:15.434866 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.434852    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sb2lp\""
Jul 15 12:11:15.434866 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.434871    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:11:15.435106 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.435090    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 12:11:15.436110 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.436093    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:15.436190 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.436122    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95a1c495-dbd0-4635-a0c7-1288e8404efa-agent-certs\") pod \"konnectivity-agent-zbj2w\" (UID: \"95a1c495-dbd0-4635-a0c7-1288e8404efa\") " pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:15.436190 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.436097    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 12:11:15.436190 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.436148    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95a1c495-dbd0-4635-a0c7-1288e8404efa-konnectivity-ca\") pod \"konnectivity-agent-zbj2w\" (UID: \"95a1c495-dbd0-4635-a0c7-1288e8404efa\") " pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:15.437107 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.437090    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.439511 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.439478    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:15.439589 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.439552    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:15.440348 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.440318    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 12:11:15.440348 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.440332    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 12:11:15.440504 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.440348    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 12:11:15.440504 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.440325    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tg8dg\""
Jul 15 12:11:15.440504 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.440355    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 12:11:15.440504 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.440442    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 12:11:15.443401 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.442300    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.443780 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.443759    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 12:11:15.445144 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.445126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.445902 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.445881    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xgn9m\""
Jul 15 12:11:15.446030 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.446000    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 12:11:15.446502 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.445853    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 12:11:15.448275 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.448256    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-txlml\""
Jul 15 12:11:15.448389 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.448320    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 12:11:15.448458 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.448409    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 12:11:15.448497 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.448471    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:11:15.448745 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.448726    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.451105 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.451085    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.451632 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.451610    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 12:11:15.451839 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.451822    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 12:11:15.451905 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.451883    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 12:11:15.451905 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.451896    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9gnk7\""
Jul 15 12:11:15.454136 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.454111    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 12:11:15.454136 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.454136    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 12:11:15.454287 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.454191    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gj684\""
Jul 15 12:11:15.463197 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.463178    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vp872"
Jul 15 12:11:15.471093 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.471075    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vp872"
Jul 15 12:11:15.524768 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.524739    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 12:11:15.536788 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.536758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-cnibin\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.536932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.536799    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-socket-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.536932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.536828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-tuned\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.536932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.536856    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-etc-selinux\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.536932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.536880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-run-ovn\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.536932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.536903    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-cnibin\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.536932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.536930    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twm96\" (UniqueName: \"kubernetes.io/projected/9592893f-442b-47fa-862f-d9c2bfa30ead-kube-api-access-twm96\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.537187 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.536958    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-run-systemd\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.537187 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537005    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-run-ovn-kubernetes\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.537187 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99f66112-4275-47b6-9e54-d1b2b0f0a575-ovnkube-config\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.537187 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:15.537187 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537092    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-sysctl-d\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.537187 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537157    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf2sd\" (UniqueName: \"kubernetes.io/projected/99f66112-4275-47b6-9e54-d1b2b0f0a575-kube-api-access-cf2sd\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537250    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-run-multus-certs\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-sysctl-conf\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-run\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537347    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-system-cni-dir\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537419    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-cni-dir\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-sysconfig\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/751927ee-281b-4427-bce1-1b8c3bfb2349-tmp\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnd8g\" (UniqueName: \"kubernetes.io/projected/89fd816f-1fa1-4220-8e5e-903050d92a3a-kube-api-access-wnd8g\") pod \"node-resolver-wjqkf\" (UID: \"89fd816f-1fa1-4220-8e5e-903050d92a3a\") " pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-registration-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.537531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-cni-bin\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537545    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-var-lib-kubelet\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-sys\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-var-lib-kubelet\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537642    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-cni-binary-copy\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537717    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-conf-dir\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537749    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-daemon-config\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537780    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95a1c495-dbd0-4635-a0c7-1288e8404efa-konnectivity-ca\") pod \"konnectivity-agent-zbj2w\" (UID: \"95a1c495-dbd0-4635-a0c7-1288e8404efa\") " pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-modprobe-d\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-os-release\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537863    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67edde5e-b3b4-4c04-8f93-482970cd6e00-iptables-alerter-script\") pod \"iptables-alerter-qvlnl\" (UID: \"67edde5e-b3b4-4c04-8f93-482970cd6e00\") " pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537889    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67edde5e-b3b4-4c04-8f93-482970cd6e00-host-slash\") pod \"iptables-alerter-qvlnl\" (UID: \"67edde5e-b3b4-4c04-8f93-482970cd6e00\") " pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537911    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-systemd-units\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl5ms\" (UniqueName: \"kubernetes.io/projected/f633254c-28aa-4625-ac26-df610d480c2d-kube-api-access-bl5ms\") pod \"node-ca-dtgm7\" (UID: \"f633254c-28aa-4625-ac26-df610d480c2d\") " pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537957    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-run-k8s-cni-cncf-io\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.538126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.537994    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-var-lib-cni-bin\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538021    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-device-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538037    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3a41138-421d-46e7-af35-7e0f94d4cadd-dbus\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-run-openvswitch\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538083    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9592893f-442b-47fa-862f-d9c2bfa30ead-cni-binary-copy\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538106    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-hostroot\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-node-log\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f633254c-28aa-4625-ac26-df610d480c2d-serviceca\") pod \"node-ca-dtgm7\" (UID: \"f633254c-28aa-4625-ac26-df610d480c2d\") " pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538181    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-var-lib-openvswitch\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538199    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-cni-netd\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538218    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538257    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fd816f-1fa1-4220-8e5e-903050d92a3a-tmp-dir\") pod \"node-resolver-wjqkf\" (UID: \"89fd816f-1fa1-4220-8e5e-903050d92a3a\") " pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-systemd\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8pf8\" (UniqueName: \"kubernetes.io/projected/751927ee-281b-4427-bce1-1b8c3bfb2349-kube-api-access-r8pf8\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538457    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k29zk\" (UniqueName: \"kubernetes.io/projected/b7b134d9-1ced-4432-bc91-b31c12185191-kube-api-access-k29zk\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.538777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538485    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3a41138-421d-46e7-af35-7e0f94d4cadd-kubelet-config\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-kubernetes\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89fd816f-1fa1-4220-8e5e-903050d92a3a-hosts-file\") pod \"node-resolver-wjqkf\" (UID: \"89fd816f-1fa1-4220-8e5e-903050d92a3a\") " pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538566    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-kubelet\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-run-netns\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538618    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538642    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkn8p\" (UniqueName: \"kubernetes.io/projected/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-kube-api-access-tkn8p\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538666    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-run-netns\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99f66112-4275-47b6-9e54-d1b2b0f0a575-ovn-node-metrics-cert\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-sys-fs\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538742    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538773    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-log-socket\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f633254c-28aa-4625-ac26-df610d480c2d-host\") pod \"node-ca-dtgm7\" (UID: \"f633254c-28aa-4625-ac26-df610d480c2d\") " pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-socket-dir-parent\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-slash\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99f66112-4275-47b6-9e54-d1b2b0f0a575-env-overrides\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.539532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99f66112-4275-47b6-9e54-d1b2b0f0a575-ovnkube-script-lib\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538971    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-system-cni-dir\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.538995    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-os-release\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-lib-modules\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539040    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-host\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7nc9\" (UniqueName: \"kubernetes.io/projected/8d48e773-ec60-489a-84f1-8f816afd365e-kube-api-access-s7nc9\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539089    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-etc-openvswitch\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539116    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-var-lib-cni-multus\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539136    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95a1c495-dbd0-4635-a0c7-1288e8404efa-konnectivity-ca\") pod \"konnectivity-agent-zbj2w\" (UID: \"95a1c495-dbd0-4635-a0c7-1288e8404efa\") " pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-etc-kubernetes\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539199    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95a1c495-dbd0-4635-a0c7-1288e8404efa-agent-certs\") pod \"konnectivity-agent-zbj2w\" (UID: \"95a1c495-dbd0-4635-a0c7-1288e8404efa\") " pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539227    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g469\" (UniqueName: \"kubernetes.io/projected/67edde5e-b3b4-4c04-8f93-482970cd6e00-kube-api-access-8g469\") pod \"iptables-alerter-qvlnl\" (UID: \"67edde5e-b3b4-4c04-8f93-482970cd6e00\") " pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.540172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.539594    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 12:11:15.543782 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.543755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95a1c495-dbd0-4635-a0c7-1288e8404efa-agent-certs\") pod \"konnectivity-agent-zbj2w\" (UID: \"95a1c495-dbd0-4635-a0c7-1288e8404efa\") " pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:15.546568 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.546547    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:15.546686 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.546572    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:15.546686 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.546585    2571 projected.go:196] Error preparing data for projected volume kube-api-access-lhcq5 for pod openshift-network-diagnostics/network-check-target-5vkzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:15.546686 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.546664    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5 podName:7d114473-e4b2-4ce7-97df-eb319eabe1ea nodeName:}" failed. No retries permitted until 2026-07-15 12:11:16.046641293 +0000 UTC m=+2.994669925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lhcq5" (UniqueName: "kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5") pod "network-check-target-5vkzg" (UID: "7d114473-e4b2-4ce7-97df-eb319eabe1ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:15.625358 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.625282    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal" event={"ID":"1d549db6d156048ee269a1cdc2293048","Type":"ContainerStarted","Data":"0c45ccd99f3216a36045bfc2edbd53b9bb157d18862b1790f56705ae8ff941c5"}
Jul 15 12:11:15.626732 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.626703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal" event={"ID":"c7803b45d5dbe62303a41ccd8fb6f0b0","Type":"ContainerStarted","Data":"8f45328004d55a8efc0467bfe99b0309a1d08cb67d33a48002ef5c13088ac8f1"}
Jul 15 12:11:15.639787 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639710    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-lib-modules\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.639787 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639739    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-host\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.639787 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7nc9\" (UniqueName: \"kubernetes.io/projected/8d48e773-ec60-489a-84f1-8f816afd365e-kube-api-access-s7nc9\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:15.639787 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639775    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-etc-openvswitch\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-var-lib-cni-multus\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-etc-kubernetes\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g469\" (UniqueName: \"kubernetes.io/projected/67edde5e-b3b4-4c04-8f93-482970cd6e00-kube-api-access-8g469\") pod \"iptables-alerter-qvlnl\" (UID: \"67edde5e-b3b4-4c04-8f93-482970cd6e00\") " pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639860    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-host\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-cnibin\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639891    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-etc-openvswitch\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-cnibin\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-socket-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639954    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-etc-kubernetes\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-tuned\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639970    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-lib-modules\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.639991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-etc-selinux\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-var-lib-cni-multus\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.640020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-run-ovn\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-cnibin\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640054    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-socket-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640104    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-run-ovn\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640106    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-cnibin\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-etc-selinux\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twm96\" (UniqueName: \"kubernetes.io/projected/9592893f-442b-47fa-862f-d9c2bfa30ead-kube-api-access-twm96\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640219    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-run-systemd\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640282    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-run-systemd\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-run-ovn-kubernetes\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640358    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99f66112-4275-47b6-9e54-d1b2b0f0a575-ovnkube-config\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640410    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-sysctl-d\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640425    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-run-ovn-kubernetes\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640438    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf2sd\" (UniqueName: \"kubernetes.io/projected/99f66112-4275-47b6-9e54-d1b2b0f0a575-kube-api-access-cf2sd\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640464    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-run-multus-certs\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-sysctl-conf\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640539    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-sysctl-d\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.640740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640540    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-run\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640577    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-system-cni-dir\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640614    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-cni-dir\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-sysconfig\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-run\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/751927ee-281b-4427-bce1-1b8c3bfb2349-tmp\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640658    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640672    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnd8g\" (UniqueName: \"kubernetes.io/projected/89fd816f-1fa1-4220-8e5e-903050d92a3a-kube-api-access-wnd8g\") pod \"node-resolver-wjqkf\" (UID: \"89fd816f-1fa1-4220-8e5e-903050d92a3a\") " pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640682    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-run-multus-certs\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640691    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-registration-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640733    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-system-cni-dir\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-sysctl-conf\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-cni-bin\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640849    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-var-lib-kubelet\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-sys\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640889    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-var-lib-kubelet\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.641350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-cni-binary-copy\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.640978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99f66112-4275-47b6-9e54-d1b2b0f0a575-ovnkube-config\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-conf-dir\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641054    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-cni-dir\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641067    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-daemon-config\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641094    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-modprobe-d\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641101    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-cni-bin\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-os-release\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641164    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-conf-dir\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641268    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-sysconfig\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641348    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-os-release\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641455    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-modprobe-d\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641509    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-sys\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641561    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-registration-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641604    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-var-lib-kubelet\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641625    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-cni-binary-copy\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.642214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641643    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67edde5e-b3b4-4c04-8f93-482970cd6e00-iptables-alerter-script\") pod \"iptables-alerter-qvlnl\" (UID: \"67edde5e-b3b4-4c04-8f93-482970cd6e00\") " pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67edde5e-b3b4-4c04-8f93-482970cd6e00-host-slash\") pod \"iptables-alerter-qvlnl\" (UID: \"67edde5e-b3b4-4c04-8f93-482970cd6e00\") " pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641687    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-var-lib-kubelet\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-daemon-config\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-systemd-units\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641761    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-systemd-units\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.641789    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641797    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl5ms\" (UniqueName: \"kubernetes.io/projected/f633254c-28aa-4625-ac26-df610d480c2d-kube-api-access-bl5ms\") pod \"node-ca-dtgm7\" (UID: \"f633254c-28aa-4625-ac26-df610d480c2d\") " pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641829    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-run-k8s-cni-cncf-io\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641847    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67edde5e-b3b4-4c04-8f93-482970cd6e00-host-slash\") pod \"iptables-alerter-qvlnl\" (UID: \"67edde5e-b3b4-4c04-8f93-482970cd6e00\") " pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.641872    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-var-lib-cni-bin\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.641949    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs podName:8d48e773-ec60-489a-84f1-8f816afd365e nodeName:}" failed. No retries permitted until 2026-07-15 12:11:16.141928129 +0000 UTC m=+3.089956774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs") pod "network-metrics-daemon-54zrq" (UID: "8d48e773-ec60-489a-84f1-8f816afd365e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-device-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3a41138-421d-46e7-af35-7e0f94d4cadd-dbus\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-run-k8s-cni-cncf-io\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642084    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-run-openvswitch\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642130    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9592893f-442b-47fa-862f-d9c2bfa30ead-cni-binary-copy\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.643100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642156    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-hostroot\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642222    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3a41138-421d-46e7-af35-7e0f94d4cadd-dbus\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642260    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-var-lib-cni-bin\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642264    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-device-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-node-log\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f633254c-28aa-4625-ac26-df610d480c2d-serviceca\") pod \"node-ca-dtgm7\" (UID: \"f633254c-28aa-4625-ac26-df610d480c2d\") " pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642415    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-var-lib-openvswitch\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-cni-netd\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642507    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67edde5e-b3b4-4c04-8f93-482970cd6e00-iptables-alerter-script\") pod \"iptables-alerter-qvlnl\" (UID: \"67edde5e-b3b4-4c04-8f93-482970cd6e00\") " pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642534    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642558    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-hostroot\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fd816f-1fa1-4220-8e5e-903050d92a3a-tmp-dir\") pod \"node-resolver-wjqkf\" (UID: \"89fd816f-1fa1-4220-8e5e-903050d92a3a\") " pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642593    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-systemd\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642597    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-cni-netd\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8pf8\" (UniqueName: \"kubernetes.io/projected/751927ee-281b-4427-bce1-1b8c3bfb2349-kube-api-access-r8pf8\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-node-log\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642696    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642713    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-systemd\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642222    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-run-openvswitch\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642781    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k29zk\" (UniqueName: \"kubernetes.io/projected/b7b134d9-1ced-4432-bc91-b31c12185191-kube-api-access-k29zk\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642785    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9592893f-442b-47fa-862f-d9c2bfa30ead-cni-binary-copy\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642843    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-var-lib-openvswitch\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642848    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.642856    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3a41138-421d-46e7-af35-7e0f94d4cadd-kubelet-config\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-kubernetes\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89fd816f-1fa1-4220-8e5e-903050d92a3a-hosts-file\") pod \"node-resolver-wjqkf\" (UID: \"89fd816f-1fa1-4220-8e5e-903050d92a3a\") " pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643122    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fd816f-1fa1-4220-8e5e-903050d92a3a-tmp-dir\") pod \"node-resolver-wjqkf\" (UID: \"89fd816f-1fa1-4220-8e5e-903050d92a3a\") " pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643145    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-kubelet\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643173    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-run-netns\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643192    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-kubernetes\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643245    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkn8p\" (UniqueName: \"kubernetes.io/projected/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-kube-api-access-tkn8p\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.644950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643249    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89fd816f-1fa1-4220-8e5e-903050d92a3a-hosts-file\") pod \"node-resolver-wjqkf\" (UID: \"89fd816f-1fa1-4220-8e5e-903050d92a3a\") " pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643248    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3a41138-421d-46e7-af35-7e0f94d4cadd-kubelet-config\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643293    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-run-netns\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643292    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-kubelet\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643318    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99f66112-4275-47b6-9e54-d1b2b0f0a575-ovn-node-metrics-cert\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643348    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-sys-fs\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643382    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-host-run-netns\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643388    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643308    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-run-netns\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643420    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-log-socket\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f633254c-28aa-4625-ac26-df610d480c2d-host\") pod \"node-ca-dtgm7\" (UID: \"f633254c-28aa-4625-ac26-df610d480c2d\") " pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643474    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-socket-dir-parent\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643480    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/751927ee-281b-4427-bce1-1b8c3bfb2349-tmp\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643500    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-slash\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/751927ee-281b-4427-bce1-1b8c3bfb2349-etc-tuned\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99f66112-4275-47b6-9e54-d1b2b0f0a575-env-overrides\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643567    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-host-slash\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643578    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f633254c-28aa-4625-ac26-df610d480c2d-host\") pod \"node-ca-dtgm7\" (UID: \"f633254c-28aa-4625-ac26-df610d480c2d\") " pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.645815 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.643588    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99f66112-4275-47b6-9e54-d1b2b0f0a575-ovnkube-script-lib\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643620    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99f66112-4275-47b6-9e54-d1b2b0f0a575-log-socket\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:15.643651    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret podName:d3a41138-421d-46e7-af35-7e0f94d4cadd nodeName:}" failed. No retries permitted until 2026-07-15 12:11:16.14363422 +0000 UTC m=+3.091662865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret") pod "global-pull-secret-syncer-vhf9x" (UID: "d3a41138-421d-46e7-af35-7e0f94d4cadd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643584    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7b134d9-1ced-4432-bc91-b31c12185191-sys-fs\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643671    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-system-cni-dir\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-multus-socket-dir-parent\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643734    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-system-cni-dir\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643742    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-os-release\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643749    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f633254c-28aa-4625-ac26-df610d480c2d-serviceca\") pod \"node-ca-dtgm7\" (UID: \"f633254c-28aa-4625-ac26-df610d480c2d\") " pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643842    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9592893f-442b-47fa-862f-d9c2bfa30ead-os-release\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643852    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.643971    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99f66112-4275-47b6-9e54-d1b2b0f0a575-env-overrides\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.644434    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99f66112-4275-47b6-9e54-d1b2b0f0a575-ovnkube-script-lib\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.646484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.646027    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99f66112-4275-47b6-9e54-d1b2b0f0a575-ovn-node-metrics-cert\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.649115 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.649087    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g469\" (UniqueName: \"kubernetes.io/projected/67edde5e-b3b4-4c04-8f93-482970cd6e00-kube-api-access-8g469\") pod \"iptables-alerter-qvlnl\" (UID: \"67edde5e-b3b4-4c04-8f93-482970cd6e00\") " pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.649623 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.649587    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnd8g\" (UniqueName: \"kubernetes.io/projected/89fd816f-1fa1-4220-8e5e-903050d92a3a-kube-api-access-wnd8g\") pod \"node-resolver-wjqkf\" (UID: \"89fd816f-1fa1-4220-8e5e-903050d92a3a\") " pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.649817 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.649797    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7nc9\" (UniqueName: \"kubernetes.io/projected/8d48e773-ec60-489a-84f1-8f816afd365e-kube-api-access-s7nc9\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:15.650232 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.650212    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twm96\" (UniqueName: \"kubernetes.io/projected/9592893f-442b-47fa-862f-d9c2bfa30ead-kube-api-access-twm96\") pod \"multus-6754g\" (UID: \"9592893f-442b-47fa-862f-d9c2bfa30ead\") " pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.650408 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.650388    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf2sd\" (UniqueName: \"kubernetes.io/projected/99f66112-4275-47b6-9e54-d1b2b0f0a575-kube-api-access-cf2sd\") pod \"ovnkube-node-lpdrc\" (UID: \"99f66112-4275-47b6-9e54-d1b2b0f0a575\") " pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.652708 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.652688    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl5ms\" (UniqueName: \"kubernetes.io/projected/f633254c-28aa-4625-ac26-df610d480c2d-kube-api-access-bl5ms\") pod \"node-ca-dtgm7\" (UID: \"f633254c-28aa-4625-ac26-df610d480c2d\") " pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.657125 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.657103    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k29zk\" (UniqueName: \"kubernetes.io/projected/b7b134d9-1ced-4432-bc91-b31c12185191-kube-api-access-k29zk\") pod \"aws-ebs-csi-driver-node-xq6lv\" (UID: \"b7b134d9-1ced-4432-bc91-b31c12185191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.657520 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.657494    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8pf8\" (UniqueName: \"kubernetes.io/projected/751927ee-281b-4427-bce1-1b8c3bfb2349-kube-api-access-r8pf8\") pod \"tuned-b2tgg\" (UID: \"751927ee-281b-4427-bce1-1b8c3bfb2349\") " pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.657630 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.657499    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkn8p\" (UniqueName: \"kubernetes.io/projected/c6acb4c6-9cd8-4239-a879-1a12f83f1c9e-kube-api-access-tkn8p\") pod \"multus-additional-cni-plugins-swsmv\" (UID: \"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e\") " pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.735393 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.735355    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:15.742439 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.742414    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv"
Jul 15 12:11:15.748179 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:15.748150    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a1c495_dbd0_4635_a0c7_1288e8404efa.slice/crio-771fce7efdc66a2684373898385c3f4bbe1948f4e6441409d2a0d19c25ce755c WatchSource:0}: Error finding container 771fce7efdc66a2684373898385c3f4bbe1948f4e6441409d2a0d19c25ce755c: Status 404 returned error can't find the container with id 771fce7efdc66a2684373898385c3f4bbe1948f4e6441409d2a0d19c25ce755c
Jul 15 12:11:15.751775 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.751751    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6754g"
Jul 15 12:11:15.755830 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.755810    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b2tgg"
Jul 15 12:11:15.756164 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:15.756142    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b134d9_1ced_4432_bc91_b31c12185191.slice/crio-0780a0548d01c8f69e7d0d6f2b26fa8f49ed86f4b5a72af030264f21b0906a2a WatchSource:0}: Error finding container 0780a0548d01c8f69e7d0d6f2b26fa8f49ed86f4b5a72af030264f21b0906a2a: Status 404 returned error can't find the container with id 0780a0548d01c8f69e7d0d6f2b26fa8f49ed86f4b5a72af030264f21b0906a2a
Jul 15 12:11:15.761276 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.761122    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:15.764142 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:15.764019    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9592893f_442b_47fa_862f_d9c2bfa30ead.slice/crio-f8edc36a42c03b3a43d6f550ad7548ca34b304fbd63d1c975e209c3ce998b138 WatchSource:0}: Error finding container f8edc36a42c03b3a43d6f550ad7548ca34b304fbd63d1c975e209c3ce998b138: Status 404 returned error can't find the container with id f8edc36a42c03b3a43d6f550ad7548ca34b304fbd63d1c975e209c3ce998b138
Jul 15 12:11:15.766950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.766813    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swsmv"
Jul 15 12:11:15.768446 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:15.768418    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751927ee_281b_4427_bce1_1b8c3bfb2349.slice/crio-f4e80912197974702e2f0a13dca5e5a976c47194d874762d4f033057ad4f1a25 WatchSource:0}: Error finding container f4e80912197974702e2f0a13dca5e5a976c47194d874762d4f033057ad4f1a25: Status 404 returned error can't find the container with id f4e80912197974702e2f0a13dca5e5a976c47194d874762d4f033057ad4f1a25
Jul 15 12:11:15.771889 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:15.771867    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f66112_4275_47b6_9e54_d1b2b0f0a575.slice/crio-e03a97916c307fdd1a1b769f1f4424b5348bc440ec8285e1c613bf0603bdb8bb WatchSource:0}: Error finding container e03a97916c307fdd1a1b769f1f4424b5348bc440ec8285e1c613bf0603bdb8bb: Status 404 returned error can't find the container with id e03a97916c307fdd1a1b769f1f4424b5348bc440ec8285e1c613bf0603bdb8bb
Jul 15 12:11:15.773007 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.772979    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qvlnl"
Jul 15 12:11:15.777848 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:15.777823    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6acb4c6_9cd8_4239_a879_1a12f83f1c9e.slice/crio-9a15d90d2562e66b0e0c256fed42b9f8fca86a6094b91400ccacd43525b4bce4 WatchSource:0}: Error finding container 9a15d90d2562e66b0e0c256fed42b9f8fca86a6094b91400ccacd43525b4bce4: Status 404 returned error can't find the container with id 9a15d90d2562e66b0e0c256fed42b9f8fca86a6094b91400ccacd43525b4bce4
Jul 15 12:11:15.779141 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.779120    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtgm7"
Jul 15 12:11:15.783266 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:15.783248    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67edde5e_b3b4_4c04_8f93_482970cd6e00.slice/crio-aff4d3597380288bc1803c7d79c50c124ae0733bec8ac0509ecc6511fba18354 WatchSource:0}: Error finding container aff4d3597380288bc1803c7d79c50c124ae0733bec8ac0509ecc6511fba18354: Status 404 returned error can't find the container with id aff4d3597380288bc1803c7d79c50c124ae0733bec8ac0509ecc6511fba18354
Jul 15 12:11:15.783921 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:15.783901    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wjqkf"
Jul 15 12:11:15.789869 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:15.789840    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf633254c_28aa_4625_ac26_df610d480c2d.slice/crio-0e79b21a16a5b408ff3675224721ccbedd10a7b0b7cd5fbca521741b576fe281 WatchSource:0}: Error finding container 0e79b21a16a5b408ff3675224721ccbedd10a7b0b7cd5fbca521741b576fe281: Status 404 returned error can't find the container with id 0e79b21a16a5b408ff3675224721ccbedd10a7b0b7cd5fbca521741b576fe281
Jul 15 12:11:15.795860 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:15.795835    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fd816f_1fa1_4220_8e5e_903050d92a3a.slice/crio-f6e15dba8d7f51eaa8530384c2f70689768739942396cd53a4f440974d82e3bd WatchSource:0}: Error finding container f6e15dba8d7f51eaa8530384c2f70689768739942396cd53a4f440974d82e3bd: Status 404 returned error can't find the container with id f6e15dba8d7f51eaa8530384c2f70689768739942396cd53a4f440974d82e3bd
Jul 15 12:11:16.047725 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.047622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:16.047895 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:16.047808    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:16.047895 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:16.047833    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:16.047895 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:16.047850    2571 projected.go:196] Error preparing data for projected volume kube-api-access-lhcq5 for pod openshift-network-diagnostics/network-check-target-5vkzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:16.048022 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:16.047921    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5 podName:7d114473-e4b2-4ce7-97df-eb319eabe1ea nodeName:}" failed. No retries permitted until 2026-07-15 12:11:17.047900666 +0000 UTC m=+3.995929311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhcq5" (UniqueName: "kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5") pod "network-check-target-5vkzg" (UID: "7d114473-e4b2-4ce7-97df-eb319eabe1ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:16.148693 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.148664    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:16.148943 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.148738    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:16.148943 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:16.148853    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:16.148943 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:16.148868    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:16.148943 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:16.148938    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs podName:8d48e773-ec60-489a-84f1-8f816afd365e nodeName:}" failed. No retries permitted until 2026-07-15 12:11:17.148918825 +0000 UTC m=+4.096947458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs") pod "network-metrics-daemon-54zrq" (UID: "8d48e773-ec60-489a-84f1-8f816afd365e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:16.149181 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:16.148959    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret podName:d3a41138-421d-46e7-af35-7e0f94d4cadd nodeName:}" failed. No retries permitted until 2026-07-15 12:11:17.148947048 +0000 UTC m=+4.096975679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret") pod "global-pull-secret-syncer-vhf9x" (UID: "d3a41138-421d-46e7-af35-7e0f94d4cadd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:16.475149 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.475024    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:06:15 +0000 UTC" deadline="2028-02-05 00:00:13.027388305 +0000 UTC"
Jul 15 12:11:16.475149 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.475091    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13667h48m56.552301585s"
Jul 15 12:11:16.621483 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.621439    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:16.621670 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:16.621591    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:16.630357 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.630299    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerStarted","Data":"e03a97916c307fdd1a1b769f1f4424b5348bc440ec8285e1c613bf0603bdb8bb"}
Jul 15 12:11:16.631609 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.631549    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv" event={"ID":"b7b134d9-1ced-4432-bc91-b31c12185191","Type":"ContainerStarted","Data":"0780a0548d01c8f69e7d0d6f2b26fa8f49ed86f4b5a72af030264f21b0906a2a"}
Jul 15 12:11:16.633444 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.633412    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zbj2w" event={"ID":"95a1c495-dbd0-4635-a0c7-1288e8404efa","Type":"ContainerStarted","Data":"771fce7efdc66a2684373898385c3f4bbe1948f4e6441409d2a0d19c25ce755c"}
Jul 15 12:11:16.634619 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.634592    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wjqkf" event={"ID":"89fd816f-1fa1-4220-8e5e-903050d92a3a","Type":"ContainerStarted","Data":"f6e15dba8d7f51eaa8530384c2f70689768739942396cd53a4f440974d82e3bd"}
Jul 15 12:11:16.635923 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.635894    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qvlnl" event={"ID":"67edde5e-b3b4-4c04-8f93-482970cd6e00","Type":"ContainerStarted","Data":"aff4d3597380288bc1803c7d79c50c124ae0733bec8ac0509ecc6511fba18354"}
Jul 15 12:11:16.637278 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.637247    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swsmv" event={"ID":"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e","Type":"ContainerStarted","Data":"9a15d90d2562e66b0e0c256fed42b9f8fca86a6094b91400ccacd43525b4bce4"}
Jul 15 12:11:16.638624 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.638594    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b2tgg" event={"ID":"751927ee-281b-4427-bce1-1b8c3bfb2349","Type":"ContainerStarted","Data":"f4e80912197974702e2f0a13dca5e5a976c47194d874762d4f033057ad4f1a25"}
Jul 15 12:11:16.639995 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.639964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6754g" event={"ID":"9592893f-442b-47fa-862f-d9c2bfa30ead","Type":"ContainerStarted","Data":"f8edc36a42c03b3a43d6f550ad7548ca34b304fbd63d1c975e209c3ce998b138"}
Jul 15 12:11:16.641754 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:16.641721    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtgm7" event={"ID":"f633254c-28aa-4625-ac26-df610d480c2d","Type":"ContainerStarted","Data":"0e79b21a16a5b408ff3675224721ccbedd10a7b0b7cd5fbca521741b576fe281"}
Jul 15 12:11:17.055501 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:17.055411    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:17.055675 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.055589    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:17.055675 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.055612    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:17.055675 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.055627    2571 projected.go:196] Error preparing data for projected volume kube-api-access-lhcq5 for pod openshift-network-diagnostics/network-check-target-5vkzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:17.055861 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.055688    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5 podName:7d114473-e4b2-4ce7-97df-eb319eabe1ea nodeName:}" failed. No retries permitted until 2026-07-15 12:11:19.055669403 +0000 UTC m=+6.003698053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhcq5" (UniqueName: "kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5") pod "network-check-target-5vkzg" (UID: "7d114473-e4b2-4ce7-97df-eb319eabe1ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:17.156641 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:17.155838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:17.156641 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:17.155913    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:17.156641 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.156047    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:17.156641 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.156112    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret podName:d3a41138-421d-46e7-af35-7e0f94d4cadd nodeName:}" failed. No retries permitted until 2026-07-15 12:11:19.156093186 +0000 UTC m=+6.104121820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret") pod "global-pull-secret-syncer-vhf9x" (UID: "d3a41138-421d-46e7-af35-7e0f94d4cadd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:17.156641 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.156543    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:17.156641 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.156598    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs podName:8d48e773-ec60-489a-84f1-8f816afd365e nodeName:}" failed. No retries permitted until 2026-07-15 12:11:19.156580346 +0000 UTC m=+6.104608980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs") pod "network-metrics-daemon-54zrq" (UID: "8d48e773-ec60-489a-84f1-8f816afd365e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:17.345306 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:17.345213    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:11:17.475607 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:17.475519    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:06:15 +0000 UTC" deadline="2028-04-13 17:25:54.015368124 +0000 UTC"
Jul 15 12:11:17.475607 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:17.475561    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15317h14m36.539811737s"
Jul 15 12:11:17.622642 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:17.622546    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:17.622839 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.622704    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:17.622839 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:17.622786    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:17.623128 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:17.622896    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:17.674053 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:17.673993    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal" event={"ID":"c7803b45d5dbe62303a41ccd8fb6f0b0","Type":"ContainerStarted","Data":"87dd2a607b2313d5fa3d32897056e60b9b163b70abb0e9112f63ae00d6c5805b"}
Jul 15 12:11:18.620859 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:18.620627    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:18.621355 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:18.620969    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:19.076775 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:19.076077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:19.076775 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.076278    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:19.076775 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.076312    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:19.076775 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.076325    2571 projected.go:196] Error preparing data for projected volume kube-api-access-lhcq5 for pod openshift-network-diagnostics/network-check-target-5vkzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:19.076775 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.076384    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5 podName:7d114473-e4b2-4ce7-97df-eb319eabe1ea nodeName:}" failed. No retries permitted until 2026-07-15 12:11:23.076365862 +0000 UTC m=+10.024394495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhcq5" (UniqueName: "kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5") pod "network-check-target-5vkzg" (UID: "7d114473-e4b2-4ce7-97df-eb319eabe1ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:19.177720 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:19.176897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:19.177720 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:19.176982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:19.177720 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.177133    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:19.177720 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.177199    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs podName:8d48e773-ec60-489a-84f1-8f816afd365e nodeName:}" failed. No retries permitted until 2026-07-15 12:11:23.177179094 +0000 UTC m=+10.125207741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs") pod "network-metrics-daemon-54zrq" (UID: "8d48e773-ec60-489a-84f1-8f816afd365e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:19.177720 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.177620    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:19.177720 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.177676    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret podName:d3a41138-421d-46e7-af35-7e0f94d4cadd nodeName:}" failed. No retries permitted until 2026-07-15 12:11:23.177660079 +0000 UTC m=+10.125688709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret") pod "global-pull-secret-syncer-vhf9x" (UID: "d3a41138-421d-46e7-af35-7e0f94d4cadd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:19.623444 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:19.622921    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:19.623444 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.623067    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:19.623444 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:19.623228    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:19.623444 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:19.623355    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:20.620895 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:20.620829    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:20.621089 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:20.621003    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:21.621694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:21.621603    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:21.622126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:21.621611    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:21.622126 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:21.621746    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:21.622126 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:21.621835    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:22.621109 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:22.621074    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:22.621280 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:22.621218    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:23.111103 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:23.110931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:23.111103 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.111086    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:23.111646 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.111118    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:23.111646 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.111131    2571 projected.go:196] Error preparing data for projected volume kube-api-access-lhcq5 for pod openshift-network-diagnostics/network-check-target-5vkzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:23.111646 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.111198    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5 podName:7d114473-e4b2-4ce7-97df-eb319eabe1ea nodeName:}" failed. No retries permitted until 2026-07-15 12:11:31.11117816 +0000 UTC m=+18.059206792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhcq5" (UniqueName: "kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5") pod "network-check-target-5vkzg" (UID: "7d114473-e4b2-4ce7-97df-eb319eabe1ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:23.211612 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:23.211574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:23.211804 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:23.211656    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:23.211804 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.211782    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:23.211904 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.211848    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs podName:8d48e773-ec60-489a-84f1-8f816afd365e nodeName:}" failed. No retries permitted until 2026-07-15 12:11:31.211828908 +0000 UTC m=+18.159857540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs") pod "network-metrics-daemon-54zrq" (UID: "8d48e773-ec60-489a-84f1-8f816afd365e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:23.211904 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.211780    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:23.212005 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.211932    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret podName:d3a41138-421d-46e7-af35-7e0f94d4cadd nodeName:}" failed. No retries permitted until 2026-07-15 12:11:31.211913807 +0000 UTC m=+18.159942437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret") pod "global-pull-secret-syncer-vhf9x" (UID: "d3a41138-421d-46e7-af35-7e0f94d4cadd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:23.621987 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:23.621947    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:23.622167 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.622084    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:23.622328 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:23.622306    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:23.622456 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:23.622435    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:24.621313 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:24.621260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:24.621778 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:24.621613    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:25.620998 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:25.620964    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:25.621188 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:25.621108    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:25.621188 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:25.621179    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:25.621324 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:25.621270    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:26.621256 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:26.621218    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:26.621634 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:26.621343    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:27.620685 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:27.620600    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:27.620832 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:27.620737    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:27.620832 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:27.620792    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:27.620948 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:27.620923    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:28.621455 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:28.621403    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:28.621859 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:28.621545    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:29.620729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:29.620690    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:29.620947 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:29.620819    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:29.620947 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:29.620889    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:29.621066 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:29.621022    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:30.621519 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:30.621482    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:30.622027 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:30.621605    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:31.173830 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:31.173782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:31.173997 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.173935    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:31.173997 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.173952    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:31.173997 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.173966    2571 projected.go:196] Error preparing data for projected volume kube-api-access-lhcq5 for pod openshift-network-diagnostics/network-check-target-5vkzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:31.174148 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.174024    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5 podName:7d114473-e4b2-4ce7-97df-eb319eabe1ea nodeName:}" failed. No retries permitted until 2026-07-15 12:11:47.174010923 +0000 UTC m=+34.122039552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhcq5" (UniqueName: "kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5") pod "network-check-target-5vkzg" (UID: "7d114473-e4b2-4ce7-97df-eb319eabe1ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:31.274222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:31.274176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:31.274408 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:31.274246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:31.274408 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.274344    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:31.274500 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.274411    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs podName:8d48e773-ec60-489a-84f1-8f816afd365e nodeName:}" failed. No retries permitted until 2026-07-15 12:11:47.274396439 +0000 UTC m=+34.222425071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs") pod "network-metrics-daemon-54zrq" (UID: "8d48e773-ec60-489a-84f1-8f816afd365e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:31.274500 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.274344    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:31.274500 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.274484    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret podName:d3a41138-421d-46e7-af35-7e0f94d4cadd nodeName:}" failed. No retries permitted until 2026-07-15 12:11:47.274472748 +0000 UTC m=+34.222501380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret") pod "global-pull-secret-syncer-vhf9x" (UID: "d3a41138-421d-46e7-af35-7e0f94d4cadd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:31.621180 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:31.621089    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:31.621180 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:31.621102    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:31.621431 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.621211    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:31.621431 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:31.621364    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:32.621405 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:32.621368    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:32.621855 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:32.621508    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:33.622004 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:33.621967    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:33.622495 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:33.622077    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:33.622495 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:33.622153    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:33.622495 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:33.622274    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:34.621368 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:34.621333    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:34.621558 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:34.621453    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:35.621143 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:35.621120    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:35.621445 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:35.621120    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:35.621445 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:35.621239    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:35.621445 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:35.621325    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:36.621204 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.620862    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:36.621833 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:36.621224    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:36.711145 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.711108    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zbj2w" event={"ID":"95a1c495-dbd0-4635-a0c7-1288e8404efa","Type":"ContainerStarted","Data":"74f18c394ed8dc21426b45d8f6b83e4a4c285c5bd9de95db02709599e7303fd2"}
Jul 15 12:11:36.712606 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.712584    2571 generic.go:356] "Generic (PLEG): container finished" podID="1d549db6d156048ee269a1cdc2293048" containerID="7f085e9ad75435573253ea735ceb6a4942a817759a00c6029dbe03dbd7a98d85" exitCode=0
Jul 15 12:11:36.712708 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.712654    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal" event={"ID":"1d549db6d156048ee269a1cdc2293048","Type":"ContainerDied","Data":"7f085e9ad75435573253ea735ceb6a4942a817759a00c6029dbe03dbd7a98d85"}
Jul 15 12:11:36.714115 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.714090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wjqkf" event={"ID":"89fd816f-1fa1-4220-8e5e-903050d92a3a","Type":"ContainerStarted","Data":"34870cec21991d88ca65c16fb893216760b2c8196ead652cd71aa31b04234743"}
Jul 15 12:11:36.715500 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.715479    2571 generic.go:356] "Generic (PLEG): container finished" podID="c6acb4c6-9cd8-4239-a879-1a12f83f1c9e" containerID="8903a2c145bae5d1b867b62ea33f13de1b42193a2046f841bb3a3a4f2a5ed8f9" exitCode=0
Jul 15 12:11:36.715609 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.715546    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swsmv" event={"ID":"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e","Type":"ContainerDied","Data":"8903a2c145bae5d1b867b62ea33f13de1b42193a2046f841bb3a3a4f2a5ed8f9"}
Jul 15 12:11:36.716950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.716930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b2tgg" event={"ID":"751927ee-281b-4427-bce1-1b8c3bfb2349","Type":"ContainerStarted","Data":"35af57603d83dfa45bd91d30d0f6c545620d9a92abc8927418e4a66ef417087b"}
Jul 15 12:11:36.718340 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.718318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6754g" event={"ID":"9592893f-442b-47fa-862f-d9c2bfa30ead","Type":"ContainerStarted","Data":"318676e8da515f377ba68b0ae788fed77a3d877630db6d40956dbace4353258b"}
Jul 15 12:11:36.719567 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.719551    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtgm7" event={"ID":"f633254c-28aa-4625-ac26-df610d480c2d","Type":"ContainerStarted","Data":"f47043b1877091344273d3c7058314d63333e0632b5f505697b8976271971cef"}
Jul 15 12:11:36.722192 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.722175    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:11:36.722527 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.722510    2571 generic.go:356] "Generic (PLEG): container finished" podID="99f66112-4275-47b6-9e54-d1b2b0f0a575" containerID="d88d8c4fe685a50a164f814037068f2767aa71f4aaa9e5395dc776bc386a9bea" exitCode=1
Jul 15 12:11:36.722604 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.722582    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerStarted","Data":"51d7ed81edb1a7fcdc75293fce4c13cb2ddec97c83f7fa2601429fa8448b692c"}
Jul 15 12:11:36.722669 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.722649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerStarted","Data":"9276bbf26e047ee4d34b0668bb724b54f48657584312ae1431d81d773273ab02"}
Jul 15 12:11:36.722710 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.722687    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerStarted","Data":"9222559aafc2ed92c8a60f2f87c56c09616b0d92f89b4f8a66cfdbb373719040"}
Jul 15 12:11:36.722747 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.722721    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerStarted","Data":"24afd6d783688aab02b3656eba48950c77fffb21eb58e3b8df3013500d036e99"}
Jul 15 12:11:36.722795 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.722762    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerDied","Data":"d88d8c4fe685a50a164f814037068f2767aa71f4aaa9e5395dc776bc386a9bea"}
Jul 15 12:11:36.722795 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.722793    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerStarted","Data":"b0fe064f37b6b774cd83bcaa11f8ecb2f71509da000f7e2c525c020cfd6e9415"}
Jul 15 12:11:36.723845 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.723824    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv" event={"ID":"b7b134d9-1ced-4432-bc91-b31c12185191","Type":"ContainerStarted","Data":"101224eb747206ef16e016690d2b6cff9d3c5b49143d003f0715a81196600cc1"}
Jul 15 12:11:36.727173 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.727132    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zbj2w" podStartSLOduration=3.979970583 podStartE2EDuration="23.727121682s" totalImagesPullingTime="19.747151099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:36.727011615 +0000 UTC m=+23.675040266" watchObservedRunningTime="2026-07-15 12:11:36.727121682 +0000 UTC m=+23.675150332"
Jul 15 12:11:36.727505 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.727479    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-29.ec2.internal" podStartSLOduration=21.727471918 podStartE2EDuration="21.727471918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:17.696620419 +0000 UTC m=+4.644649074" watchObservedRunningTime="2026-07-15 12:11:36.727471918 +0000 UTC m=+23.675500576"
Jul 15 12:11:36.764034 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.763990    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b2tgg" podStartSLOduration=3.03372453 podStartE2EDuration="22.763972336s" totalImagesPullingTime="19.730247806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:36.763887055 +0000 UTC m=+23.711915707" watchObservedRunningTime="2026-07-15 12:11:36.763972336 +0000 UTC m=+23.712000988"
Jul 15 12:11:36.764691 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.764661    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6754g" podStartSLOduration=3.999883962 podStartE2EDuration="23.76464924s" totalImagesPullingTime="19.764765278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:36.74686026 +0000 UTC m=+23.694888912" watchObservedRunningTime="2026-07-15 12:11:36.76464924 +0000 UTC m=+23.712677912"
Jul 15 12:11:36.801672 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.801630    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dtgm7" podStartSLOduration=3.094360012 podStartE2EDuration="22.801615585s" totalImagesPullingTime="19.707255573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:36.801179089 +0000 UTC m=+23.749207739" watchObservedRunningTime="2026-07-15 12:11:36.801615585 +0000 UTC m=+23.749644236"
Jul 15 12:11:36.815858 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:36.815813    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wjqkf" podStartSLOduration=7.28375826 podStartE2EDuration="22.815797348s" totalImagesPullingTime="15.532039088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:36.815727572 +0000 UTC m=+23.763756223" watchObservedRunningTime="2026-07-15 12:11:36.815797348 +0000 UTC m=+23.763825999"
Jul 15 12:11:37.621322 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:37.621275    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:37.621824 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:37.621342    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:37.621824 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:37.621445    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:37.621824 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:37.621575    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:37.727026 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:37.726993    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qvlnl" event={"ID":"67edde5e-b3b4-4c04-8f93-482970cd6e00","Type":"ContainerStarted","Data":"e2de6956fbed88f44e5b8c37c4c7c2b3753e5b3f49a90d29ea86b5dc792f128e"}
Jul 15 12:11:37.730823 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:37.730792    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal" event={"ID":"1d549db6d156048ee269a1cdc2293048","Type":"ContainerStarted","Data":"bbe587b304dcd7ccb3452bf66f997c3f3a7988c157a00ea6e0ccbbf75920e5d4"}
Jul 15 12:11:37.743841 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:37.743781    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qvlnl" podStartSLOduration=8.199965021 podStartE2EDuration="23.743757093s" totalImagesPullingTime="15.543792072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:37.742579809 +0000 UTC m=+24.690608461" watchObservedRunningTime="2026-07-15 12:11:37.743757093 +0000 UTC m=+24.691785745"
Jul 15 12:11:38.310556 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:38.310529    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 12:11:38.493844 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:38.493709    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T12:11:38.310552271Z","UUID":"ec81aad0-8cff-4a91-8075-41c2d5cad9a6","Handler":null,"Name":"","Endpoint":""}
Jul 15 12:11:38.495268 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:38.495243    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 12:11:38.495405 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:38.495307    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 12:11:38.620554 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:38.620495    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:38.620639 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:38.620618    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:38.737861 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:38.737836    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:11:38.738315 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:38.738262    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerStarted","Data":"e275feb93edafc4fa02dd2360a06711b34d6c289d8d3deaf99c7c1d40bb51c4c"}
Jul 15 12:11:38.740413 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:38.740374    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv" event={"ID":"b7b134d9-1ced-4432-bc91-b31c12185191","Type":"ContainerStarted","Data":"91ef2857484c6a0172683c2d0d3aba91456b9ea161c80be0464e64a9d9bb72c0"}
Jul 15 12:11:39.621243 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:39.621198    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:39.621555 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:39.621256    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:39.621555 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:39.621399    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:39.621817 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:39.621783    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:40.621305 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:40.621257    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:40.621699 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:40.621386    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:41.621322 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.621128    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:41.622038 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.621198    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:41.622038 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:41.621410    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:41.622038 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:41.621534    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:41.645443 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.645413    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:41.646147 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.646128    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:41.662528 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.662486    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-29.ec2.internal" podStartSLOduration=26.662473426 podStartE2EDuration="26.662473426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:37.757086005 +0000 UTC m=+24.705114657" watchObservedRunningTime="2026-07-15 12:11:41.662473426 +0000 UTC m=+28.610502076"
Jul 15 12:11:41.750071 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.750049    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:11:41.750488 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.750445    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerStarted","Data":"78b27ddff32ef018464f521179daa11b4fab79e70be519e9d7a78fcf663ee987"}
Jul 15 12:11:41.750796 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.750756    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:41.750926 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.750824    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:41.750926 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.750873    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:41.751024 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.750968    2571 scope.go:117] "RemoveContainer" containerID="d88d8c4fe685a50a164f814037068f2767aa71f4aaa9e5395dc776bc386a9bea"
Jul 15 12:11:41.752897 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.752867    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv" event={"ID":"b7b134d9-1ced-4432-bc91-b31c12185191","Type":"ContainerStarted","Data":"5c145c3876368d4f5d84cda1820f4e564451ebb96d69cbe407ca022709072667"}
Jul 15 12:11:41.753220 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.753199    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:41.753782 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.753737    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zbj2w"
Jul 15 12:11:41.768165 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.767936    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:41.768279 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.768267    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:11:41.794671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:41.794628    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xq6lv" podStartSLOduration=5.836195197 podStartE2EDuration="28.794612563s" totalImagesPullingTime="22.958417366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:41.794146495 +0000 UTC m=+28.742175146" watchObservedRunningTime="2026-07-15 12:11:41.794612563 +0000 UTC m=+28.742641213"
Jul 15 12:11:42.620810 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:42.620733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:42.620968 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:42.620828    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:42.758157 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:42.758124    2571 generic.go:356] "Generic (PLEG): container finished" podID="c6acb4c6-9cd8-4239-a879-1a12f83f1c9e" containerID="fcfcb55e0ba971b81c2a07e0d40b77527bf38c87d315d600e5b9dfd7356c00a5" exitCode=0
Jul 15 12:11:42.758996 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:42.758260    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swsmv" event={"ID":"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e","Type":"ContainerDied","Data":"fcfcb55e0ba971b81c2a07e0d40b77527bf38c87d315d600e5b9dfd7356c00a5"}
Jul 15 12:11:42.767780 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:42.767751    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:11:42.769555 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:42.769528    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" event={"ID":"99f66112-4275-47b6-9e54-d1b2b0f0a575","Type":"ContainerStarted","Data":"a0363fcfc31842e2bbf6b203f1713a3b9761ac9b8d0741bf740b4a8374ea25e7"}
Jul 15 12:11:42.805991 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:42.805943    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc" podStartSLOduration=8.807179131 podStartE2EDuration="28.805927444s" totalImagesPullingTime="19.998748313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:42.805578201 +0000 UTC m=+29.753606853" watchObservedRunningTime="2026-07-15 12:11:42.805927444 +0000 UTC m=+29.753956095"
Jul 15 12:11:43.412379 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:43.412342    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vhf9x"]
Jul 15 12:11:43.412592 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:43.412448    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:43.412592 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:43.412533    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:43.415769 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:43.415515    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5vkzg"]
Jul 15 12:11:43.415769 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:43.415632    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:43.415769 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:43.415725    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:43.416529 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:43.416507    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-54zrq"]
Jul 15 12:11:43.416632 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:43.416619    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:43.416748 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:43.416726    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:44.621136 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:44.621099    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:44.621136 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:44.621132    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:44.621623 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:44.621099    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:44.621623 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:44.621223    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:44.621623 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:44.621307    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:44.621623 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:44.621362    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:45.777248 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:45.777169    2571 generic.go:356] "Generic (PLEG): container finished" podID="c6acb4c6-9cd8-4239-a879-1a12f83f1c9e" containerID="651c561b9ca2e71d73ce549c6ebe4c3ae7abc3be99f88461830ab16ee7ae993d" exitCode=0
Jul 15 12:11:45.777248 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:45.777231    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swsmv" event={"ID":"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e","Type":"ContainerDied","Data":"651c561b9ca2e71d73ce549c6ebe4c3ae7abc3be99f88461830ab16ee7ae993d"}
Jul 15 12:11:46.620707 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:46.620507    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:46.620867 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:46.620534    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:46.620867 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:46.620798    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:46.620867 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:46.620564    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:46.621018 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:46.620888    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:46.621018 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:46.620954    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:47.190439 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:47.190408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:47.190768 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:47.190568    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:11:47.190768 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:47.190586    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:11:47.190768 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:47.190596    2571 projected.go:196] Error preparing data for projected volume kube-api-access-lhcq5 for pod openshift-network-diagnostics/network-check-target-5vkzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:47.190768 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:47.190656    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5 podName:7d114473-e4b2-4ce7-97df-eb319eabe1ea nodeName:}" failed. No retries permitted until 2026-07-15 12:12:19.190643618 +0000 UTC m=+66.138672251 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhcq5" (UniqueName: "kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5") pod "network-check-target-5vkzg" (UID: "7d114473-e4b2-4ce7-97df-eb319eabe1ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:11:47.291478 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:47.291398    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:47.291478 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:47.291446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:47.291632 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:47.291534    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:47.291632 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:47.291534    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:47.291632 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:47.291582    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs podName:8d48e773-ec60-489a-84f1-8f816afd365e nodeName:}" failed. No retries permitted until 2026-07-15 12:12:19.291569745 +0000 UTC m=+66.239598375 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs") pod "network-metrics-daemon-54zrq" (UID: "8d48e773-ec60-489a-84f1-8f816afd365e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:11:47.291632 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:47.291595    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret podName:d3a41138-421d-46e7-af35-7e0f94d4cadd nodeName:}" failed. No retries permitted until 2026-07-15 12:12:19.29158891 +0000 UTC m=+66.239617540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret") pod "global-pull-secret-syncer-vhf9x" (UID: "d3a41138-421d-46e7-af35-7e0f94d4cadd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:11:47.782980 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:47.782884    2571 generic.go:356] "Generic (PLEG): container finished" podID="c6acb4c6-9cd8-4239-a879-1a12f83f1c9e" containerID="67ba7a8ebc1923d1e37b59083a69546aaeec4f6603c160ab88d14d1c2c761ef1" exitCode=0
Jul 15 12:11:47.782980 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:47.782948    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swsmv" event={"ID":"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e","Type":"ContainerDied","Data":"67ba7a8ebc1923d1e37b59083a69546aaeec4f6603c160ab88d14d1c2c761ef1"}
Jul 15 12:11:48.621120 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:48.621082    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:48.621120 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:48.621113    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:48.621619 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:48.621204    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:48.621619 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:48.621203    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhf9x" podUID="d3a41138-421d-46e7-af35-7e0f94d4cadd"
Jul 15 12:11:48.621619 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:48.621363    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:11:48.621619 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:48.621468    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vkzg" podUID="7d114473-e4b2-4ce7-97df-eb319eabe1ea"
Jul 15 12:11:49.303547 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.303514    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-29.ec2.internal" event="NodeReady"
Jul 15 12:11:49.303709 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.303667    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 12:11:49.337553 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.337466    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77b445fd56-x9mhl"]
Jul 15 12:11:49.339364 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.339343    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.342331 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.342304    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 12:11:49.342496 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.342310    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6jhfg\""
Jul 15 12:11:49.342496 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.342364    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 12:11:49.342496 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.342453    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 12:11:49.349094 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.349067    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 12:11:49.351235 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.351211    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-drjhz"]
Jul 15 12:11:49.354363 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.354344    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rcnn5"]
Jul 15 12:11:49.354478 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.354462    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.356105 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.356088    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rcnn5"
Jul 15 12:11:49.356520 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.356499    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b445fd56-x9mhl"]
Jul 15 12:11:49.357223 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.357116    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 12:11:49.357223 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.357216    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gfjwd\""
Jul 15 12:11:49.357466 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.357388    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 12:11:49.358710 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.358689    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 12:11:49.360335 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.359013    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 12:11:49.360335 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.359200    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xk7gb\""
Jul 15 12:11:49.360335 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.359601    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 12:11:49.360873 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.360807    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-drjhz"]
Jul 15 12:11:49.362746 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.362719    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rcnn5"]
Jul 15 12:11:49.507249 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507205    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ce3db41-5447-47d0-8e0f-d7099217a05d-config-volume\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.507441 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507259    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ceb06a4-a48b-4966-87d3-546dba28c399-ca-trust-extracted\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.507441 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507299    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-certificates\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.507441 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce3db41-5447-47d0-8e0f-d7099217a05d-tmp-dir\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.507441 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-trusted-ca\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.507441 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507384    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.507689 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5tjd\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-kube-api-access-x5tjd\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.507689 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507507    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96860b42-9d6f-4fd9-bd9d-b4bbc700b972-cert\") pod \"ingress-canary-rcnn5\" (UID: \"96860b42-9d6f-4fd9-bd9d-b4bbc700b972\") " pod="openshift-ingress-canary/ingress-canary-rcnn5"
Jul 15 12:11:49.507689 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s54qd\" (UniqueName: \"kubernetes.io/projected/5ce3db41-5447-47d0-8e0f-d7099217a05d-kube-api-access-s54qd\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.507689 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.507689 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507652    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-bound-sa-token\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.507877 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-image-registry-private-configuration\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.507877 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507747    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n76cl\" (UniqueName: \"kubernetes.io/projected/96860b42-9d6f-4fd9-bd9d-b4bbc700b972-kube-api-access-n76cl\") pod \"ingress-canary-rcnn5\" (UID: \"96860b42-9d6f-4fd9-bd9d-b4bbc700b972\") " pod="openshift-ingress-canary/ingress-canary-rcnn5"
Jul 15 12:11:49.507877 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.507832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-installation-pull-secrets\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.608598 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.608598 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-bound-sa-token\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.608598 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-image-registry-private-configuration\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n76cl\" (UniqueName: \"kubernetes.io/projected/96860b42-9d6f-4fd9-bd9d-b4bbc700b972-kube-api-access-n76cl\") pod \"ingress-canary-rcnn5\" (UID: \"96860b42-9d6f-4fd9-bd9d-b4bbc700b972\") " pod="openshift-ingress-canary/ingress-canary-rcnn5"
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608636    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-installation-pull-secrets\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608664    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ce3db41-5447-47d0-8e0f-d7099217a05d-config-volume\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608691    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ceb06a4-a48b-4966-87d3-546dba28c399-ca-trust-extracted\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608713    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-certificates\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:49.608719    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce3db41-5447-47d0-8e0f-d7099217a05d-tmp-dir\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:49.608743    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b445fd56-x9mhl: secret "image-registry-tls" not found
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-trusted-ca\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.608863 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:49.608818    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls podName:7ceb06a4-a48b-4966-87d3-546dba28c399 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:50.108793017 +0000 UTC m=+37.056821673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls") pod "image-registry-77b445fd56-x9mhl" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399") : secret "image-registry-tls" not found
Jul 15 12:11:49.609421 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:49.608872    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:49.609421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608890    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5tjd\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-kube-api-access-x5tjd\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.609421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96860b42-9d6f-4fd9-bd9d-b4bbc700b972-cert\") pod \"ingress-canary-rcnn5\" (UID: \"96860b42-9d6f-4fd9-bd9d-b4bbc700b972\") " pod="openshift-ingress-canary/ingress-canary-rcnn5"
Jul 15 12:11:49.609421 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:49.608934    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls podName:5ce3db41-5447-47d0-8e0f-d7099217a05d nodeName:}" failed. No retries permitted until 2026-07-15 12:11:50.108914931 +0000 UTC m=+37.056943560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls") pod "dns-default-drjhz" (UID: "5ce3db41-5447-47d0-8e0f-d7099217a05d") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:49.609421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.608986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s54qd\" (UniqueName: \"kubernetes.io/projected/5ce3db41-5447-47d0-8e0f-d7099217a05d-kube-api-access-s54qd\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.609421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.609145    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ceb06a4-a48b-4966-87d3-546dba28c399-ca-trust-extracted\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.609421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.609378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-certificates\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.609421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.609411    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce3db41-5447-47d0-8e0f-d7099217a05d-tmp-dir\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.609773 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.609435    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ce3db41-5447-47d0-8e0f-d7099217a05d-config-volume\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.610016 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.609993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-trusted-ca\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.613139 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.613116    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-installation-pull-secrets\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.613260 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.613187    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-image-registry-private-configuration\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.613335 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.613268    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96860b42-9d6f-4fd9-bd9d-b4bbc700b972-cert\") pod \"ingress-canary-rcnn5\" (UID: \"96860b42-9d6f-4fd9-bd9d-b4bbc700b972\") " pod="openshift-ingress-canary/ingress-canary-rcnn5"
Jul 15 12:11:49.617634 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.617603    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-bound-sa-token\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.617743 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.617717    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n76cl\" (UniqueName: \"kubernetes.io/projected/96860b42-9d6f-4fd9-bd9d-b4bbc700b972-kube-api-access-n76cl\") pod \"ingress-canary-rcnn5\" (UID: \"96860b42-9d6f-4fd9-bd9d-b4bbc700b972\") " pod="openshift-ingress-canary/ingress-canary-rcnn5"
Jul 15 12:11:49.618207 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.618188    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s54qd\" (UniqueName: \"kubernetes.io/projected/5ce3db41-5447-47d0-8e0f-d7099217a05d-kube-api-access-s54qd\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:49.618733 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.618714    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5tjd\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-kube-api-access-x5tjd\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:49.677378 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.677343    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rcnn5"
Jul 15 12:11:49.830342 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:49.830272    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rcnn5"]
Jul 15 12:11:49.835061 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:11:49.835023    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96860b42_9d6f_4fd9_bd9d_b4bbc700b972.slice/crio-8c870212c2c6ff6b47136616255db938c972762b2550c1a93ef16250394e6638 WatchSource:0}: Error finding container 8c870212c2c6ff6b47136616255db938c972762b2550c1a93ef16250394e6638: Status 404 returned error can't find the container with id 8c870212c2c6ff6b47136616255db938c972762b2550c1a93ef16250394e6638
Jul 15 12:11:50.113025 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.112982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:50.113212 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.113035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:50.113212 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:50.113152    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:50.113212 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:50.113170    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b445fd56-x9mhl: secret "image-registry-tls" not found
Jul 15 12:11:50.113212 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:50.113185    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:50.113447 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:50.113231    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls podName:7ceb06a4-a48b-4966-87d3-546dba28c399 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:51.11321135 +0000 UTC m=+38.061239983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls") pod "image-registry-77b445fd56-x9mhl" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399") : secret "image-registry-tls" not found
Jul 15 12:11:50.113447 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:50.113250    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls podName:5ce3db41-5447-47d0-8e0f-d7099217a05d nodeName:}" failed. No retries permitted until 2026-07-15 12:11:51.113241641 +0000 UTC m=+38.061270270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls") pod "dns-default-drjhz" (UID: "5ce3db41-5447-47d0-8e0f-d7099217a05d") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:50.620878 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.620846    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:11:50.621071 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.620894    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:11:50.621071 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.620973    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:11:50.623940 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.623911    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 12:11:50.623940 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.623936    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5qgtr\""
Jul 15 12:11:50.625344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.625257    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 12:11:50.625344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.625260    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 12:11:50.625344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.625339    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 12:11:50.625567 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.625499    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcn8s\""
Jul 15 12:11:50.794510 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:50.794469    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rcnn5" event={"ID":"96860b42-9d6f-4fd9-bd9d-b4bbc700b972","Type":"ContainerStarted","Data":"8c870212c2c6ff6b47136616255db938c972762b2550c1a93ef16250394e6638"}
Jul 15 12:11:51.122252 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:51.122222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:51.122431 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:51.122270    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:51.122431 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:51.122395    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:51.122431 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:51.122412    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b445fd56-x9mhl: secret "image-registry-tls" not found
Jul 15 12:11:51.122431 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:51.122420    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:51.122584 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:51.122473    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls podName:7ceb06a4-a48b-4966-87d3-546dba28c399 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:53.122457752 +0000 UTC m=+40.070486393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls") pod "image-registry-77b445fd56-x9mhl" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399") : secret "image-registry-tls" not found
Jul 15 12:11:51.122584 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:51.122492    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls podName:5ce3db41-5447-47d0-8e0f-d7099217a05d nodeName:}" failed. No retries permitted until 2026-07-15 12:11:53.122483042 +0000 UTC m=+40.070511682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls") pod "dns-default-drjhz" (UID: "5ce3db41-5447-47d0-8e0f-d7099217a05d") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:53.138276 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:53.138237    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:53.138676 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:53.138317    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:53.138676 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:53.138395    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:53.138676 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:53.138415    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b445fd56-x9mhl: secret "image-registry-tls" not found
Jul 15 12:11:53.138676 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:53.138444    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:53.138676 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:53.138471    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls podName:7ceb06a4-a48b-4966-87d3-546dba28c399 nodeName:}" failed. No retries permitted until 2026-07-15 12:11:57.138455518 +0000 UTC m=+44.086484147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls") pod "image-registry-77b445fd56-x9mhl" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399") : secret "image-registry-tls" not found
Jul 15 12:11:53.138676 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:53.138484    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls podName:5ce3db41-5447-47d0-8e0f-d7099217a05d nodeName:}" failed. No retries permitted until 2026-07-15 12:11:57.138478576 +0000 UTC m=+44.086507205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls") pod "dns-default-drjhz" (UID: "5ce3db41-5447-47d0-8e0f-d7099217a05d") : secret "dns-default-metrics-tls" not found
Jul 15 12:11:53.803216 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:53.803181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rcnn5" event={"ID":"96860b42-9d6f-4fd9-bd9d-b4bbc700b972","Type":"ContainerStarted","Data":"def1cc5d650cd26633170c7b29a489b9baba254b93e93c2b6497281fbcfed3c4"}
Jul 15 12:11:53.805763 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:53.805737    2571 generic.go:356] "Generic (PLEG): container finished" podID="c6acb4c6-9cd8-4239-a879-1a12f83f1c9e" containerID="aea43916ebe6462dfcc42a6f5ace2923632ce62ae979eeefb42d7fbe7fc3e6dc" exitCode=0
Jul 15 12:11:53.805860 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:53.805771    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swsmv" event={"ID":"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e","Type":"ContainerDied","Data":"aea43916ebe6462dfcc42a6f5ace2923632ce62ae979eeefb42d7fbe7fc3e6dc"}
Jul 15 12:11:53.818795 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:53.818745    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rcnn5" podStartSLOduration=1.358557489 podStartE2EDuration="4.818725531s" totalImagesPullingTime="3.460168042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:53.818256735 +0000 UTC m=+40.766285386" watchObservedRunningTime="2026-07-15 12:11:53.818725531 +0000 UTC m=+40.766754183"
Jul 15 12:11:54.811515 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:54.811484    2571 generic.go:356] "Generic (PLEG): container finished" podID="c6acb4c6-9cd8-4239-a879-1a12f83f1c9e" containerID="7dd2cfb9bb573b6ae7f618248cadac443cea81627088006990ce84dfd37ae341" exitCode=0
Jul 15 12:11:54.811905 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:54.811567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swsmv" event={"ID":"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e","Type":"ContainerDied","Data":"7dd2cfb9bb573b6ae7f618248cadac443cea81627088006990ce84dfd37ae341"}
Jul 15 12:11:55.817196 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:55.817160    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swsmv" event={"ID":"c6acb4c6-9cd8-4239-a879-1a12f83f1c9e","Type":"ContainerStarted","Data":"c81ff44f4a1dfbcee6a86b3a261196eeca4581fa9b1356d6dcfa430a9c709f94"}
Jul 15 12:11:55.840259 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:55.840211    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-swsmv" podStartSLOduration=8.557011604 podStartE2EDuration="41.840196828s" totalImagesPullingTime="33.283185224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:11:55.838628667 +0000 UTC m=+42.786657317" watchObservedRunningTime="2026-07-15 12:11:55.840196828 +0000 UTC m=+42.788225479"
Jul 15 12:11:57.166475 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:57.166433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:11:57.166475 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:11:57.166480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:11:57.166885 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:57.166593    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:11:57.166885 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:57.166599    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:11:57.166885 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:57.166609    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b445fd56-x9mhl: secret "image-registry-tls" not found
Jul 15 12:11:57.166885 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:57.166662    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls podName:7ceb06a4-a48b-4966-87d3-546dba28c399 nodeName:}" failed. No retries permitted until 2026-07-15 12:12:05.166646764 +0000 UTC m=+52.114675409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls") pod "image-registry-77b445fd56-x9mhl" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399") : secret "image-registry-tls" not found
Jul 15 12:11:57.166885 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:11:57.166678    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls podName:5ce3db41-5447-47d0-8e0f-d7099217a05d nodeName:}" failed. No retries permitted until 2026-07-15 12:12:05.166672205 +0000 UTC m=+52.114700848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls") pod "dns-default-drjhz" (UID: "5ce3db41-5447-47d0-8e0f-d7099217a05d") : secret "dns-default-metrics-tls" not found
Jul 15 12:12:05.223633 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:05.223596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:12:05.224178 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:05.223645    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:12:05.224178 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:05.223746    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:12:05.224178 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:05.223766    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:12:05.224178 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:05.223792    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b445fd56-x9mhl: secret "image-registry-tls" not found
Jul 15 12:12:05.224178 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:05.223795    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls podName:5ce3db41-5447-47d0-8e0f-d7099217a05d nodeName:}" failed. No retries permitted until 2026-07-15 12:12:21.223783228 +0000 UTC m=+68.171811857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls") pod "dns-default-drjhz" (UID: "5ce3db41-5447-47d0-8e0f-d7099217a05d") : secret "dns-default-metrics-tls" not found
Jul 15 12:12:05.224178 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:05.223861    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls podName:7ceb06a4-a48b-4966-87d3-546dba28c399 nodeName:}" failed. No retries permitted until 2026-07-15 12:12:21.22384216 +0000 UTC m=+68.171870789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls") pod "image-registry-77b445fd56-x9mhl" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399") : secret "image-registry-tls" not found
Jul 15 12:12:13.781551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:13.781519    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lpdrc"
Jul 15 12:12:19.220412 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.220356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:12:19.223408 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.223391    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 12:12:19.233101 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.233084    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 12:12:19.244874 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.244850    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhcq5\" (UniqueName: \"kubernetes.io/projected/7d114473-e4b2-4ce7-97df-eb319eabe1ea-kube-api-access-lhcq5\") pod \"network-check-target-5vkzg\" (UID: \"7d114473-e4b2-4ce7-97df-eb319eabe1ea\") " pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:12:19.321547 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.321492    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:12:19.321740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.321598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:12:19.325008 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.324986    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 12:12:19.325077 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.325009    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 12:12:19.331784 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:19.331763    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 12:12:19.331863 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:19.331851    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs podName:8d48e773-ec60-489a-84f1-8f816afd365e nodeName:}" failed. No retries permitted until 2026-07-15 12:13:23.331828343 +0000 UTC m=+130.279856988 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs") pod "network-metrics-daemon-54zrq" (UID: "8d48e773-ec60-489a-84f1-8f816afd365e") : secret "metrics-daemon-secret" not found
Jul 15 12:12:19.333809 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.333788    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a41138-421d-46e7-af35-7e0f94d4cadd-original-pull-secret\") pod \"global-pull-secret-syncer-vhf9x\" (UID: \"d3a41138-421d-46e7-af35-7e0f94d4cadd\") " pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:12:19.434916 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.434866    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhf9x"
Jul 15 12:12:19.451703 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.451679    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcn8s\""
Jul 15 12:12:19.458941 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.458916    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:12:19.586504 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.586473    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vhf9x"]
Jul 15 12:12:19.589515 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:12:19.589480    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a41138_421d_46e7_af35_7e0f94d4cadd.slice/crio-d15b30eb169526bdb7f10c607a1ac62c3aa809cd19724978cdd544b098ec27a0 WatchSource:0}: Error finding container d15b30eb169526bdb7f10c607a1ac62c3aa809cd19724978cdd544b098ec27a0: Status 404 returned error can't find the container with id d15b30eb169526bdb7f10c607a1ac62c3aa809cd19724978cdd544b098ec27a0
Jul 15 12:12:19.605744 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.605720    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5vkzg"]
Jul 15 12:12:19.608449 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:12:19.608418    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d114473_e4b2_4ce7_97df_eb319eabe1ea.slice/crio-5671e0a807859b5374face64e0d3b7b6c1b3a6a45c818b50ce4bd28368aff407 WatchSource:0}: Error finding container 5671e0a807859b5374face64e0d3b7b6c1b3a6a45c818b50ce4bd28368aff407: Status 404 returned error can't find the container with id 5671e0a807859b5374face64e0d3b7b6c1b3a6a45c818b50ce4bd28368aff407
Jul 15 12:12:19.872360 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.872326    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5vkzg" event={"ID":"7d114473-e4b2-4ce7-97df-eb319eabe1ea","Type":"ContainerStarted","Data":"5671e0a807859b5374face64e0d3b7b6c1b3a6a45c818b50ce4bd28368aff407"}
Jul 15 12:12:19.873390 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:19.873368    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vhf9x" event={"ID":"d3a41138-421d-46e7-af35-7e0f94d4cadd","Type":"ContainerStarted","Data":"d15b30eb169526bdb7f10c607a1ac62c3aa809cd19724978cdd544b098ec27a0"}
Jul 15 12:12:21.237706 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:21.236039    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:12:21.237706 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:21.236106    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:12:21.237706 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:21.236267    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:12:21.237706 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:21.236346    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls podName:5ce3db41-5447-47d0-8e0f-d7099217a05d nodeName:}" failed. No retries permitted until 2026-07-15 12:12:53.236326274 +0000 UTC m=+100.184354919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls") pod "dns-default-drjhz" (UID: "5ce3db41-5447-47d0-8e0f-d7099217a05d") : secret "dns-default-metrics-tls" not found
Jul 15 12:12:21.237706 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:21.236757    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:12:21.237706 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:21.236773    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b445fd56-x9mhl: secret "image-registry-tls" not found
Jul 15 12:12:21.237706 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:21.236817    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls podName:7ceb06a4-a48b-4966-87d3-546dba28c399 nodeName:}" failed. No retries permitted until 2026-07-15 12:12:53.236799566 +0000 UTC m=+100.184828214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls") pod "image-registry-77b445fd56-x9mhl" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399") : secret "image-registry-tls" not found
Jul 15 12:12:24.888002 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:24.887913    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vhf9x" event={"ID":"d3a41138-421d-46e7-af35-7e0f94d4cadd","Type":"ContainerStarted","Data":"ec03b4b24c9dd463fed6c6fb728b7a69ddf2147097aff2f1510e21b887ad3736"}
Jul 15 12:12:24.889335 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:24.889310    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5vkzg" event={"ID":"7d114473-e4b2-4ce7-97df-eb319eabe1ea","Type":"ContainerStarted","Data":"519a6dba7870a60daa80fc6dbea39c1ef1a62833274f903ee5d17121dfc2188d"}
Jul 15 12:12:24.889425 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:24.889374    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:12:24.903502 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:24.903449    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vhf9x" podStartSLOduration=65.866035493 podStartE2EDuration="1m10.903433572s" totalImagesPullingTime="5.037398079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:12:24.902816786 +0000 UTC m=+71.850845436" watchObservedRunningTime="2026-07-15 12:12:24.903433572 +0000 UTC m=+71.851462223"
Jul 15 12:12:24.917147 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:24.917098    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5vkzg" podStartSLOduration=66.90949271 podStartE2EDuration="1m11.917077999s" totalImagesPullingTime="5.007585289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:12:24.916746369 +0000 UTC m=+71.864775039" watchObservedRunningTime="2026-07-15 12:12:24.917077999 +0000 UTC m=+71.865106658"
Jul 15 12:12:53.262039 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:53.261949    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:12:53.262039 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:53.261997    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:12:53.262484 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:53.262101    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:12:53.262484 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:53.262123    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:12:53.262484 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:53.262148    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b445fd56-x9mhl: secret "image-registry-tls" not found
Jul 15 12:12:53.262484 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:53.262162    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls podName:5ce3db41-5447-47d0-8e0f-d7099217a05d nodeName:}" failed. No retries permitted until 2026-07-15 12:13:57.26214886 +0000 UTC m=+164.210177489 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls") pod "dns-default-drjhz" (UID: "5ce3db41-5447-47d0-8e0f-d7099217a05d") : secret "dns-default-metrics-tls" not found
Jul 15 12:12:53.262484 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:12:53.262206    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls podName:7ceb06a4-a48b-4966-87d3-546dba28c399 nodeName:}" failed. No retries permitted until 2026-07-15 12:13:57.262190857 +0000 UTC m=+164.210219486 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls") pod "image-registry-77b445fd56-x9mhl" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399") : secret "image-registry-tls" not found
Jul 15 12:12:55.894435 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:12:55.894402    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5vkzg"
Jul 15 12:13:23.373439 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:13:23.373381    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:13:23.373931 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:23.373529    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 12:13:23.373931 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:23.373599    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs podName:8d48e773-ec60-489a-84f1-8f816afd365e nodeName:}" failed. No retries permitted until 2026-07-15 12:15:25.373584097 +0000 UTC m=+252.321612725 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs") pod "network-metrics-daemon-54zrq" (UID: "8d48e773-ec60-489a-84f1-8f816afd365e") : secret "metrics-daemon-secret" not found
Jul 15 12:13:52.354596 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:52.354537    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77b445fd56-x9mhl" podUID="7ceb06a4-a48b-4966-87d3-546dba28c399"
Jul 15 12:13:52.370692 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:52.370665    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-drjhz" podUID="5ce3db41-5447-47d0-8e0f-d7099217a05d"
Jul 15 12:13:53.098723 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:13:53.098694    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drjhz"
Jul 15 12:13:53.098865 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:13:53.098730    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:13:53.643262 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:53.643227    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-54zrq" podUID="8d48e773-ec60-489a-84f1-8f816afd365e"
Jul 15 12:13:57.316172 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:13:57.316125    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:13:57.316573 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:13:57.316200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") pod \"image-registry-77b445fd56-x9mhl\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") " pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:13:57.316573 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:57.316275    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 12:13:57.316573 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:57.316307    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 12:13:57.316573 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:57.316318    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b445fd56-x9mhl: secret "image-registry-tls" not found
Jul 15 12:13:57.316573 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:57.316356    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls podName:5ce3db41-5447-47d0-8e0f-d7099217a05d nodeName:}" failed. No retries permitted until 2026-07-15 12:15:59.316338236 +0000 UTC m=+286.264366865 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls") pod "dns-default-drjhz" (UID: "5ce3db41-5447-47d0-8e0f-d7099217a05d") : secret "dns-default-metrics-tls" not found
Jul 15 12:13:57.316573 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:13:57.316371    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls podName:7ceb06a4-a48b-4966-87d3-546dba28c399 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:59.316365509 +0000 UTC m=+286.264394138 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls") pod "image-registry-77b445fd56-x9mhl" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399") : secret "image-registry-tls" not found
Jul 15 12:14:05.621690 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:05.621593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:14:58.066490 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.066448    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh"]
Jul 15 12:14:58.068592 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.068572    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh"
Jul 15 12:14:58.073742 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.073716    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 12:14:58.073858 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.073765    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:14:58.073858 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.073716    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x566n\""
Jul 15 12:14:58.076553 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.076534    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"]
Jul 15 12:14:58.078770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.078752    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"]
Jul 15 12:14:58.078878 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.078863    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:14:58.080533 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.080516    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6dcc798bb6-d4rll"]
Jul 15 12:14:58.080641 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.080625    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.082163 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.082146    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.082383 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.082358    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 12:14:58.082465 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.082434    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6wh8m\""
Jul 15 12:14:58.082884 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.082864    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:14:58.082977 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.082901    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 12:14:58.083361 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.083331    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 12:14:58.083484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.083334    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wvcxv\""
Jul 15 12:14:58.084032 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.084015    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh"]
Jul 15 12:14:58.085415 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.085274    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 12:14:58.086075 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.086057    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 12:14:58.086168 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.086136    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 12:14:58.087269 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.087248    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 12:14:58.087380 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.087351    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 12:14:58.087651 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.087630    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 12:14:58.087651 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.087644    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 12:14:58.087782 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.087751    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dbtlv\""
Jul 15 12:14:58.088271 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.088251    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 12:14:58.088511 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.088496    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 12:14:58.095221 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.095201    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"]
Jul 15 12:14:58.098725 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.098706    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"]
Jul 15 12:14:58.101604 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.101586    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dcc798bb6-d4rll"]
Jul 15 12:14:58.142474 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-default-certificate\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.142659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.142659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142499    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.142659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gxgs\" (UniqueName: \"kubernetes.io/projected/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-kube-api-access-9gxgs\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.142659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142539    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd2gh\" (UniqueName: \"kubernetes.io/projected/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-kube-api-access-dd2gh\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:14:58.142659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142614    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.142659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142653    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47wn4\" (UniqueName: \"kubernetes.io/projected/e46cdc29-7b58-49af-bb22-ef055801f13b-kube-api-access-47wn4\") pod \"volume-data-source-validator-78495597f6-p77zh\" (UID: \"e46cdc29-7b58-49af-bb22-ef055801f13b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh"
Jul 15 12:14:58.142968 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.142968 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-stats-auth\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.142968 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n55fk\" (UniqueName: \"kubernetes.io/projected/5cb27ae7-f500-4917-92ac-b461e19ac839-kube-api-access-n55fk\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.142968 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.142796    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:14:58.243837 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.243807    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-stats-auth\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.243837 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.243838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n55fk\" (UniqueName: \"kubernetes.io/projected/5cb27ae7-f500-4917-92ac-b461e19ac839-kube-api-access-n55fk\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.244095 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.243858    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:14:58.244095 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.244065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-default-certificate\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.244200 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.244103    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.244200 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.244119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.244279 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.244146    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gxgs\" (UniqueName: \"kubernetes.io/projected/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-kube-api-access-9gxgs\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.244279 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.244165    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 12:14:58.244279 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.244254    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:14:58.744232324 +0000 UTC m=+225.692260975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : configmap references non-existent config key: service-ca.crt
Jul 15 12:14:58.244449 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.244306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd2gh\" (UniqueName: \"kubernetes.io/projected/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-kube-api-access-dd2gh\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:14:58.244449 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.244324    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls podName:9dee292b-69b5-4fb7-95a5-e9bd9897ab60 nodeName:}" failed. No retries permitted until 2026-07-15 12:14:58.744308404 +0000 UTC m=+225.692337052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls") pod "cluster-samples-operator-65db858894-n8v78" (UID: "9dee292b-69b5-4fb7-95a5-e9bd9897ab60") : secret "samples-operator-tls" not found
Jul 15 12:14:58.244449 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.244363    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.244449 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.244218    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 12:14:58.244449 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.244398    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47wn4\" (UniqueName: \"kubernetes.io/projected/e46cdc29-7b58-49af-bb22-ef055801f13b-kube-api-access-47wn4\") pod \"volume-data-source-validator-78495597f6-p77zh\" (UID: \"e46cdc29-7b58-49af-bb22-ef055801f13b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh"
Jul 15 12:14:58.244449 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.244426    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:14:58.744412748 +0000 UTC m=+225.692441391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : secret "router-metrics-certs-default" not found
Jul 15 12:14:58.244449 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.244444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.244766 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.244554    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 12:14:58.244766 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.244593    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls podName:1d6de926-a79c-49b2-a2d3-eb8cb1a33aee nodeName:}" failed. No retries permitted until 2026-07-15 12:14:58.744581269 +0000 UTC m=+225.692609954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-kcm8z" (UID: "1d6de926-a79c-49b2-a2d3-eb8cb1a33aee") : secret "cluster-monitoring-operator-tls" not found
Jul 15 12:14:58.245068 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.245047    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.246512 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.246489    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-stats-auth\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.246689 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.246672    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-default-certificate\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.255126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.255101    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n55fk\" (UniqueName: \"kubernetes.io/projected/5cb27ae7-f500-4917-92ac-b461e19ac839-kube-api-access-n55fk\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.255230 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.255139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47wn4\" (UniqueName: \"kubernetes.io/projected/e46cdc29-7b58-49af-bb22-ef055801f13b-kube-api-access-47wn4\") pod \"volume-data-source-validator-78495597f6-p77zh\" (UID: \"e46cdc29-7b58-49af-bb22-ef055801f13b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh"
Jul 15 12:14:58.255688 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.255661    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd2gh\" (UniqueName: \"kubernetes.io/projected/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-kube-api-access-dd2gh\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:14:58.255831 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.255813    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gxgs\" (UniqueName: \"kubernetes.io/projected/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-kube-api-access-9gxgs\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.377682 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.377593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh"
Jul 15 12:14:58.498339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.498308    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh"]
Jul 15 12:14:58.748518 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.748422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:14:58.748518 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.748496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.748698 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.748524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:58.748698 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:58.748574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:58.748698 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.748583    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 12:14:58.748698 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.748648    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls podName:9dee292b-69b5-4fb7-95a5-e9bd9897ab60 nodeName:}" failed. No retries permitted until 2026-07-15 12:14:59.748629328 +0000 UTC m=+226.696657970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls") pod "cluster-samples-operator-65db858894-n8v78" (UID: "9dee292b-69b5-4fb7-95a5-e9bd9897ab60") : secret "samples-operator-tls" not found
Jul 15 12:14:58.748698 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.748647    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 12:14:58.748698 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.748701    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:14:59.748684131 +0000 UTC m=+226.696712764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : secret "router-metrics-certs-default" not found
Jul 15 12:14:58.748890 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.748704    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 12:14:58.748890 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.748725    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:14:59.74870781 +0000 UTC m=+226.696736439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : configmap references non-existent config key: service-ca.crt
Jul 15 12:14:58.748890 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:58.748749    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls podName:1d6de926-a79c-49b2-a2d3-eb8cb1a33aee nodeName:}" failed. No retries permitted until 2026-07-15 12:14:59.748737454 +0000 UTC m=+226.696766086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-kcm8z" (UID: "1d6de926-a79c-49b2-a2d3-eb8cb1a33aee") : secret "cluster-monitoring-operator-tls" not found
Jul 15 12:14:59.250797 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:59.250750    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh" event={"ID":"e46cdc29-7b58-49af-bb22-ef055801f13b","Type":"ContainerStarted","Data":"9d8b4218deb9f5720bdd445211596926ff5d4d5ec56a5576b21d027045f9b6ed"}
Jul 15 12:14:59.756570 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:59.756527    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:14:59.756744 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:59.756618    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:14:59.756744 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:59.756674    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 12:14:59.756744 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:59.756697    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 12:14:59.756744 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:59.756741    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls podName:1d6de926-a79c-49b2-a2d3-eb8cb1a33aee nodeName:}" failed. No retries permitted until 2026-07-15 12:15:01.756720921 +0000 UTC m=+228.704749551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-kcm8z" (UID: "1d6de926-a79c-49b2-a2d3-eb8cb1a33aee") : secret "cluster-monitoring-operator-tls" not found
Jul 15 12:14:59.756992 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:59.756807    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:59.756992 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:14:59.756838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:14:59.756992 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:59.756935    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:01.756919328 +0000 UTC m=+228.704947960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : configmap references non-existent config key: service-ca.crt
Jul 15 12:14:59.756992 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:59.756935    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 12:14:59.756992 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:59.756971    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:01.756963399 +0000 UTC m=+228.704992031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : secret "router-metrics-certs-default" not found
Jul 15 12:14:59.756992 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:14:59.756982    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls podName:9dee292b-69b5-4fb7-95a5-e9bd9897ab60 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:01.756975995 +0000 UTC m=+228.705004623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls") pod "cluster-samples-operator-65db858894-n8v78" (UID: "9dee292b-69b5-4fb7-95a5-e9bd9897ab60") : secret "samples-operator-tls" not found
Jul 15 12:15:00.254123 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:00.254082    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh" event={"ID":"e46cdc29-7b58-49af-bb22-ef055801f13b","Type":"ContainerStarted","Data":"350905af01332ed1355abb7d473c35480534e3b549a67e2d7c6b7546fe0a7e3c"}
Jul 15 12:15:01.775070 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:01.775042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:01.775097    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:01.775118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:01.775147    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:01.775195    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:01.775230    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:01.775271    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls podName:9dee292b-69b5-4fb7-95a5-e9bd9897ab60 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:05.775252231 +0000 UTC m=+232.723280875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls") pod "cluster-samples-operator-65db858894-n8v78" (UID: "9dee292b-69b5-4fb7-95a5-e9bd9897ab60") : secret "samples-operator-tls" not found
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:01.775285    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:05.775279324 +0000 UTC m=+232.723307952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : configmap references non-existent config key: service-ca.crt
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:01.775306    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:01.775316    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:05.775305828 +0000 UTC m=+232.723334460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : secret "router-metrics-certs-default" not found
Jul 15 12:15:01.775519 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:01.775369    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls podName:1d6de926-a79c-49b2-a2d3-eb8cb1a33aee nodeName:}" failed. No retries permitted until 2026-07-15 12:15:05.77535048 +0000 UTC m=+232.723379126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-kcm8z" (UID: "1d6de926-a79c-49b2-a2d3-eb8cb1a33aee") : secret "cluster-monitoring-operator-tls" not found
Jul 15 12:15:03.416390 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.416338    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-p77zh" podStartSLOduration=4.33634976 podStartE2EDuration="5.416316732s" totalImagesPullingTime="1.079966972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:00.269031907 +0000 UTC m=+227.217060558" watchObservedRunningTime="2026-07-15 12:15:03.416316732 +0000 UTC m=+230.364345380"
Jul 15 12:15:03.417318 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.417262    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xwmg5"]
Jul 15 12:15:03.419539 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.419518    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.422465 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.422443    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 12:15:03.422581 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.422494    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jn585\""
Jul 15 12:15:03.422669 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.422657    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 12:15:03.424069 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.424035    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 12:15:03.424143 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.424069    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 12:15:03.433326 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.433283    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xwmg5"]
Jul 15 12:15:03.486914 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.486867    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.487102 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.486928    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.487102 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.487004    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlkdp\" (UniqueName: \"kubernetes.io/projected/6583841b-e7ea-4114-be05-b93ac21160e5-kube-api-access-tlkdp\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.487102 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.487045    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6583841b-e7ea-4114-be05-b93ac21160e5-crio-socket\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.487102 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.487067    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6583841b-e7ea-4114-be05-b93ac21160e5-data-volume\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.587852 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.587799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6583841b-e7ea-4114-be05-b93ac21160e5-crio-socket\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.587852 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.587854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6583841b-e7ea-4114-be05-b93ac21160e5-data-volume\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.588072 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.587884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.588072 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.587915    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.588072 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.587938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6583841b-e7ea-4114-be05-b93ac21160e5-crio-socket\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.588072 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.587994    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlkdp\" (UniqueName: \"kubernetes.io/projected/6583841b-e7ea-4114-be05-b93ac21160e5-kube-api-access-tlkdp\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.588072 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:03.588010    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:03.588072 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:03.588040    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:03.588072 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:03.588071    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:04.08805216 +0000 UTC m=+231.036080812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:03.588282 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:03.588111    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:04.088103811 +0000 UTC m=+231.036132439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:03.588282 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.588179    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6583841b-e7ea-4114-be05-b93ac21160e5-data-volume\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:03.596938 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:03.596910    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlkdp\" (UniqueName: \"kubernetes.io/projected/6583841b-e7ea-4114-be05-b93ac21160e5-kube-api-access-tlkdp\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:04.091595 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:04.091558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:04.091595 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:04.091604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:04.091807 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:04.091744    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:04.091807 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:04.091790    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:05.091777951 +0000 UTC m=+232.039806580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:04.091807 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:04.091743    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:04.091909 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:04.091820    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:05.091814249 +0000 UTC m=+232.039842878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:05.100446 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:05.100394    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:05.100847 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:05.100474    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:05.100847 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.100540    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:05.100847 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.100584    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:05.100847 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.100608    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:07.100593016 +0000 UTC m=+234.048621645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:05.100847 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.100629    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:07.100617005 +0000 UTC m=+234.048645633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:05.384979 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:05.384900    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wjqkf_89fd816f-1fa1-4220-8e5e-903050d92a3a/dns-node-resolver/0.log"
Jul 15 12:15:05.805826 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:05.805790    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:15:05.805989 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:05.805835    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:05.805989 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:05.805903    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:05.805989 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:05.805925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:15:05.805989 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.805944    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 12:15:05.806116 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.806008    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 12:15:05.806116 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.806016    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 12:15:05.806116 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.806019    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls podName:9dee292b-69b5-4fb7-95a5-e9bd9897ab60 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:13.806000191 +0000 UTC m=+240.754028825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls") pod "cluster-samples-operator-65db858894-n8v78" (UID: "9dee292b-69b5-4fb7-95a5-e9bd9897ab60") : secret "samples-operator-tls" not found
Jul 15 12:15:05.806116 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.806062    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:13.806050294 +0000 UTC m=+240.754078928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : configmap references non-existent config key: service-ca.crt
Jul 15 12:15:05.806116 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.806077    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:13.806068101 +0000 UTC m=+240.754096743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : secret "router-metrics-certs-default" not found
Jul 15 12:15:05.806116 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:05.806089    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls podName:1d6de926-a79c-49b2-a2d3-eb8cb1a33aee nodeName:}" failed. No retries permitted until 2026-07-15 12:15:13.806082164 +0000 UTC m=+240.754110799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-kcm8z" (UID: "1d6de926-a79c-49b2-a2d3-eb8cb1a33aee") : secret "cluster-monitoring-operator-tls" not found
Jul 15 12:15:06.385282 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:06.385256    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dtgm7_f633254c-28aa-4625-ac26-df610d480c2d/node-ca/0.log"
Jul 15 12:15:06.922335 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:06.922299    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z7s2j"]
Jul 15 12:15:06.925211 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:06.925190    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:06.928052 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:06.928030    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 12:15:06.928284 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:06.928268    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 12:15:06.928383 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:06.928274    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-llhxd\""
Jul 15 12:15:06.929564 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:06.929550    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 12:15:06.929612 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:06.929589    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 12:15:06.936145 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:06.936119    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z7s2j"]
Jul 15 12:15:07.016215 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.016169    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/db9f4923-b6ae-4ded-8d0b-17ef4962635d-signing-key\") pod \"service-ca-79f68b9f4f-z7s2j\" (UID: \"db9f4923-b6ae-4ded-8d0b-17ef4962635d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.016215 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.016215    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6956\" (UniqueName: \"kubernetes.io/projected/db9f4923-b6ae-4ded-8d0b-17ef4962635d-kube-api-access-s6956\") pod \"service-ca-79f68b9f4f-z7s2j\" (UID: \"db9f4923-b6ae-4ded-8d0b-17ef4962635d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.016454 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.016281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/db9f4923-b6ae-4ded-8d0b-17ef4962635d-signing-cabundle\") pod \"service-ca-79f68b9f4f-z7s2j\" (UID: \"db9f4923-b6ae-4ded-8d0b-17ef4962635d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.116669 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.116641    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:07.116737 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.116680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/db9f4923-b6ae-4ded-8d0b-17ef4962635d-signing-cabundle\") pod \"service-ca-79f68b9f4f-z7s2j\" (UID: \"db9f4923-b6ae-4ded-8d0b-17ef4962635d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.116737 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.116701    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:07.116801 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.116785    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/db9f4923-b6ae-4ded-8d0b-17ef4962635d-signing-key\") pod \"service-ca-79f68b9f4f-z7s2j\" (UID: \"db9f4923-b6ae-4ded-8d0b-17ef4962635d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.116834 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:07.116800    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:07.116834 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.116813    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6956\" (UniqueName: \"kubernetes.io/projected/db9f4923-b6ae-4ded-8d0b-17ef4962635d-kube-api-access-s6956\") pod \"service-ca-79f68b9f4f-z7s2j\" (UID: \"db9f4923-b6ae-4ded-8d0b-17ef4962635d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.116896 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:07.116854    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:07.116896 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:07.116867    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:11.116851645 +0000 UTC m=+238.064880274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:07.116966 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:07.116909    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:11.11689269 +0000 UTC m=+238.064921341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:07.117453 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.117429    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/db9f4923-b6ae-4ded-8d0b-17ef4962635d-signing-cabundle\") pod \"service-ca-79f68b9f4f-z7s2j\" (UID: \"db9f4923-b6ae-4ded-8d0b-17ef4962635d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.119170 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.119154    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/db9f4923-b6ae-4ded-8d0b-17ef4962635d-signing-key\") pod \"service-ca-79f68b9f4f-z7s2j\" (UID: \"db9f4923-b6ae-4ded-8d0b-17ef4962635d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.124662 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.124641    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6956\" (UniqueName: \"kubernetes.io/projected/db9f4923-b6ae-4ded-8d0b-17ef4962635d-kube-api-access-s6956\") pod \"service-ca-79f68b9f4f-z7s2j\" (UID: \"db9f4923-b6ae-4ded-8d0b-17ef4962635d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.234231 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.234137    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j"
Jul 15 12:15:07.353491 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.353422    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z7s2j"]
Jul 15 12:15:07.355935 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:07.355912    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9f4923_b6ae_4ded_8d0b_17ef4962635d.slice/crio-27a4222cd8941f7c3d2c3d9cdc4493f74fe1727278db8dddaa30f23139d55b05 WatchSource:0}: Error finding container 27a4222cd8941f7c3d2c3d9cdc4493f74fe1727278db8dddaa30f23139d55b05: Status 404 returned error can't find the container with id 27a4222cd8941f7c3d2c3d9cdc4493f74fe1727278db8dddaa30f23139d55b05
Jul 15 12:15:07.385190 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:07.385168    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rcnn5_96860b42-9d6f-4fd9-bd9d-b4bbc700b972/serve-healthcheck-canary/0.log"
Jul 15 12:15:08.276303 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:08.276261    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j" event={"ID":"db9f4923-b6ae-4ded-8d0b-17ef4962635d","Type":"ContainerStarted","Data":"27a4222cd8941f7c3d2c3d9cdc4493f74fe1727278db8dddaa30f23139d55b05"}
Jul 15 12:15:10.284239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:10.284155    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j" event={"ID":"db9f4923-b6ae-4ded-8d0b-17ef4962635d","Type":"ContainerStarted","Data":"a3464ab84ce481fed70408731885759876d4b6014783c595ce5cd74e9abbc50e"}
Jul 15 12:15:10.300474 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:10.300421    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-z7s2j" podStartSLOduration=1.819333502 podStartE2EDuration="4.300398832s" totalImagesPullingTime="2.48106533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:10.300008257 +0000 UTC m=+237.248036908" watchObservedRunningTime="2026-07-15 12:15:10.300398832 +0000 UTC m=+237.248427484"
Jul 15 12:15:11.150460 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:11.150420    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:11.150665 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:11.150474    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:11.150665 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:11.150581    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:11.150665 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:11.150614    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:15:11.150665 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:11.150641    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:19.150622488 +0000 UTC m=+246.098651132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:11.150665 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:11.150668    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:19.150654616 +0000 UTC m=+246.098683249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : configmap "kube-rbac-proxy" not found
Jul 15 12:15:13.877030 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:13.876991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:13.877526 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:13.877040    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:15:13.877526 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:13.877098    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:15:13.877526 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:13.877127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:13.877526 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:13.877155    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 12:15:13.877526 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:13.877219    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:29.877201082 +0000 UTC m=+256.825229732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : secret "router-metrics-certs-default" not found
Jul 15 12:15:13.877526 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:13.877259    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle podName:5cb27ae7-f500-4917-92ac-b461e19ac839 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:29.877249017 +0000 UTC m=+256.825277647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle") pod "router-default-6dcc798bb6-d4rll" (UID: "5cb27ae7-f500-4917-92ac-b461e19ac839") : configmap references non-existent config key: service-ca.crt
Jul 15 12:15:13.877526 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:13.877341    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 12:15:13.877526 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:13.877389    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls podName:1d6de926-a79c-49b2-a2d3-eb8cb1a33aee nodeName:}" failed. No retries permitted until 2026-07-15 12:15:29.877379156 +0000 UTC m=+256.825407786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-kcm8z" (UID: "1d6de926-a79c-49b2-a2d3-eb8cb1a33aee") : secret "cluster-monitoring-operator-tls" not found
Jul 15 12:15:13.879638 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:13.879615    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9dee292b-69b5-4fb7-95a5-e9bd9897ab60-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-n8v78\" (UID: \"9dee292b-69b5-4fb7-95a5-e9bd9897ab60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:15:13.991672 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:13.991644    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6wh8m\""
Jul 15 12:15:13.999076 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:13.999058    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"
Jul 15 12:15:14.124027 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:14.123981    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78"]
Jul 15 12:15:14.297951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:14.297915    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78" event={"ID":"9dee292b-69b5-4fb7-95a5-e9bd9897ab60","Type":"ContainerStarted","Data":"de7f44382c7e0e5dc0dd61a6fcbb69f6448b72ee272d23dab1f31e9380fa5aec"}
Jul 15 12:15:16.306607 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:16.306565    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78" event={"ID":"9dee292b-69b5-4fb7-95a5-e9bd9897ab60","Type":"ContainerStarted","Data":"0d7feee8b631577abaeed149e2ae252c677ff3411e9fcbe91d904a77348b4b48"}
Jul 15 12:15:16.306985 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:16.306633    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78" event={"ID":"9dee292b-69b5-4fb7-95a5-e9bd9897ab60","Type":"ContainerStarted","Data":"0d45107657803ee983fdccbc485b601475b49bfa7b01b0de1beb27f8c4141e93"}
Jul 15 12:15:16.323285 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:16.323235    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-n8v78" podStartSLOduration=16.535427753 podStartE2EDuration="18.32321907s" totalImagesPullingTime="1.787791317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:16.322692211 +0000 UTC m=+243.270720861" watchObservedRunningTime="2026-07-15 12:15:16.32321907 +0000 UTC m=+243.271247721"
Jul 15 12:15:19.224050 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:19.224005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:19.224464 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:19.224072    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:19.224464 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:19.224166    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:19.224464 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:19.224237    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls podName:6583841b-e7ea-4114-be05-b93ac21160e5 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:35.224217068 +0000 UTC m=+262.172245698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwmg5" (UID: "6583841b-e7ea-4114-be05-b93ac21160e5") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:15:19.224625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:19.224609    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6583841b-e7ea-4114-be05-b93ac21160e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:25.374735 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:25.374694    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:15:25.376956 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:25.376931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d48e773-ec60-489a-84f1-8f816afd365e-metrics-certs\") pod \"network-metrics-daemon-54zrq\" (UID: \"8d48e773-ec60-489a-84f1-8f816afd365e\") " pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:15:25.425184 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:25.425152    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5qgtr\""
Jul 15 12:15:25.432501 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:25.432477    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54zrq"
Jul 15 12:15:25.552949 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:25.552925    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-54zrq"]
Jul 15 12:15:25.554916 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:25.554890    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d48e773_ec60_489a_84f1_8f816afd365e.slice/crio-e245745e6e1ba790dcc6332adc279fb79dfc3f5c570afc5ca50242e438915a4d WatchSource:0}: Error finding container e245745e6e1ba790dcc6332adc279fb79dfc3f5c570afc5ca50242e438915a4d: Status 404 returned error can't find the container with id e245745e6e1ba790dcc6332adc279fb79dfc3f5c570afc5ca50242e438915a4d
Jul 15 12:15:26.337114 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:26.337072    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54zrq" event={"ID":"8d48e773-ec60-489a-84f1-8f816afd365e","Type":"ContainerStarted","Data":"e245745e6e1ba790dcc6332adc279fb79dfc3f5c570afc5ca50242e438915a4d"}
Jul 15 12:15:27.345675 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:27.345634    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54zrq" event={"ID":"8d48e773-ec60-489a-84f1-8f816afd365e","Type":"ContainerStarted","Data":"fd26160b14f4ac4227bd62d46654463a568fcba86bbabc220840a1c692058584"}
Jul 15 12:15:27.346149 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:27.345728    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54zrq" event={"ID":"8d48e773-ec60-489a-84f1-8f816afd365e","Type":"ContainerStarted","Data":"63c277d2d5d3c44c534887a05a4379336a5adb2345fc71ca0148a45068a8a671"}
Jul 15 12:15:27.362734 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:27.362689    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-54zrq" podStartSLOduration=252.135532387 podStartE2EDuration="4m13.362674774s" totalImagesPullingTime="1.227142387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:27.362213049 +0000 UTC m=+254.310241701" watchObservedRunningTime="2026-07-15 12:15:27.362674774 +0000 UTC m=+254.310703424"
Jul 15 12:15:29.912640 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:29.912603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:29.913126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:29.912671    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:29.913126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:29.912792    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:15:29.913407 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:29.913378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb27ae7-f500-4917-92ac-b461e19ac839-service-ca-bundle\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:29.915018 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:29.914998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cb27ae7-f500-4917-92ac-b461e19ac839-metrics-certs\") pod \"router-default-6dcc798bb6-d4rll\" (UID: \"5cb27ae7-f500-4917-92ac-b461e19ac839\") " pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:29.915240 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:29.915222    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6de926-a79c-49b2-a2d3-eb8cb1a33aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-kcm8z\" (UID: \"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:15:30.198011 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.197930    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wvcxv\""
Jul 15 12:15:30.205488 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.205455    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"
Jul 15 12:15:30.205740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.205725    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dbtlv\""
Jul 15 12:15:30.211700 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.211679    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:30.253205 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.253172    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b445fd56-x9mhl"]
Jul 15 12:15:30.253581 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:30.253526    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-77b445fd56-x9mhl" podUID="7ceb06a4-a48b-4966-87d3-546dba28c399"
Jul 15 12:15:30.270284 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.270252    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c5557588b-2bpln"]
Jul 15 12:15:30.273551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.273524    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.290318 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.290270    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5557588b-2bpln"]
Jul 15 12:15:30.314996 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.314886    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqx87\" (UniqueName: \"kubernetes.io/projected/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-kube-api-access-cqx87\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.314996 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.314973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-installation-pull-secrets\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.315245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.315019    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-bound-sa-token\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.315245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.315061    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-registry-tls\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.315245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.315120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-registry-certificates\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.315245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.315149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-image-registry-private-configuration\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.315245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.315180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-trusted-ca\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.315245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.315237    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-ca-trust-extracted\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.354426 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.354405    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z"]
Jul 15 12:15:30.355043 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.355026    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:15:30.356601 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:30.356575    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6de926_a79c_49b2_a2d3_eb8cb1a33aee.slice/crio-d015eb0e8708b219394fb07d531bd04cc16f1f7bb0a10af55728a9944ff0ba72 WatchSource:0}: Error finding container d015eb0e8708b219394fb07d531bd04cc16f1f7bb0a10af55728a9944ff0ba72: Status 404 returned error can't find the container with id d015eb0e8708b219394fb07d531bd04cc16f1f7bb0a10af55728a9944ff0ba72
Jul 15 12:15:30.361975 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.361956    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:15:30.368888 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.368818    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dcc798bb6-d4rll"]
Jul 15 12:15:30.370789 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:30.370768    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb27ae7_f500_4917_92ac_b461e19ac839.slice/crio-a8c08dd98684b38945aaf1ca094463dcd75944b03e017103527cd76701831426 WatchSource:0}: Error finding container a8c08dd98684b38945aaf1ca094463dcd75944b03e017103527cd76701831426: Status 404 returned error can't find the container with id a8c08dd98684b38945aaf1ca094463dcd75944b03e017103527cd76701831426
Jul 15 12:15:30.416550 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416529    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-trusted-ca\") pod \"7ceb06a4-a48b-4966-87d3-546dba28c399\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") "
Jul 15 12:15:30.416691 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416575    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5tjd\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-kube-api-access-x5tjd\") pod \"7ceb06a4-a48b-4966-87d3-546dba28c399\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") "
Jul 15 12:15:30.416691 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416601    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-bound-sa-token\") pod \"7ceb06a4-a48b-4966-87d3-546dba28c399\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") "
Jul 15 12:15:30.416691 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416633    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ceb06a4-a48b-4966-87d3-546dba28c399-ca-trust-extracted\") pod \"7ceb06a4-a48b-4966-87d3-546dba28c399\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") "
Jul 15 12:15:30.416691 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416662    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-certificates\") pod \"7ceb06a4-a48b-4966-87d3-546dba28c399\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") "
Jul 15 12:15:30.416890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416692    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-installation-pull-secrets\") pod \"7ceb06a4-a48b-4966-87d3-546dba28c399\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") "
Jul 15 12:15:30.416890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416729    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-image-registry-private-configuration\") pod \"7ceb06a4-a48b-4966-87d3-546dba28c399\" (UID: \"7ceb06a4-a48b-4966-87d3-546dba28c399\") "
Jul 15 12:15:30.416890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416835    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqx87\" (UniqueName: \"kubernetes.io/projected/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-kube-api-access-cqx87\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.416890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-installation-pull-secrets\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.417085 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-bound-sa-token\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.417085 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416929    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ceb06a4-a48b-4966-87d3-546dba28c399-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7ceb06a4-a48b-4966-87d3-546dba28c399" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:15:30.417085 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416949    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-registry-tls\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.417085 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416950    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7ceb06a4-a48b-4966-87d3-546dba28c399" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:15:30.417085 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.416996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-registry-certificates\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.417085 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.417027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-image-registry-private-configuration\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.417085 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.417064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-trusted-ca\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.417457 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.417116    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-ca-trust-extracted\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.417457 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.417187    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ceb06a4-a48b-4966-87d3-546dba28c399-ca-trust-extracted\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:15:30.417605 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.417203    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-trusted-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:15:30.417605 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.417340    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7ceb06a4-a48b-4966-87d3-546dba28c399" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:15:30.418597 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.418523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-registry-certificates\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.418597 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.418548    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-ca-trust-extracted\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.418762 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.418643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-trusted-ca\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.419596 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.419564    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7ceb06a4-a48b-4966-87d3-546dba28c399" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:15:30.419716 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.419693    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-installation-pull-secrets\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.419872 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.419855    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7ceb06a4-a48b-4966-87d3-546dba28c399" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:15:30.420103 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.420084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-image-registry-private-configuration\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.420225 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.420111    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-kube-api-access-x5tjd" (OuterVolumeSpecName: "kube-api-access-x5tjd") pod "7ceb06a4-a48b-4966-87d3-546dba28c399" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399"). InnerVolumeSpecName "kube-api-access-x5tjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:15:30.420393 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.420376    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7ceb06a4-a48b-4966-87d3-546dba28c399" (UID: "7ceb06a4-a48b-4966-87d3-546dba28c399"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:15:30.420935 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.420919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-registry-tls\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.426917 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.426898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqx87\" (UniqueName: \"kubernetes.io/projected/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-kube-api-access-cqx87\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.427188 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.427167    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaa51f88-e736-4b9b-94b5-8a0fefac89f2-bound-sa-token\") pod \"image-registry-6c5557588b-2bpln\" (UID: \"aaa51f88-e736-4b9b-94b5-8a0fefac89f2\") " pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.518083 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.518008    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5tjd\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-kube-api-access-x5tjd\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:15:30.518083 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.518034    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-bound-sa-token\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:15:30.518083 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.518048    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-certificates\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:15:30.518083 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.518057    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-installation-pull-secrets\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:15:30.518083 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.518066    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ceb06a4-a48b-4966-87d3-546dba28c399-image-registry-private-configuration\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:15:30.588841 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.588812    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6jhfg\""
Jul 15 12:15:30.596198 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.596165    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:30.721211 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:30.721189    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5557588b-2bpln"]
Jul 15 12:15:30.723247 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:30.723223    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa51f88_e736_4b9b_94b5_8a0fefac89f2.slice/crio-399751e9ff14d5a9cae4a724b77e8a2ec8f68d965ac378bd86eb85d3517bbcc7 WatchSource:0}: Error finding container 399751e9ff14d5a9cae4a724b77e8a2ec8f68d965ac378bd86eb85d3517bbcc7: Status 404 returned error can't find the container with id 399751e9ff14d5a9cae4a724b77e8a2ec8f68d965ac378bd86eb85d3517bbcc7
Jul 15 12:15:31.360142 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.360106    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5557588b-2bpln" event={"ID":"aaa51f88-e736-4b9b-94b5-8a0fefac89f2","Type":"ContainerStarted","Data":"0d7f2320debfd013ba7948d17d93730b899799b3fff2d0de0982fe36b54674bc"}
Jul 15 12:15:31.360142 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.360169    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5557588b-2bpln" event={"ID":"aaa51f88-e736-4b9b-94b5-8a0fefac89f2","Type":"ContainerStarted","Data":"399751e9ff14d5a9cae4a724b77e8a2ec8f68d965ac378bd86eb85d3517bbcc7"}
Jul 15 12:15:31.360700 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.360212    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:15:31.361912 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.361886    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dcc798bb6-d4rll" event={"ID":"5cb27ae7-f500-4917-92ac-b461e19ac839","Type":"ContainerStarted","Data":"3277908d91d5ca6f6a3002913c2b4493ee7f72b5a59006921fd9abc3a17f1512"}
Jul 15 12:15:31.362020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.361927    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dcc798bb6-d4rll" event={"ID":"5cb27ae7-f500-4917-92ac-b461e19ac839","Type":"ContainerStarted","Data":"a8c08dd98684b38945aaf1ca094463dcd75944b03e017103527cd76701831426"}
Jul 15 12:15:31.367780 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.367760    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b445fd56-x9mhl"
Jul 15 12:15:31.367911 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.367752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z" event={"ID":"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee","Type":"ContainerStarted","Data":"d015eb0e8708b219394fb07d531bd04cc16f1f7bb0a10af55728a9944ff0ba72"}
Jul 15 12:15:31.382754 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.382704    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c5557588b-2bpln" podStartSLOduration=1.382691919 podStartE2EDuration="1.382691919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:31.381036272 +0000 UTC m=+258.329064924" watchObservedRunningTime="2026-07-15 12:15:31.382691919 +0000 UTC m=+258.330720548"
Jul 15 12:15:31.412194 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.412163    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b445fd56-x9mhl"]
Jul 15 12:15:31.415786 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.415761    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77b445fd56-x9mhl"]
Jul 15 12:15:31.426357 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.426272    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ceb06a4-a48b-4966-87d3-546dba28c399-registry-tls\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:15:31.432275 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.432224    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6dcc798bb6-d4rll" podStartSLOduration=33.432205146 podStartE2EDuration="33.432205146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:31.431880765 +0000 UTC m=+258.379909419" watchObservedRunningTime="2026-07-15 12:15:31.432205146 +0000 UTC m=+258.380233801"
Jul 15 12:15:31.625722 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:31.625638    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ceb06a4-a48b-4966-87d3-546dba28c399" path="/var/lib/kubelet/pods/7ceb06a4-a48b-4966-87d3-546dba28c399/volumes"
Jul 15 12:15:32.213380 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.213340    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:32.215880 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.215855    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:32.373397 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.373351    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z" event={"ID":"1d6de926-a79c-49b2-a2d3-eb8cb1a33aee","Type":"ContainerStarted","Data":"34dc8cb95c8fcbb676ff0c67d85d9bb9e90dfd4d4dfc5510df6f0a15fefa81cb"}
Jul 15 12:15:32.373914 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.373895    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:32.375047 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.375027    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6dcc798bb6-d4rll"
Jul 15 12:15:32.390535 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.390488    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-kcm8z" podStartSLOduration=32.480958618 podStartE2EDuration="34.390471874s" totalImagesPullingTime="1.909513256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:32.389232205 +0000 UTC m=+259.337260855" watchObservedRunningTime="2026-07-15 12:15:32.390471874 +0000 UTC m=+259.338500525"
Jul 15 12:15:32.733594 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.733563    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"]
Jul 15 12:15:32.736916 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.736900    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"
Jul 15 12:15:32.739705 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.739684    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 12:15:32.739924 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.739909    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-snjqk\""
Jul 15 12:15:32.745040 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.745015    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"]
Jul 15 12:15:32.839390 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.839354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/431fbd53-e43c-41c7-8844-4e72f6dc0e43-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gz4xc\" (UID: \"431fbd53-e43c-41c7-8844-4e72f6dc0e43\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"
Jul 15 12:15:32.940012 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:32.939974    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/431fbd53-e43c-41c7-8844-4e72f6dc0e43-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gz4xc\" (UID: \"431fbd53-e43c-41c7-8844-4e72f6dc0e43\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"
Jul 15 12:15:32.940186 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:32.940090    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 12:15:32.940186 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:32.940143    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/431fbd53-e43c-41c7-8844-4e72f6dc0e43-tls-certificates podName:431fbd53-e43c-41c7-8844-4e72f6dc0e43 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:33.440129465 +0000 UTC m=+260.388158094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/431fbd53-e43c-41c7-8844-4e72f6dc0e43-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-gz4xc" (UID: "431fbd53-e43c-41c7-8844-4e72f6dc0e43") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 12:15:33.444300 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:33.444265    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/431fbd53-e43c-41c7-8844-4e72f6dc0e43-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gz4xc\" (UID: \"431fbd53-e43c-41c7-8844-4e72f6dc0e43\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"
Jul 15 12:15:33.446693 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:33.446672    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/431fbd53-e43c-41c7-8844-4e72f6dc0e43-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gz4xc\" (UID: \"431fbd53-e43c-41c7-8844-4e72f6dc0e43\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"
Jul 15 12:15:33.647168 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:33.647142    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"
Jul 15 12:15:33.770762 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:33.770644    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"]
Jul 15 12:15:33.773190 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:33.773162    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431fbd53_e43c_41c7_8844_4e72f6dc0e43.slice/crio-0801aa6c8b83c501b3c1cedee27c74660de8c0733650f35ce97ee0e1b9f1e5c4 WatchSource:0}: Error finding container 0801aa6c8b83c501b3c1cedee27c74660de8c0733650f35ce97ee0e1b9f1e5c4: Status 404 returned error can't find the container with id 0801aa6c8b83c501b3c1cedee27c74660de8c0733650f35ce97ee0e1b9f1e5c4
Jul 15 12:15:34.381609 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:34.381574    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc" event={"ID":"431fbd53-e43c-41c7-8844-4e72f6dc0e43","Type":"ContainerStarted","Data":"0801aa6c8b83c501b3c1cedee27c74660de8c0733650f35ce97ee0e1b9f1e5c4"}
Jul 15 12:15:35.261057 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:35.260936    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:35.263324 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:35.263275    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6583841b-e7ea-4114-be05-b93ac21160e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwmg5\" (UID: \"6583841b-e7ea-4114-be05-b93ac21160e5\") " pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:35.386164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:35.386127    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc" event={"ID":"431fbd53-e43c-41c7-8844-4e72f6dc0e43","Type":"ContainerStarted","Data":"f89ad5d207ec8409dc4a0673c951ae6946a31ee31100922b2e456ec7c399ba14"}
Jul 15 12:15:35.386375 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:35.386323    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"
Jul 15 12:15:35.390906 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:35.390880    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc"
Jul 15 12:15:35.402910 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:35.402871    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gz4xc" podStartSLOduration=2.175877591 podStartE2EDuration="3.402859457s" totalImagesPullingTime="1.226981866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:35.402264622 +0000 UTC m=+262.350293276" watchObservedRunningTime="2026-07-15 12:15:35.402859457 +0000 UTC m=+262.350888124"
Jul 15 12:15:35.531782 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:35.531695    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jn585\""
Jul 15 12:15:35.539260 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:35.539239    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xwmg5"
Jul 15 12:15:35.679136 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:35.679012    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xwmg5"]
Jul 15 12:15:35.681559 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:35.681533    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6583841b_e7ea_4114_be05_b93ac21160e5.slice/crio-e758a47f50811994266d74a3c7a5a434a184d6bf05c513d7a702c8b8be3cab38 WatchSource:0}: Error finding container e758a47f50811994266d74a3c7a5a434a184d6bf05c513d7a702c8b8be3cab38: Status 404 returned error can't find the container with id e758a47f50811994266d74a3c7a5a434a184d6bf05c513d7a702c8b8be3cab38
Jul 15 12:15:36.392538 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:36.392503    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwmg5" event={"ID":"6583841b-e7ea-4114-be05-b93ac21160e5","Type":"ContainerStarted","Data":"e758a47f50811994266d74a3c7a5a434a184d6bf05c513d7a702c8b8be3cab38"}
Jul 15 12:15:42.419121 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:42.419077    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwmg5" event={"ID":"6583841b-e7ea-4114-be05-b93ac21160e5","Type":"ContainerStarted","Data":"4bd7d3c91d1339a5fddc9e3d1acdfc8f1e86a290743cc19ac73519a6da98c168"}
Jul 15 12:15:43.181857 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.181819    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"]
Jul 15 12:15:43.184525 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.184509    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.187714 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.187687    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 15 12:15:43.187895 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.187687    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6r6gd\""
Jul 15 12:15:43.188979 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.188961    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 12:15:43.189069 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.189013    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 15 12:15:43.192132 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.192108    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wtw5s"]
Jul 15 12:15:43.194638 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.194619    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.197339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.197315    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 12:15:43.197447 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.197417    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-n2sgv\""
Jul 15 12:15:43.197782 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.197672    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 12:15:43.197869 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.197839    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 12:15:43.202104 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.202080    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"]
Jul 15 12:15:43.230417 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.230384    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0cda0b2-d65b-4616-9854-8a0500703b02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.230572 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.230476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0cda0b2-d65b-4616-9854-8a0500703b02-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.230572 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.230517    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k22p\" (UniqueName: \"kubernetes.io/projected/c0cda0b2-d65b-4616-9854-8a0500703b02-kube-api-access-6k22p\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.230688 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.230614    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0cda0b2-d65b-4616-9854-8a0500703b02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.331227 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.331150    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01891276-45c8-42e0-a0fb-6d775da7b9c5-metrics-client-ca\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.331227 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.331202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-textfile\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.331478 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.331327    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvjbd\" (UniqueName: \"kubernetes.io/projected/01891276-45c8-42e0-a0fb-6d775da7b9c5-kube-api-access-gvjbd\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.331478 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.331390    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-tls\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.331478 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.331455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.331644 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.331484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01891276-45c8-42e0-a0fb-6d775da7b9c5-sys\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.331644 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.331593    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0cda0b2-d65b-4616-9854-8a0500703b02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.332051 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.332029    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01891276-45c8-42e0-a0fb-6d775da7b9c5-root\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.332192 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.332080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0cda0b2-d65b-4616-9854-8a0500703b02-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.332785 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.332745    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0cda0b2-d65b-4616-9854-8a0500703b02-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.332881 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.332110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k22p\" (UniqueName: \"kubernetes.io/projected/c0cda0b2-d65b-4616-9854-8a0500703b02-kube-api-access-6k22p\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.332948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.332879    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.333004 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.332966    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-wtmp\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.333058 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.333004    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0cda0b2-d65b-4616-9854-8a0500703b02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.335924 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.335882    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0cda0b2-d65b-4616-9854-8a0500703b02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.336906 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.336866    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0cda0b2-d65b-4616-9854-8a0500703b02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.340660 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.340634    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k22p\" (UniqueName: \"kubernetes.io/projected/c0cda0b2-d65b-4616-9854-8a0500703b02-kube-api-access-6k22p\") pod \"openshift-state-metrics-84bd68b896-n8d6b\" (UID: \"c0cda0b2-d65b-4616-9854-8a0500703b02\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.434218 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434136    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvjbd\" (UniqueName: \"kubernetes.io/projected/01891276-45c8-42e0-a0fb-6d775da7b9c5-kube-api-access-gvjbd\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.434218 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-tls\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.434789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.434789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434252    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01891276-45c8-42e0-a0fb-6d775da7b9c5-sys\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.434789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434330    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01891276-45c8-42e0-a0fb-6d775da7b9c5-root\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.434789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434358    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.434789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-wtmp\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.434789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434472    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01891276-45c8-42e0-a0fb-6d775da7b9c5-metrics-client-ca\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.434789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434478    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01891276-45c8-42e0-a0fb-6d775da7b9c5-sys\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.434789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.434541    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-textfile\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.435201 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.435056    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-wtmp\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.435201 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.435155    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.435201 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.435183    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01891276-45c8-42e0-a0fb-6d775da7b9c5-root\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.435437 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.435419    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-textfile\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.435498 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.435443    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01891276-45c8-42e0-a0fb-6d775da7b9c5-metrics-client-ca\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.437837 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.437793    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-tls\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.438352 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.438311    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01891276-45c8-42e0-a0fb-6d775da7b9c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.443274 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.443253    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvjbd\" (UniqueName: \"kubernetes.io/projected/01891276-45c8-42e0-a0fb-6d775da7b9c5-kube-api-access-gvjbd\") pod \"node-exporter-wtw5s\" (UID: \"01891276-45c8-42e0-a0fb-6d775da7b9c5\") " pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:43.496568 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.496531    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"
Jul 15 12:15:43.508375 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:43.508348    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtw5s"
Jul 15 12:15:44.214996 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.214962    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:15:44.225538 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.225509    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.229222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.228766    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 12:15:44.229222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.228976    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 12:15:44.229222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.229152    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 12:15:44.229491 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.229407    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hzsp4\""
Jul 15 12:15:44.229491 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.229443    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 12:15:44.229618 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.229597    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 12:15:44.229690 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.229676    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 12:15:44.229742 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.229688    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 12:15:44.229796 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.229606    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 12:15:44.231357 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.230561    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 12:15:44.237377 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.237350    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:15:44.340983 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.340931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341027    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341160    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-web-config\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341266    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341386 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341341    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341386 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341376    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341479 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341529 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341497    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341594 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341577    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-out\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341635 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nkth\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-kube-api-access-6nkth\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341683 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341639    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.341734 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.341706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.442832 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.442796    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.442847    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.442881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.442905    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.442946    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-out\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.442975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkth\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-kube-api-access-6nkth\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.443005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.443032    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.443056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.443079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.443137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.443165    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-web-config\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.443193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.443961 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:44.443397    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-trusted-ca-bundle podName:ca214bcf-38e6-4228-8ab5-88c5b15ab052 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:44.943373855 +0000 UTC m=+271.891402490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052") : configmap references non-existent config key: ca-bundle.crt
Jul 15 12:15:44.443961 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.443652    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453351 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:44.444243    2571 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 15 12:15:44.453351 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:44.444322    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-main-tls podName:ca214bcf-38e6-4228-8ab5-88c5b15ab052 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:44.944302324 +0000 UTC m=+271.892330970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052") : secret "alertmanager-main-tls" not found
Jul 15 12:15:44.453351 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.445903    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453351 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.446397    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453351 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.447016    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453351 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.448537    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-web-config\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453351 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.449038    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453351 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.451341    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453351 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.451533    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453886 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.453784    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nkth\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-kube-api-access-6nkth\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453941 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.453908    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.453941 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.453927    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-out\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.947905 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.947867    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.948073 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.947927    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.948929 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.948901    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:44.950695 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:44.950649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:45.130798 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.130754    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85f55bc854-khq54"]
Jul 15 12:15:45.133607 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.133579    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.136657 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.136627    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 12:15:45.136779 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.136664    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 12:15:45.136779 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.136696    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 12:15:45.136779 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.136722    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8hshhqlccju8p\""
Jul 15 12:15:45.136779 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.136757    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jpnv8\""
Jul 15 12:15:45.137012 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.136996    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 12:15:45.138014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.137994    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 12:15:45.141421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.141401    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:15:45.147524 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.147497    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85f55bc854-khq54"]
Jul 15 12:15:45.219451 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:45.219408    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01891276_45c8_42e0_a0fb_6d775da7b9c5.slice/crio-8d955c4a1b7bcb9a1062bdce094e158e413ce3b539cad77edbd1da0ad1930f25 WatchSource:0}: Error finding container 8d955c4a1b7bcb9a1062bdce094e158e413ce3b539cad77edbd1da0ad1930f25: Status 404 returned error can't find the container with id 8d955c4a1b7bcb9a1062bdce094e158e413ce3b539cad77edbd1da0ad1930f25
Jul 15 12:15:45.251588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.250636    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-grpc-tls\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.251588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.250727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.251588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.250763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-tls\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.251588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.250800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.251588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.250846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91cfe13c-659c-4826-8fc3-4c4555266737-metrics-client-ca\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.251588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.250880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.251588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.251188    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.251588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.251231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpz2k\" (UniqueName: \"kubernetes.io/projected/91cfe13c-659c-4826-8fc3-4c4555266737-kube-api-access-xpz2k\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.352310 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.352251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-grpc-tls\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.352373 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.352334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.352373 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.352356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-tls\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.352513 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.352388    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.352791 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.352640    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91cfe13c-659c-4826-8fc3-4c4555266737-metrics-client-ca\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.352791 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.352700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.352791 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.352747    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b"]
Jul 15 12:15:45.352948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.352752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.352948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.352862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpz2k\" (UniqueName: \"kubernetes.io/projected/91cfe13c-659c-4826-8fc3-4c4555266737-kube-api-access-xpz2k\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.353502 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.353454    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91cfe13c-659c-4826-8fc3-4c4555266737-metrics-client-ca\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.355012 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:45.354969    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0cda0b2_d65b_4616_9854_8a0500703b02.slice/crio-101bcaa6c03f2ad4723b53ee00b0a37bca5c9cb1790e6b0f593e84ebb49587a4 WatchSource:0}: Error finding container 101bcaa6c03f2ad4723b53ee00b0a37bca5c9cb1790e6b0f593e84ebb49587a4: Status 404 returned error can't find the container with id 101bcaa6c03f2ad4723b53ee00b0a37bca5c9cb1790e6b0f593e84ebb49587a4
Jul 15 12:15:45.355221 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.355191    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.355535 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.355515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.355660 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.355594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-grpc-tls\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.356177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.356094    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.357182 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.356550    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-tls\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.357182 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.357088    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/91cfe13c-659c-4826-8fc3-4c4555266737-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.365113 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.365095    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpz2k\" (UniqueName: \"kubernetes.io/projected/91cfe13c-659c-4826-8fc3-4c4555266737-kube-api-access-xpz2k\") pod \"thanos-querier-85f55bc854-khq54\" (UID: \"91cfe13c-659c-4826-8fc3-4c4555266737\") " pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.380384 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.380347    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:15:45.382098 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:45.382070    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca214bcf_38e6_4228_8ab5_88c5b15ab052.slice/crio-58787dcaa3fac9c42cce5e84677f083218a06e47d7708ff248168c37a875cca9 WatchSource:0}: Error finding container 58787dcaa3fac9c42cce5e84677f083218a06e47d7708ff248168c37a875cca9: Status 404 returned error can't find the container with id 58787dcaa3fac9c42cce5e84677f083218a06e47d7708ff248168c37a875cca9
Jul 15 12:15:45.432808 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.432777    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwmg5" event={"ID":"6583841b-e7ea-4114-be05-b93ac21160e5","Type":"ContainerStarted","Data":"820ee7e4db3d3f340825b5f5fceab49cb34d16039fd99c9a4b4ff58048758653"}
Jul 15 12:15:45.434010 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.433974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerStarted","Data":"58787dcaa3fac9c42cce5e84677f083218a06e47d7708ff248168c37a875cca9"}
Jul 15 12:15:45.435481 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.435444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b" event={"ID":"c0cda0b2-d65b-4616-9854-8a0500703b02","Type":"ContainerStarted","Data":"6e4bcc114f632e7c271efb045022d9f8889900bbc5ab78bb847a9f8c0e8c5710"}
Jul 15 12:15:45.435607 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.435496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b" event={"ID":"c0cda0b2-d65b-4616-9854-8a0500703b02","Type":"ContainerStarted","Data":"101bcaa6c03f2ad4723b53ee00b0a37bca5c9cb1790e6b0f593e84ebb49587a4"}
Jul 15 12:15:45.436768 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.436747    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtw5s" event={"ID":"01891276-45c8-42e0-a0fb-6d775da7b9c5","Type":"ContainerStarted","Data":"8d955c4a1b7bcb9a1062bdce094e158e413ce3b539cad77edbd1da0ad1930f25"}
Jul 15 12:15:45.443802 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.443781    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:45.573021 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:45.572988    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85f55bc854-khq54"]
Jul 15 12:15:45.576054 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:45.576031    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91cfe13c_659c_4826_8fc3_4c4555266737.slice/crio-b6a13edf80da5f7475427e1fa0820b41bc9c7d17fff11256b27d402cc611a2d8 WatchSource:0}: Error finding container b6a13edf80da5f7475427e1fa0820b41bc9c7d17fff11256b27d402cc611a2d8: Status 404 returned error can't find the container with id b6a13edf80da5f7475427e1fa0820b41bc9c7d17fff11256b27d402cc611a2d8
Jul 15 12:15:46.446413 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:46.446251    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b" event={"ID":"c0cda0b2-d65b-4616-9854-8a0500703b02","Type":"ContainerStarted","Data":"31a35c2b55fb55d8950861ea79db27ea1b71bbceabaafd7d49c6f6546383ba54"}
Jul 15 12:15:46.450579 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:46.450099    2571 generic.go:356] "Generic (PLEG): container finished" podID="01891276-45c8-42e0-a0fb-6d775da7b9c5" containerID="bb480e6c4b948f66bfe5596d9eafc1c67ae8788b19f3888d385eebb567eda978" exitCode=0
Jul 15 12:15:46.450579 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:46.450236    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtw5s" event={"ID":"01891276-45c8-42e0-a0fb-6d775da7b9c5","Type":"ContainerDied","Data":"bb480e6c4b948f66bfe5596d9eafc1c67ae8788b19f3888d385eebb567eda978"}
Jul 15 12:15:46.451682 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:46.451656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54" event={"ID":"91cfe13c-659c-4826-8fc3-4c4555266737","Type":"ContainerStarted","Data":"b6a13edf80da5f7475427e1fa0820b41bc9c7d17fff11256b27d402cc611a2d8"}
Jul 15 12:15:47.456313 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.456215    2571 generic.go:356] "Generic (PLEG): container finished" podID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerID="b06dd36e8aef93edc2d4ada9880def42e904de1957b9850266d588e0e07747d2" exitCode=0
Jul 15 12:15:47.456728 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.456304    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerDied","Data":"b06dd36e8aef93edc2d4ada9880def42e904de1957b9850266d588e0e07747d2"}
Jul 15 12:15:47.458561 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.458531    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b" event={"ID":"c0cda0b2-d65b-4616-9854-8a0500703b02","Type":"ContainerStarted","Data":"1d484317f60b02bd25f1f3c3db995501595adbea5a923322d0c3745bd5b70832"}
Jul 15 12:15:47.461069 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.461045    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtw5s" event={"ID":"01891276-45c8-42e0-a0fb-6d775da7b9c5","Type":"ContainerStarted","Data":"6283c88a47e70e0c0c529c461e3301890b714294e7e29c2c8bac6f26c1c76a2c"}
Jul 15 12:15:47.461174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.461104    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtw5s" event={"ID":"01891276-45c8-42e0-a0fb-6d775da7b9c5","Type":"ContainerStarted","Data":"767999f49c48d27020811db3a6b17d043981f099d1ba2114d4411b0d22234a62"}
Jul 15 12:15:47.504752 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.504689    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wtw5s" podStartSLOduration=3.457411208 podStartE2EDuration="4.504671839s" totalImagesPullingTime="944.199591ms" totalInitContainerRuntime="103.06104ms" isStatefulPod=true podCreationTimestamp="2026-07-15 12:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:47.504208731 +0000 UTC m=+274.452237385" watchObservedRunningTime="2026-07-15 12:15:47.504671839 +0000 UTC m=+274.452700492"
Jul 15 12:15:47.522677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.522619    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-n8d6b" podStartSLOduration=2.811207225 podStartE2EDuration="4.522600715s" totalImagesPullingTime="1.71139349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:47.521384375 +0000 UTC m=+274.469413027" watchObservedRunningTime="2026-07-15 12:15:47.522600715 +0000 UTC m=+274.470629366"
Jul 15 12:15:47.918557 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.918521    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"]
Jul 15 12:15:47.927224 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.927193    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:47.930044 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.929848    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 12:15:47.930044 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.929880    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4zw2j\""
Jul 15 12:15:47.930044 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.929950    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"]
Jul 15 12:15:47.986764 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.986660    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvz7t\" (UniqueName: \"kubernetes.io/projected/46696abf-324b-45be-b5fb-339fc3d6a155-kube-api-access-vvz7t\") pod \"monitoring-plugin-5f68df7f58-vqnqz\" (UID: \"46696abf-324b-45be-b5fb-339fc3d6a155\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:47.986971 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:47.986800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46696abf-324b-45be-b5fb-339fc3d6a155-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-vqnqz\" (UID: \"46696abf-324b-45be-b5fb-339fc3d6a155\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:48.087520 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:48.087487    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvz7t\" (UniqueName: \"kubernetes.io/projected/46696abf-324b-45be-b5fb-339fc3d6a155-kube-api-access-vvz7t\") pod \"monitoring-plugin-5f68df7f58-vqnqz\" (UID: \"46696abf-324b-45be-b5fb-339fc3d6a155\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:48.087711 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:48.087601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46696abf-324b-45be-b5fb-339fc3d6a155-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-vqnqz\" (UID: \"46696abf-324b-45be-b5fb-339fc3d6a155\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:48.087784 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:48.087719    2571 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 12:15:48.087833 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:48.087789    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46696abf-324b-45be-b5fb-339fc3d6a155-monitoring-plugin-cert podName:46696abf-324b-45be-b5fb-339fc3d6a155 nodeName:}" failed. No retries permitted until 2026-07-15 12:15:48.587767436 +0000 UTC m=+275.535796079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/46696abf-324b-45be-b5fb-339fc3d6a155-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-vqnqz" (UID: "46696abf-324b-45be-b5fb-339fc3d6a155") : secret "monitoring-plugin-cert" not found
Jul 15 12:15:48.096828 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:48.096801    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvz7t\" (UniqueName: \"kubernetes.io/projected/46696abf-324b-45be-b5fb-339fc3d6a155-kube-api-access-vvz7t\") pod \"monitoring-plugin-5f68df7f58-vqnqz\" (UID: \"46696abf-324b-45be-b5fb-339fc3d6a155\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:48.593870 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:48.593830    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46696abf-324b-45be-b5fb-339fc3d6a155-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-vqnqz\" (UID: \"46696abf-324b-45be-b5fb-339fc3d6a155\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:48.596551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:48.596522    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46696abf-324b-45be-b5fb-339fc3d6a155-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-vqnqz\" (UID: \"46696abf-324b-45be-b5fb-339fc3d6a155\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:48.838699 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:48.838462    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:49.888580 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:49.888506    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"]
Jul 15 12:15:49.891159 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:49.891122    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46696abf_324b_45be_b5fb_339fc3d6a155.slice/crio-1392a7bed3e754b81fdaf792720b2cbcf1e055e7bd05e5cff037d851a17e2bf6 WatchSource:0}: Error finding container 1392a7bed3e754b81fdaf792720b2cbcf1e055e7bd05e5cff037d851a17e2bf6: Status 404 returned error can't find the container with id 1392a7bed3e754b81fdaf792720b2cbcf1e055e7bd05e5cff037d851a17e2bf6
Jul 15 12:15:50.478020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:50.477988    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwmg5" event={"ID":"6583841b-e7ea-4114-be05-b93ac21160e5","Type":"ContainerStarted","Data":"14fd3079809a81a8f2c84e18bc250da0810d6458d58070c1398f2e695ae9ab71"}
Jul 15 12:15:50.480196 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:50.480172    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54" event={"ID":"91cfe13c-659c-4826-8fc3-4c4555266737","Type":"ContainerStarted","Data":"24164dc49e81df3c557a0e2b81216e14065a3cd4722515275c6ca77c56f87836"}
Jul 15 12:15:50.480305 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:50.480241    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54" event={"ID":"91cfe13c-659c-4826-8fc3-4c4555266737","Type":"ContainerStarted","Data":"7f1e870d53c2f2a655bc679ed2272a40edce1b5ec5dc61eccf8de7d1b5a08fbd"}
Jul 15 12:15:50.480305 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:50.480283    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54" event={"ID":"91cfe13c-659c-4826-8fc3-4c4555266737","Type":"ContainerStarted","Data":"19311241680f81063f8069e841c3e97ca1276b738953ff074f1613b9c830ea97"}
Jul 15 12:15:50.481225 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:50.481204    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz" event={"ID":"46696abf-324b-45be-b5fb-339fc3d6a155","Type":"ContainerStarted","Data":"1392a7bed3e754b81fdaf792720b2cbcf1e055e7bd05e5cff037d851a17e2bf6"}
Jul 15 12:15:50.495164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:50.495122    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xwmg5" podStartSLOduration=33.600591451 podStartE2EDuration="47.495108294s" totalImagesPullingTime="13.894516843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:15:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:50.494566377 +0000 UTC m=+277.442595029" watchObservedRunningTime="2026-07-15 12:15:50.495108294 +0000 UTC m=+277.443136944"
Jul 15 12:15:50.602065 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:50.601956    2571 patch_prober.go:28] interesting pod/image-registry-6c5557588b-2bpln container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 12:15:50.602210 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:50.602044    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c5557588b-2bpln" podUID="aaa51f88-e736-4b9b-94b5-8a0fefac89f2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 12:15:51.490428 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.490396    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerStarted","Data":"d70ed67c999e8ff46cb3f1933a437799ced29e5c08365003362626e9a6022b90"}
Jul 15 12:15:51.490895 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.490474    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerStarted","Data":"a7f27f1ca0d093b44bd43b191d892dddc4ab374e39859e4f85e47f15bb39d9f1"}
Jul 15 12:15:51.490895 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.490514    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerStarted","Data":"212bd98059907a34be4707edefa1bca971a76315d619ce49922f43acf574d114"}
Jul 15 12:15:51.490895 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.490555    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerStarted","Data":"4113752a86f7abf1e6ea75edfe3cd4ddee71ef5cac42c1b9d21a811026dfd3e3"}
Jul 15 12:15:51.490895 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.490601    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerStarted","Data":"eb90686ac8a0517aa94b57a65d83d99827e1f9159b52b843c1afc3e250d67b9e"}
Jul 15 12:15:51.490895 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.490638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerStarted","Data":"5f9d1a269708ed1271562a751d1b7200b5e7d928e78a8d13c1a5c1502beaed01"}
Jul 15 12:15:51.493705 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.493674    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54" event={"ID":"91cfe13c-659c-4826-8fc3-4c4555266737","Type":"ContainerStarted","Data":"a59709500325538a870cd15813f82e9c05e8f5e41718af9d9cb3ac113c941b07"}
Jul 15 12:15:51.493861 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.493748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54" event={"ID":"91cfe13c-659c-4826-8fc3-4c4555266737","Type":"ContainerStarted","Data":"ae66a5edf2cd1857d4c2a457d9e226bc05b4300187cfcbb58992c0f918cefb11"}
Jul 15 12:15:51.493861 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.493794    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54" event={"ID":"91cfe13c-659c-4826-8fc3-4c4555266737","Type":"ContainerStarted","Data":"a81c69f3dc1f4333c60898438b8fbdb2d3f5d2305a0a7502c69ac2003dd1e98f"}
Jul 15 12:15:51.521243 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.521184    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.712901726 podStartE2EDuration="7.521168852s" totalImagesPullingTime="4.79196785s" totalInitContainerRuntime="16.299276ms" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:51.519165837 +0000 UTC m=+278.467194498" watchObservedRunningTime="2026-07-15 12:15:51.521168852 +0000 UTC m=+278.469197502"
Jul 15 12:15:51.541811 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:51.541748    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54" podStartSLOduration=1.4837357930000001 podStartE2EDuration="6.541729471s" totalImagesPullingTime="5.057993678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:51.540369565 +0000 UTC m=+278.488398218" watchObservedRunningTime="2026-07-15 12:15:51.541729471 +0000 UTC m=+278.489758162"
Jul 15 12:15:52.378314 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:52.378261    2571 patch_prober.go:28] interesting pod/image-registry-6c5557588b-2bpln container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 12:15:52.378468 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:52.378326    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6c5557588b-2bpln" podUID="aaa51f88-e736-4b9b-94b5-8a0fefac89f2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 12:15:52.498671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:52.498626    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz" event={"ID":"46696abf-324b-45be-b5fb-339fc3d6a155","Type":"ContainerStarted","Data":"0b2af93d252c4067c8f465ea7ca4b64b888d5c5366106f392ed36aafdf5f72b0"}
Jul 15 12:15:52.499116 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:52.498825    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:52.499116 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:52.499013    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:52.503850 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:52.503830    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz"
Jul 15 12:15:52.514984 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:52.514935    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-vqnqz" podStartSLOduration=3.806847341 podStartE2EDuration="5.514921348s" totalImagesPullingTime="1.708074007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:52.514146133 +0000 UTC m=+279.462174784" watchObservedRunningTime="2026-07-15 12:15:52.514921348 +0000 UTC m=+279.462950000"
Jul 15 12:15:56.100133 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:15:56.100066    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-drjhz" podUID="5ce3db41-5447-47d0-8e0f-d7099217a05d"
Jul 15 12:15:56.514485 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:56.514407    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drjhz"
Jul 15 12:15:57.324088 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.324048    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-kxbc6"]
Jul 15 12:15:57.328362 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.328345    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kxbc6"
Jul 15 12:15:57.331013 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.330989    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-72mn8\""
Jul 15 12:15:57.331281 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.331260    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 12:15:57.331360 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.331283    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 12:15:57.337896 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.337870    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kxbc6"]
Jul 15 12:15:57.473503 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.473467    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbgxl\" (UniqueName: \"kubernetes.io/projected/9e3a005b-f1ae-493f-b6f6-0bd4527f3049-kube-api-access-jbgxl\") pod \"downloads-68c9cbb497-kxbc6\" (UID: \"9e3a005b-f1ae-493f-b6f6-0bd4527f3049\") " pod="openshift-console/downloads-68c9cbb497-kxbc6"
Jul 15 12:15:57.574213 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.574126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbgxl\" (UniqueName: \"kubernetes.io/projected/9e3a005b-f1ae-493f-b6f6-0bd4527f3049-kube-api-access-jbgxl\") pod \"downloads-68c9cbb497-kxbc6\" (UID: \"9e3a005b-f1ae-493f-b6f6-0bd4527f3049\") " pod="openshift-console/downloads-68c9cbb497-kxbc6"
Jul 15 12:15:57.583771 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.583739    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbgxl\" (UniqueName: \"kubernetes.io/projected/9e3a005b-f1ae-493f-b6f6-0bd4527f3049-kube-api-access-jbgxl\") pod \"downloads-68c9cbb497-kxbc6\" (UID: \"9e3a005b-f1ae-493f-b6f6-0bd4527f3049\") " pod="openshift-console/downloads-68c9cbb497-kxbc6"
Jul 15 12:15:57.638211 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.638178    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kxbc6"
Jul 15 12:15:57.764212 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:57.764191    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kxbc6"]
Jul 15 12:15:57.766165 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:57.766138    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3a005b_f1ae_493f_b6f6_0bd4527f3049.slice/crio-d3986a26a38b3434911026770fff42a91360534da351f9b910c956f61419f3dd WatchSource:0}: Error finding container d3986a26a38b3434911026770fff42a91360534da351f9b910c956f61419f3dd: Status 404 returned error can't find the container with id d3986a26a38b3434911026770fff42a91360534da351f9b910c956f61419f3dd
Jul 15 12:15:58.510652 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:58.510621    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85f55bc854-khq54"
Jul 15 12:15:58.523647 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:58.523610    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kxbc6" event={"ID":"9e3a005b-f1ae-493f-b6f6-0bd4527f3049","Type":"ContainerStarted","Data":"d3986a26a38b3434911026770fff42a91360534da351f9b910c956f61419f3dd"}
Jul 15 12:15:59.389833 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:59.389801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:15:59.392494 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:59.392460    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ce3db41-5447-47d0-8e0f-d7099217a05d-metrics-tls\") pod \"dns-default-drjhz\" (UID: \"5ce3db41-5447-47d0-8e0f-d7099217a05d\") " pod="openshift-dns/dns-default-drjhz"
Jul 15 12:15:59.518348 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:59.518310    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gfjwd\""
Jul 15 12:15:59.525978 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:59.525954    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drjhz"
Jul 15 12:15:59.678056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:15:59.678028    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-drjhz"]
Jul 15 12:15:59.680059 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:15:59.680029    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce3db41_5447_47d0_8e0f_d7099217a05d.slice/crio-491c82f3dbe29b3ee36afe83ee4401983b64ddfca4396bbeeb09b78acf831409 WatchSource:0}: Error finding container 491c82f3dbe29b3ee36afe83ee4401983b64ddfca4396bbeeb09b78acf831409: Status 404 returned error can't find the container with id 491c82f3dbe29b3ee36afe83ee4401983b64ddfca4396bbeeb09b78acf831409
Jul 15 12:16:00.532863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:00.532816    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-drjhz" event={"ID":"5ce3db41-5447-47d0-8e0f-d7099217a05d","Type":"ContainerStarted","Data":"491c82f3dbe29b3ee36afe83ee4401983b64ddfca4396bbeeb09b78acf831409"}
Jul 15 12:16:00.602561 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:00.602510    2571 patch_prober.go:28] interesting pod/image-registry-6c5557588b-2bpln container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 12:16:00.602785 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:00.602584    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c5557588b-2bpln" podUID="aaa51f88-e736-4b9b-94b5-8a0fefac89f2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 12:16:02.379162 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:02.379133    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c5557588b-2bpln"
Jul 15 12:16:02.544993 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:02.544953    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-drjhz" event={"ID":"5ce3db41-5447-47d0-8e0f-d7099217a05d","Type":"ContainerStarted","Data":"14b3faec42c92c6c1b99cf576bce4711e9781ce8f8d2a4c2e0dc45afe54d82c4"}
Jul 15 12:16:02.545186 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:02.545019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-drjhz" event={"ID":"5ce3db41-5447-47d0-8e0f-d7099217a05d","Type":"ContainerStarted","Data":"aaf9bdfe80db2a731c9a3a37bb6fed034f23ad144d1722ff2e44f8c7ad9a4073"}
Jul 15 12:16:02.545186 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:02.545078    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-drjhz"
Jul 15 12:16:02.565193 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:02.565135    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-drjhz" podStartSLOduration=251.610556202 podStartE2EDuration="4m13.565117019s" totalImagesPullingTime="1.954560817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:16:02.563916066 +0000 UTC m=+289.511944717" watchObservedRunningTime="2026-07-15 12:16:02.565117019 +0000 UTC m=+289.513145670"
Jul 15 12:16:03.299526 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.299487    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-596fdb88dc-f72cm"]
Jul 15 12:16:03.303410 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.303382    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.306660 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.306562    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 12:16:03.306660 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.306639    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 12:16:03.308285 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.308257    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k4498\""
Jul 15 12:16:03.308422 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.308300    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 12:16:03.308422 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.308320    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 12:16:03.308564 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.308546    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 12:16:03.312059 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.312035    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596fdb88dc-f72cm"]
Jul 15 12:16:03.427980 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.427946    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-console-config\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.428448 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.427996    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-serving-cert\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.428448 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.428092    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-oauth-config\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.428448 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.428139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-oauth-serving-cert\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.428448 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.428202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-service-ca\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.428448 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.428308    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snhzz\" (UniqueName: \"kubernetes.io/projected/cb8e1e5b-c114-420c-9603-a959a8923070-kube-api-access-snhzz\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.528811 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.528776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snhzz\" (UniqueName: \"kubernetes.io/projected/cb8e1e5b-c114-420c-9603-a959a8923070-kube-api-access-snhzz\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.529015 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.528828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-console-config\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.529015 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.528871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-serving-cert\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.529015 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.528897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-oauth-config\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.529015 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.528925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-oauth-serving-cert\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.529015 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.528960    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-service-ca\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.529768 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.529739    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-service-ca\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.529967 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.529943    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-oauth-serving-cert\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.529967 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.529958    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-console-config\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.532043 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.532019    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-oauth-config\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.532169 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.532146    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-serving-cert\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.538087 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.538057    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snhzz\" (UniqueName: \"kubernetes.io/projected/cb8e1e5b-c114-420c-9603-a959a8923070-kube-api-access-snhzz\") pod \"console-596fdb88dc-f72cm\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") " pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.615321 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.615213    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:03.785056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:03.784916    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596fdb88dc-f72cm"]
Jul 15 12:16:03.787535 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:16:03.787501    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8e1e5b_c114_420c_9603_a959a8923070.slice/crio-7c63fecc19382919d799d53a702b1c1f9db8ad2c3d85e2956cf1736080aa1034 WatchSource:0}: Error finding container 7c63fecc19382919d799d53a702b1c1f9db8ad2c3d85e2956cf1736080aa1034: Status 404 returned error can't find the container with id 7c63fecc19382919d799d53a702b1c1f9db8ad2c3d85e2956cf1736080aa1034
Jul 15 12:16:04.557368 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:04.557323    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596fdb88dc-f72cm" event={"ID":"cb8e1e5b-c114-420c-9603-a959a8923070","Type":"ContainerStarted","Data":"7c63fecc19382919d799d53a702b1c1f9db8ad2c3d85e2956cf1736080aa1034"}
Jul 15 12:16:07.577658 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:07.577619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596fdb88dc-f72cm" event={"ID":"cb8e1e5b-c114-420c-9603-a959a8923070","Type":"ContainerStarted","Data":"cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d"}
Jul 15 12:16:07.597020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:07.596964    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-596fdb88dc-f72cm" podStartSLOduration=1.016142421 podStartE2EDuration="4.596943477s" totalImagesPullingTime="3.580801056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:16:07.593574681 +0000 UTC m=+294.541603333" watchObservedRunningTime="2026-07-15 12:16:07.596943477 +0000 UTC m=+294.544972127"
Jul 15 12:16:12.553327 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.553277    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-drjhz"
Jul 15 12:16:12.814691 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.814611    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66b6584cb8-wgg9x"]
Jul 15 12:16:12.840222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.840188    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b6584cb8-wgg9x"]
Jul 15 12:16:12.840433 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.840206    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:12.849511 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.849486    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 12:16:12.909494 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.909465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-service-ca\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:12.909670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.909505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrddj\" (UniqueName: \"kubernetes.io/projected/ddfdc94b-e841-4b39-915b-95c9c514a713-kube-api-access-lrddj\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:12.909670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.909541    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-console-config\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:12.909670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.909570    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-oauth-serving-cert\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:12.909670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.909599    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-oauth-config\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:12.909670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.909622    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-trusted-ca-bundle\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:12.909670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:12.909655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-serving-cert\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.010738 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.010700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-service-ca\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.010932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.010756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrddj\" (UniqueName: \"kubernetes.io/projected/ddfdc94b-e841-4b39-915b-95c9c514a713-kube-api-access-lrddj\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.010932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.010781    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-console-config\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.010932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.010805    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-oauth-serving-cert\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.010932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.010826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-oauth-config\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.010932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.010846    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-trusted-ca-bundle\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.011182 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.011072    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-serving-cert\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.011695 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.011649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-console-config\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.011695 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.011649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-oauth-serving-cert\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.011867 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.011830    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-service-ca\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.011984 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.011958    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-trusted-ca-bundle\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.013701 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.013679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-serving-cert\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.013890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.013872    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-oauth-config\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.019030 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.019006    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrddj\" (UniqueName: \"kubernetes.io/projected/ddfdc94b-e841-4b39-915b-95c9c514a713-kube-api-access-lrddj\") pod \"console-66b6584cb8-wgg9x\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") " pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.152410 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.152248    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:13.615814 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.615609    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:13.615814 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.615684    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:13.707119 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:13.627444    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:14.614955 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:14.614916    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:15.807178 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:15.807147    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:16:15.807617 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:15.807443    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:16:15.812594 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:15.812575    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 12:16:15.899198 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:15.899176    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b6584cb8-wgg9x"]
Jul 15 12:16:15.972755 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:16:15.972725    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfdc94b_e841_4b39_915b_95c9c514a713.slice/crio-82b040fec9f0f9f616f4c2bcec8aa4ae1d3f415217259251020ec56ae1cc47f8 WatchSource:0}: Error finding container 82b040fec9f0f9f616f4c2bcec8aa4ae1d3f415217259251020ec56ae1cc47f8: Status 404 returned error can't find the container with id 82b040fec9f0f9f616f4c2bcec8aa4ae1d3f415217259251020ec56ae1cc47f8
Jul 15 12:16:16.621471 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:16.621085    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6584cb8-wgg9x" event={"ID":"ddfdc94b-e841-4b39-915b-95c9c514a713","Type":"ContainerStarted","Data":"ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f"}
Jul 15 12:16:16.621471 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:16.621139    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6584cb8-wgg9x" event={"ID":"ddfdc94b-e841-4b39-915b-95c9c514a713","Type":"ContainerStarted","Data":"82b040fec9f0f9f616f4c2bcec8aa4ae1d3f415217259251020ec56ae1cc47f8"}
Jul 15 12:16:16.622851 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:16.622821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kxbc6" event={"ID":"9e3a005b-f1ae-493f-b6f6-0bd4527f3049","Type":"ContainerStarted","Data":"f210c312debd0a1429db902dba90206fb89efc549e496c80320e9fd465ceeac5"}
Jul 15 12:16:16.622986 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:16.622950    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-kxbc6"
Jul 15 12:16:16.640232 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:16.640200    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-kxbc6"
Jul 15 12:16:16.640785 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:16.640741    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66b6584cb8-wgg9x" podStartSLOduration=4.640726339 podStartE2EDuration="4.640726339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:16:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:16:16.638793825 +0000 UTC m=+303.586822511" watchObservedRunningTime="2026-07-15 12:16:16.640726339 +0000 UTC m=+303.588754992"
Jul 15 12:16:16.655673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:16.655614    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-kxbc6" podStartSLOduration=1.373117281 podStartE2EDuration="19.655585986s" totalImagesPullingTime="18.282468705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:16:16.655373937 +0000 UTC m=+303.603402590" watchObservedRunningTime="2026-07-15 12:16:16.655585986 +0000 UTC m=+303.603614638"
Jul 15 12:16:23.153222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:23.153177    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:23.153828 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:23.153251    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:23.158776 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:23.158748    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:23.660625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:23.660587    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:16:23.709441 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:23.709403    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596fdb88dc-f72cm"]
Jul 15 12:16:48.737409 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:48.737327    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-596fdb88dc-f72cm" podUID="cb8e1e5b-c114-420c-9603-a959a8923070" containerName="console" containerID="cri-o://cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d" gracePeriod=15
Jul 15 12:16:49.046510 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.046475    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:49.247052 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.247015    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-serving-cert\") pod \"cb8e1e5b-c114-420c-9603-a959a8923070\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") "
Jul 15 12:16:49.247052 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.247059    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-console-config\") pod \"cb8e1e5b-c114-420c-9603-a959a8923070\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") "
Jul 15 12:16:49.247331 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.247085    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-oauth-config\") pod \"cb8e1e5b-c114-420c-9603-a959a8923070\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") "
Jul 15 12:16:49.247331 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.247103    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-service-ca\") pod \"cb8e1e5b-c114-420c-9603-a959a8923070\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") "
Jul 15 12:16:49.247331 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.247181    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-oauth-serving-cert\") pod \"cb8e1e5b-c114-420c-9603-a959a8923070\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") "
Jul 15 12:16:49.247331 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.247207    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snhzz\" (UniqueName: \"kubernetes.io/projected/cb8e1e5b-c114-420c-9603-a959a8923070-kube-api-access-snhzz\") pod \"cb8e1e5b-c114-420c-9603-a959a8923070\" (UID: \"cb8e1e5b-c114-420c-9603-a959a8923070\") "
Jul 15 12:16:49.247548 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.247472    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-console-config" (OuterVolumeSpecName: "console-config") pod "cb8e1e5b-c114-420c-9603-a959a8923070" (UID: "cb8e1e5b-c114-420c-9603-a959a8923070"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:16:49.247548 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.247506    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-service-ca" (OuterVolumeSpecName: "service-ca") pod "cb8e1e5b-c114-420c-9603-a959a8923070" (UID: "cb8e1e5b-c114-420c-9603-a959a8923070"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:16:49.247645 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.247542    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cb8e1e5b-c114-420c-9603-a959a8923070" (UID: "cb8e1e5b-c114-420c-9603-a959a8923070"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:16:49.249347 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.249318    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8e1e5b-c114-420c-9603-a959a8923070-kube-api-access-snhzz" (OuterVolumeSpecName: "kube-api-access-snhzz") pod "cb8e1e5b-c114-420c-9603-a959a8923070" (UID: "cb8e1e5b-c114-420c-9603-a959a8923070"). InnerVolumeSpecName "kube-api-access-snhzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:16:49.249588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.249564    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cb8e1e5b-c114-420c-9603-a959a8923070" (UID: "cb8e1e5b-c114-420c-9603-a959a8923070"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:16:49.249588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.249576    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cb8e1e5b-c114-420c-9603-a959a8923070" (UID: "cb8e1e5b-c114-420c-9603-a959a8923070"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:16:49.348175 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.348144    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-serving-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:16:49.348175 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.348174    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-console-config\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:16:49.348418 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.348185    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb8e1e5b-c114-420c-9603-a959a8923070-console-oauth-config\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:16:49.348418 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.348193    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:16:49.348418 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.348201    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e1e5b-c114-420c-9603-a959a8923070-oauth-serving-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:16:49.348418 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.348209    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snhzz\" (UniqueName: \"kubernetes.io/projected/cb8e1e5b-c114-420c-9603-a959a8923070-kube-api-access-snhzz\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:16:49.766785 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.766749    2571 generic.go:356] "Generic (PLEG): container finished" podID="cb8e1e5b-c114-420c-9603-a959a8923070" containerID="cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d" exitCode=0
Jul 15 12:16:49.767211 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.766805    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596fdb88dc-f72cm" event={"ID":"cb8e1e5b-c114-420c-9603-a959a8923070","Type":"ContainerDied","Data":"cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d"}
Jul 15 12:16:49.767211 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.766868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596fdb88dc-f72cm" event={"ID":"cb8e1e5b-c114-420c-9603-a959a8923070","Type":"ContainerDied","Data":"7c63fecc19382919d799d53a702b1c1f9db8ad2c3d85e2956cf1736080aa1034"}
Jul 15 12:16:49.767211 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.766807    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596fdb88dc-f72cm"
Jul 15 12:16:49.767211 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.766887    2571 scope.go:117] "RemoveContainer" containerID="cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d"
Jul 15 12:16:49.775255 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.775237    2571 scope.go:117] "RemoveContainer" containerID="cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d"
Jul 15 12:16:49.775559 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:16:49.775535    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d\": container with ID starting with cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d not found: ID does not exist" containerID="cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d"
Jul 15 12:16:49.775645 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.775566    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d"} err="failed to get container status \"cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d\": rpc error: code = NotFound desc = could not find container \"cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d\": container with ID starting with cfd255163769fbe7d21cadad29cd0c82c7bf05aea1880ba3b55e7ea10ea2807d not found: ID does not exist"
Jul 15 12:16:49.786916 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.786892    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596fdb88dc-f72cm"]
Jul 15 12:16:49.789219 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:49.789196    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-596fdb88dc-f72cm"]
Jul 15 12:16:51.626002 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:16:51.625969    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb8e1e5b-c114-420c-9603-a959a8923070" path="/var/lib/kubelet/pods/cb8e1e5b-c114-420c-9603-a959a8923070/volumes"
Jul 15 12:17:00.347550 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.347515    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66dfb9d665-rzxz9"]
Jul 15 12:17:00.348021 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.347835    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8e1e5b-c114-420c-9603-a959a8923070" containerName="console"
Jul 15 12:17:00.348021 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.347845    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8e1e5b-c114-420c-9603-a959a8923070" containerName="console"
Jul 15 12:17:00.348021 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.347901    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8e1e5b-c114-420c-9603-a959a8923070" containerName="console"
Jul 15 12:17:00.382103 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.382068    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dfb9d665-rzxz9"]
Jul 15 12:17:00.382268 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.382187    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.440576 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.440538    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-oauth-serving-cert\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.440576 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.440582    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jcq\" (UniqueName: \"kubernetes.io/projected/091e55d9-ec51-417c-893c-31990940ce23-kube-api-access-b8jcq\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.440792 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.440671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-serving-cert\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.440792 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.440710    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-oauth-config\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.440792 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.440730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-trusted-ca-bundle\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.440884 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.440799    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-service-ca\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.440884 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.440821    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-console-config\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.542027 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.541984    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-oauth-serving-cert\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.542027 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.542031    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jcq\" (UniqueName: \"kubernetes.io/projected/091e55d9-ec51-417c-893c-31990940ce23-kube-api-access-b8jcq\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.542280 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.542080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-serving-cert\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.542280 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.542110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-oauth-config\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.542280 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.542127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-trusted-ca-bundle\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.542280 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.542149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-service-ca\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.542280 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.542170    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-console-config\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.542872 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.542840    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-oauth-serving-cert\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.542872 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.542854    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-console-config\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.543020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.542856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-service-ca\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.543193 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.543167    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-trusted-ca-bundle\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.544789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.544757    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-serving-cert\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.544789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.544774    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-oauth-config\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.550455 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.550430    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jcq\" (UniqueName: \"kubernetes.io/projected/091e55d9-ec51-417c-893c-31990940ce23-kube-api-access-b8jcq\") pod \"console-66dfb9d665-rzxz9\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") " pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.690754 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.690662    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:00.857541 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:00.857515    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dfb9d665-rzxz9"]
Jul 15 12:17:00.860013 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:17:00.859987    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091e55d9_ec51_417c_893c_31990940ce23.slice/crio-86aba3c9ce0ef181e63a447f54469e77802d36eb772af235041d1fb904b85e9f WatchSource:0}: Error finding container 86aba3c9ce0ef181e63a447f54469e77802d36eb772af235041d1fb904b85e9f: Status 404 returned error can't find the container with id 86aba3c9ce0ef181e63a447f54469e77802d36eb772af235041d1fb904b85e9f
Jul 15 12:17:01.818476 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:01.818431    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dfb9d665-rzxz9" event={"ID":"091e55d9-ec51-417c-893c-31990940ce23","Type":"ContainerStarted","Data":"8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc"}
Jul 15 12:17:01.818874 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:01.818492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dfb9d665-rzxz9" event={"ID":"091e55d9-ec51-417c-893c-31990940ce23","Type":"ContainerStarted","Data":"86aba3c9ce0ef181e63a447f54469e77802d36eb772af235041d1fb904b85e9f"}
Jul 15 12:17:01.835390 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:01.835328    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66dfb9d665-rzxz9" podStartSLOduration=1.835311499 podStartE2EDuration="1.835311499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:17:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:17:01.835189566 +0000 UTC m=+348.783218208" watchObservedRunningTime="2026-07-15 12:17:01.835311499 +0000 UTC m=+348.783340140"
Jul 15 12:17:03.421963 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.421924    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:17:03.422396 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.422207    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="alertmanager" containerID="cri-o://5f9d1a269708ed1271562a751d1b7200b5e7d928e78a8d13c1a5c1502beaed01" gracePeriod=120
Jul 15 12:17:03.422396 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.422281    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy-metric" containerID="cri-o://a7f27f1ca0d093b44bd43b191d892dddc4ab374e39859e4f85e47f15bb39d9f1" gracePeriod=120
Jul 15 12:17:03.422396 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.422340    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="prom-label-proxy" containerID="cri-o://d70ed67c999e8ff46cb3f1933a437799ced29e5c08365003362626e9a6022b90" gracePeriod=120
Jul 15 12:17:03.422396 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.422353    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy-web" containerID="cri-o://4113752a86f7abf1e6ea75edfe3cd4ddee71ef5cac42c1b9d21a811026dfd3e3" gracePeriod=120
Jul 15 12:17:03.422624 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.422374    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy" containerID="cri-o://212bd98059907a34be4707edefa1bca971a76315d619ce49922f43acf574d114" gracePeriod=120
Jul 15 12:17:03.422624 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.422546    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="config-reloader" containerID="cri-o://eb90686ac8a0517aa94b57a65d83d99827e1f9159b52b843c1afc3e250d67b9e" gracePeriod=120
Jul 15 12:17:03.829940 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.829906    2571 generic.go:356] "Generic (PLEG): container finished" podID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerID="d70ed67c999e8ff46cb3f1933a437799ced29e5c08365003362626e9a6022b90" exitCode=0
Jul 15 12:17:03.829940 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.829932    2571 generic.go:356] "Generic (PLEG): container finished" podID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerID="212bd98059907a34be4707edefa1bca971a76315d619ce49922f43acf574d114" exitCode=0
Jul 15 12:17:03.829940 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.829938    2571 generic.go:356] "Generic (PLEG): container finished" podID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerID="eb90686ac8a0517aa94b57a65d83d99827e1f9159b52b843c1afc3e250d67b9e" exitCode=0
Jul 15 12:17:03.829940 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.829944    2571 generic.go:356] "Generic (PLEG): container finished" podID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerID="5f9d1a269708ed1271562a751d1b7200b5e7d928e78a8d13c1a5c1502beaed01" exitCode=0
Jul 15 12:17:03.830222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.829975    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerDied","Data":"d70ed67c999e8ff46cb3f1933a437799ced29e5c08365003362626e9a6022b90"}
Jul 15 12:17:03.830222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.830047    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerDied","Data":"212bd98059907a34be4707edefa1bca971a76315d619ce49922f43acf574d114"}
Jul 15 12:17:03.830222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.830076    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerDied","Data":"eb90686ac8a0517aa94b57a65d83d99827e1f9159b52b843c1afc3e250d67b9e"}
Jul 15 12:17:03.830222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:03.830100    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerDied","Data":"5f9d1a269708ed1271562a751d1b7200b5e7d928e78a8d13c1a5c1502beaed01"}
Jul 15 12:17:04.836841 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:04.836804    2571 generic.go:356] "Generic (PLEG): container finished" podID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerID="a7f27f1ca0d093b44bd43b191d892dddc4ab374e39859e4f85e47f15bb39d9f1" exitCode=0
Jul 15 12:17:04.836841 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:04.836833    2571 generic.go:356] "Generic (PLEG): container finished" podID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerID="4113752a86f7abf1e6ea75edfe3cd4ddee71ef5cac42c1b9d21a811026dfd3e3" exitCode=0
Jul 15 12:17:04.837230 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:04.836871    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerDied","Data":"a7f27f1ca0d093b44bd43b191d892dddc4ab374e39859e4f85e47f15bb39d9f1"}
Jul 15 12:17:04.837230 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:04.836954    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerDied","Data":"4113752a86f7abf1e6ea75edfe3cd4ddee71ef5cac42c1b9d21a811026dfd3e3"}
Jul 15 12:17:05.196474 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.196403    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.286179 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286148    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-tls-assets\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286359 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286199    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286359 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286230    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-metrics-client-ca\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286439 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286409    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-cluster-tls-config\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286481 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286459    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-web-config\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286515 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286484    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-volume\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286564 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286515    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286564 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286553    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-web\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286662 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286584    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-main-db\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286662 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286614    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nkth\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-kube-api-access-6nkth\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286662 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286639    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:05.286662 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286657    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-trusted-ca-bundle\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286854 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286713    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-main-tls\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.286854 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286745    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-out\") pod \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\" (UID: \"ca214bcf-38e6-4228-8ab5-88c5b15ab052\") "
Jul 15 12:17:05.287659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.286978    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:05.287659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.287365    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:17:05.287659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.287447    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-main-db\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.287659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.287466    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.287659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.287482    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca214bcf-38e6-4228-8ab5-88c5b15ab052-metrics-client-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.289461 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.289431    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:05.290316 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.290275    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-volume" (OuterVolumeSpecName: "config-volume") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:05.290615 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.290583    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:05.290710 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.290590    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:17:05.290710 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.290656    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-out" (OuterVolumeSpecName: "config-out") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:17:05.290710 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.290655    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:05.291104 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.290950    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-kube-api-access-6nkth" (OuterVolumeSpecName: "kube-api-access-6nkth") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "kube-api-access-6nkth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:17:05.291438 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.291415    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:05.293834 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.293809    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:05.300740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.300720    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-web-config" (OuterVolumeSpecName: "web-config") pod "ca214bcf-38e6-4228-8ab5-88c5b15ab052" (UID: "ca214bcf-38e6-4228-8ab5-88c5b15ab052"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387863    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-web-config\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387891    2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-volume\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387901    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387910    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387920    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nkth\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-kube-api-access-6nkth\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387931    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-main-tls\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387939    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca214bcf-38e6-4228-8ab5-88c5b15ab052-config-out\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387946    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca214bcf-38e6-4228-8ab5-88c5b15ab052-tls-assets\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387954    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.387951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.387961    2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca214bcf-38e6-4228-8ab5-88c5b15ab052-cluster-tls-config\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:05.844349 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.844310    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca214bcf-38e6-4228-8ab5-88c5b15ab052","Type":"ContainerDied","Data":"58787dcaa3fac9c42cce5e84677f083218a06e47d7708ff248168c37a875cca9"}
Jul 15 12:17:05.844349 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.844348    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.844791 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.844411    2571 scope.go:117] "RemoveContainer" containerID="d70ed67c999e8ff46cb3f1933a437799ced29e5c08365003362626e9a6022b90"
Jul 15 12:17:05.851971 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.851953    2571 scope.go:117] "RemoveContainer" containerID="a7f27f1ca0d093b44bd43b191d892dddc4ab374e39859e4f85e47f15bb39d9f1"
Jul 15 12:17:05.859593 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.859571    2571 scope.go:117] "RemoveContainer" containerID="212bd98059907a34be4707edefa1bca971a76315d619ce49922f43acf574d114"
Jul 15 12:17:05.866621 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.866602    2571 scope.go:117] "RemoveContainer" containerID="4113752a86f7abf1e6ea75edfe3cd4ddee71ef5cac42c1b9d21a811026dfd3e3"
Jul 15 12:17:05.869163 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.869141    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:17:05.873882 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.873857    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:17:05.874754 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.874739    2571 scope.go:117] "RemoveContainer" containerID="eb90686ac8a0517aa94b57a65d83d99827e1f9159b52b843c1afc3e250d67b9e"
Jul 15 12:17:05.882011 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.881996    2571 scope.go:117] "RemoveContainer" containerID="5f9d1a269708ed1271562a751d1b7200b5e7d928e78a8d13c1a5c1502beaed01"
Jul 15 12:17:05.889121 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.889104    2571 scope.go:117] "RemoveContainer" containerID="b06dd36e8aef93edc2d4ada9880def42e904de1957b9850266d588e0e07747d2"
Jul 15 12:17:05.903410 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903388    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:17:05.903683 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903672    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="alertmanager"
Jul 15 12:17:05.903729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903685    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="alertmanager"
Jul 15 12:17:05.903729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903698    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="prom-label-proxy"
Jul 15 12:17:05.903729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903704    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="prom-label-proxy"
Jul 15 12:17:05.903729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903714    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="init-config-reloader"
Jul 15 12:17:05.903729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903720    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="init-config-reloader"
Jul 15 12:17:05.903729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903727    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903733    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903742    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy-web"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903747    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy-web"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903756    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy-metric"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903761    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy-metric"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903767    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="config-reloader"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903772    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="config-reloader"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903818    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="alertmanager"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903825    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903832    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="config-reloader"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903848    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy-metric"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903853    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="kube-rbac-proxy-web"
Jul 15 12:17:05.903920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.903857    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" containerName="prom-label-proxy"
Jul 15 12:17:05.923117 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.923091    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:17:05.923237 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.923225    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.926244 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.926223    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 12:17:05.926395 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.926258    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 12:17:05.926567 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.926551    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 12:17:05.926778 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.926762    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 12:17:05.926840 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.926803    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 12:17:05.927067 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.927053    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 12:17:05.927163 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.927077    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 12:17:05.927163 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.927077    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hzsp4\""
Jul 15 12:17:05.927163 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.927121    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 12:17:05.932584 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.932560    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 12:17:05.995097 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995046    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7351d82-6c0f-4687-b7ae-4a417757759e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7351d82-6c0f-4687-b7ae-4a417757759e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995145    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995176    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995199    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995223    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995489 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995277    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995489 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995489 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995360    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7351d82-6c0f-4687-b7ae-4a417757759e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995489 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5nvv\" (UniqueName: \"kubernetes.io/projected/b7351d82-6c0f-4687-b7ae-4a417757759e-kube-api-access-l5nvv\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995489 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7351d82-6c0f-4687-b7ae-4a417757759e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995489 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995468    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7351d82-6c0f-4687-b7ae-4a417757759e-config-out\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:05.995489 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:05.995485    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-web-config\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.096763 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.096683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.096763 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.096724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.096763 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.096743    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.096763 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.096762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.096784    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.096833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7351d82-6c0f-4687-b7ae-4a417757759e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.096858    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5nvv\" (UniqueName: \"kubernetes.io/projected/b7351d82-6c0f-4687-b7ae-4a417757759e-kube-api-access-l5nvv\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.097000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7351d82-6c0f-4687-b7ae-4a417757759e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.097058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7351d82-6c0f-4687-b7ae-4a417757759e-config-out\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.097086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-web-config\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097409 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.097112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7351d82-6c0f-4687-b7ae-4a417757759e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097409 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.097142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7351d82-6c0f-4687-b7ae-4a417757759e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097409 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.097193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.097409 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.097226    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7351d82-6c0f-4687-b7ae-4a417757759e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.098246 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.097961    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7351d82-6c0f-4687-b7ae-4a417757759e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.099866 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.099838    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.099977 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.099865    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-web-config\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.099977 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.099925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.100081 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.100002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.100081 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.100036    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.100180 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.100098    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.100459 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.100439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7351d82-6c0f-4687-b7ae-4a417757759e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.100574 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.100523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7351d82-6c0f-4687-b7ae-4a417757759e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.100817 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.100798    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7351d82-6c0f-4687-b7ae-4a417757759e-config-out\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.101837 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.101817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7351d82-6c0f-4687-b7ae-4a417757759e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.105174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.105154    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5nvv\" (UniqueName: \"kubernetes.io/projected/b7351d82-6c0f-4687-b7ae-4a417757759e-kube-api-access-l5nvv\") pod \"alertmanager-main-0\" (UID: \"b7351d82-6c0f-4687-b7ae-4a417757759e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.233856 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.233825    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:17:06.382577 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.382499    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:17:06.385835 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:17:06.385805    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7351d82_6c0f_4687_b7ae_4a417757759e.slice/crio-a50d3fe0d5a7d277067bd7f5dd313718c5b2826f53d31ca8d3220d2cc8cfde3e WatchSource:0}: Error finding container a50d3fe0d5a7d277067bd7f5dd313718c5b2826f53d31ca8d3220d2cc8cfde3e: Status 404 returned error can't find the container with id a50d3fe0d5a7d277067bd7f5dd313718c5b2826f53d31ca8d3220d2cc8cfde3e
Jul 15 12:17:06.850983 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.850952    2571 generic.go:356] "Generic (PLEG): container finished" podID="b7351d82-6c0f-4687-b7ae-4a417757759e" containerID="db46a2c4edb554c286d783e0b72e65b1dbb6f9a09c6c58283b9177649f49083f" exitCode=0
Jul 15 12:17:06.851373 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.850994    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7351d82-6c0f-4687-b7ae-4a417757759e","Type":"ContainerDied","Data":"db46a2c4edb554c286d783e0b72e65b1dbb6f9a09c6c58283b9177649f49083f"}
Jul 15 12:17:06.851373 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:06.851047    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7351d82-6c0f-4687-b7ae-4a417757759e","Type":"ContainerStarted","Data":"a50d3fe0d5a7d277067bd7f5dd313718c5b2826f53d31ca8d3220d2cc8cfde3e"}
Jul 15 12:17:07.626678 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:07.626641    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca214bcf-38e6-4228-8ab5-88c5b15ab052" path="/var/lib/kubelet/pods/ca214bcf-38e6-4228-8ab5-88c5b15ab052/volumes"
Jul 15 12:17:07.859240 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:07.859207    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7351d82-6c0f-4687-b7ae-4a417757759e","Type":"ContainerStarted","Data":"28208e3ff1cdad6a58536ed6407eaeb32635db82a0bdd19f141d93af55303b2a"}
Jul 15 12:17:07.859694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:07.859285    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7351d82-6c0f-4687-b7ae-4a417757759e","Type":"ContainerStarted","Data":"8fa9f722ef0e00c98ddc8df558c5f8a7fd53b40e4ca6391aadb50c9f7df1395b"}
Jul 15 12:17:07.859694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:07.859349    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7351d82-6c0f-4687-b7ae-4a417757759e","Type":"ContainerStarted","Data":"32fd0ded8f500cf3913638a8e4cbd15fab2fe5e948931438e574bdd4a7cfea56"}
Jul 15 12:17:07.859694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:07.859393    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7351d82-6c0f-4687-b7ae-4a417757759e","Type":"ContainerStarted","Data":"847307a0e01d9f7d6364604692bef6c8a8bbda88dc051a30f69e559495de7a27"}
Jul 15 12:17:07.859694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:07.859437    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7351d82-6c0f-4687-b7ae-4a417757759e","Type":"ContainerStarted","Data":"b38ba772e42081d161ce6604eea71c26195c5751835d55e614fb4cb6b411395a"}
Jul 15 12:17:07.859694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:07.859474    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7351d82-6c0f-4687-b7ae-4a417757759e","Type":"ContainerStarted","Data":"1952a04d31bdd19cda778626783f5244c48c436e08bf78cdc91b0ea22913d4f5"}
Jul 15 12:17:07.886616 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:07.886514    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.871722825 podStartE2EDuration="2.886498781s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.775956ms" isStatefulPod=false podCreationTimestamp="2026-07-15 12:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:17:07.886180762 +0000 UTC m=+354.834209412" watchObservedRunningTime="2026-07-15 12:17:07.886498781 +0000 UTC m=+354.834527426"
Jul 15 12:17:10.690869 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:10.690837    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:10.691264 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:10.690888    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:10.695330 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:10.695301    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:10.877297 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:10.877260    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:17:10.925468 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:10.925437    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b6584cb8-wgg9x"]
Jul 15 12:17:35.950573 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:35.950534    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66b6584cb8-wgg9x" podUID="ddfdc94b-e841-4b39-915b-95c9c514a713" containerName="console" containerID="cri-o://ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f" gracePeriod=15
Jul 15 12:17:36.210682 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.210622    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:17:36.259154 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.259122    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-oauth-serving-cert\") pod \"ddfdc94b-e841-4b39-915b-95c9c514a713\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") "
Jul 15 12:17:36.259154 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.259160    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-serving-cert\") pod \"ddfdc94b-e841-4b39-915b-95c9c514a713\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") "
Jul 15 12:17:36.259412 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.259179    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-oauth-config\") pod \"ddfdc94b-e841-4b39-915b-95c9c514a713\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") "
Jul 15 12:17:36.259412 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.259208    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-service-ca\") pod \"ddfdc94b-e841-4b39-915b-95c9c514a713\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") "
Jul 15 12:17:36.259412 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.259246    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-console-config\") pod \"ddfdc94b-e841-4b39-915b-95c9c514a713\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") "
Jul 15 12:17:36.259412 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.259323    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-trusted-ca-bundle\") pod \"ddfdc94b-e841-4b39-915b-95c9c514a713\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") "
Jul 15 12:17:36.259412 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.259349    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrddj\" (UniqueName: \"kubernetes.io/projected/ddfdc94b-e841-4b39-915b-95c9c514a713-kube-api-access-lrddj\") pod \"ddfdc94b-e841-4b39-915b-95c9c514a713\" (UID: \"ddfdc94b-e841-4b39-915b-95c9c514a713\") "
Jul 15 12:17:36.259677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.259522    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ddfdc94b-e841-4b39-915b-95c9c514a713" (UID: "ddfdc94b-e841-4b39-915b-95c9c514a713"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:36.259677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.259630    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-oauth-serving-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:36.260339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.260134    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-service-ca" (OuterVolumeSpecName: "service-ca") pod "ddfdc94b-e841-4b39-915b-95c9c514a713" (UID: "ddfdc94b-e841-4b39-915b-95c9c514a713"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:36.260339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.260281    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-console-config" (OuterVolumeSpecName: "console-config") pod "ddfdc94b-e841-4b39-915b-95c9c514a713" (UID: "ddfdc94b-e841-4b39-915b-95c9c514a713"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:36.260339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.260306    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ddfdc94b-e841-4b39-915b-95c9c514a713" (UID: "ddfdc94b-e841-4b39-915b-95c9c514a713"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:17:36.266530 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.262660    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ddfdc94b-e841-4b39-915b-95c9c514a713" (UID: "ddfdc94b-e841-4b39-915b-95c9c514a713"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:36.266649 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.266616    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddfdc94b-e841-4b39-915b-95c9c514a713-kube-api-access-lrddj" (OuterVolumeSpecName: "kube-api-access-lrddj") pod "ddfdc94b-e841-4b39-915b-95c9c514a713" (UID: "ddfdc94b-e841-4b39-915b-95c9c514a713"). InnerVolumeSpecName "kube-api-access-lrddj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:17:36.266649 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.266620    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ddfdc94b-e841-4b39-915b-95c9c514a713" (UID: "ddfdc94b-e841-4b39-915b-95c9c514a713"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:17:36.360697 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.360659    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-console-config\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:36.360697 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.360689    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-trusted-ca-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:36.360697 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.360701    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrddj\" (UniqueName: \"kubernetes.io/projected/ddfdc94b-e841-4b39-915b-95c9c514a713-kube-api-access-lrddj\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:36.360924 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.360711    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-serving-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:36.360924 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.360720    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfdc94b-e841-4b39-915b-95c9c514a713-console-oauth-config\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:36.360924 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.360735    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfdc94b-e841-4b39-915b-95c9c514a713-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:17:36.979598 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.979562    2571 generic.go:356] "Generic (PLEG): container finished" podID="ddfdc94b-e841-4b39-915b-95c9c514a713" containerID="ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f" exitCode=0
Jul 15 12:17:36.980032 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.979620    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6584cb8-wgg9x"
Jul 15 12:17:36.980032 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.979631    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6584cb8-wgg9x" event={"ID":"ddfdc94b-e841-4b39-915b-95c9c514a713","Type":"ContainerDied","Data":"ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f"}
Jul 15 12:17:36.980032 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.979671    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6584cb8-wgg9x" event={"ID":"ddfdc94b-e841-4b39-915b-95c9c514a713","Type":"ContainerDied","Data":"82b040fec9f0f9f616f4c2bcec8aa4ae1d3f415217259251020ec56ae1cc47f8"}
Jul 15 12:17:36.980032 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.979690    2571 scope.go:117] "RemoveContainer" containerID="ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f"
Jul 15 12:17:36.988100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.988083    2571 scope.go:117] "RemoveContainer" containerID="ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f"
Jul 15 12:17:36.988376 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:17:36.988355    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f\": container with ID starting with ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f not found: ID does not exist" containerID="ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f"
Jul 15 12:17:36.988446 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:36.988388    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f"} err="failed to get container status \"ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f\": rpc error: code = NotFound desc = could not find container \"ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f\": container with ID starting with ac14d4105ca81dee851ac118d38c3647d7a4e475a098bbdf54f75353e2514c4f not found: ID does not exist"
Jul 15 12:17:37.000216 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:37.000191    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b6584cb8-wgg9x"]
Jul 15 12:17:37.006180 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:37.006149    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66b6584cb8-wgg9x"]
Jul 15 12:17:37.626052 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:17:37.626020    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddfdc94b-e841-4b39-915b-95c9c514a713" path="/var/lib/kubelet/pods/ddfdc94b-e841-4b39-915b-95c9c514a713/volumes"
Jul 15 12:18:04.004770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.004735    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"]
Jul 15 12:18:04.005138 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.005085    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddfdc94b-e841-4b39-915b-95c9c514a713" containerName="console"
Jul 15 12:18:04.005138 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.005096    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddfdc94b-e841-4b39-915b-95c9c514a713" containerName="console"
Jul 15 12:18:04.005228 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.005166    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddfdc94b-e841-4b39-915b-95c9c514a713" containerName="console"
Jul 15 12:18:04.008217 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.008197    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.011403 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.011380    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 12:18:04.011552 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.011426    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 12:18:04.012624 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.012594    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vsmqr\""
Jul 15 12:18:04.020028 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.020003    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"]
Jul 15 12:18:04.086430 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.086398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.086625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.086479    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.086625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.086530    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96x67\" (UniqueName: \"kubernetes.io/projected/850d9870-468b-470c-b7b6-5e95c662ee17-kube-api-access-96x67\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.186988 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.186945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.187150 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.187000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96x67\" (UniqueName: \"kubernetes.io/projected/850d9870-468b-470c-b7b6-5e95c662ee17-kube-api-access-96x67\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.187150 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.187024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.187381 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.187363    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.187420 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.187389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.196062 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.196028    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96x67\" (UniqueName: \"kubernetes.io/projected/850d9870-468b-470c-b7b6-5e95c662ee17-kube-api-access-96x67\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.317334 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.317284    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:04.450640 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.450614    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"]
Jul 15 12:18:04.452623 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:18:04.452595    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850d9870_468b_470c_b7b6_5e95c662ee17.slice/crio-e4de1132997344f854b6df4865d6555eef473edfa3f2ef29480cd2f41b17d3fd WatchSource:0}: Error finding container e4de1132997344f854b6df4865d6555eef473edfa3f2ef29480cd2f41b17d3fd: Status 404 returned error can't find the container with id e4de1132997344f854b6df4865d6555eef473edfa3f2ef29480cd2f41b17d3fd
Jul 15 12:18:04.454909 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:04.454889    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:18:05.091689 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:05.091652    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv" event={"ID":"850d9870-468b-470c-b7b6-5e95c662ee17","Type":"ContainerStarted","Data":"e4de1132997344f854b6df4865d6555eef473edfa3f2ef29480cd2f41b17d3fd"}
Jul 15 12:18:14.133713 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:14.133674    2571 generic.go:356] "Generic (PLEG): container finished" podID="850d9870-468b-470c-b7b6-5e95c662ee17" containerID="8d21e374503b95692fe027ad71fa02a128d2d257f86c90df1b799b94999d549a" exitCode=0
Jul 15 12:18:14.134126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:14.133728    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv" event={"ID":"850d9870-468b-470c-b7b6-5e95c662ee17","Type":"ContainerDied","Data":"8d21e374503b95692fe027ad71fa02a128d2d257f86c90df1b799b94999d549a"}
Jul 15 12:18:17.150191 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:17.150141    2571 generic.go:356] "Generic (PLEG): container finished" podID="850d9870-468b-470c-b7b6-5e95c662ee17" containerID="c6146f3d2d1d40d76ee691ed49579a198f22b81aa6824682d6fec0c2143e6bbd" exitCode=0
Jul 15 12:18:17.150579 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:17.150213    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv" event={"ID":"850d9870-468b-470c-b7b6-5e95c662ee17","Type":"ContainerDied","Data":"c6146f3d2d1d40d76ee691ed49579a198f22b81aa6824682d6fec0c2143e6bbd"}
Jul 15 12:18:25.191057 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:25.191016    2571 generic.go:356] "Generic (PLEG): container finished" podID="850d9870-468b-470c-b7b6-5e95c662ee17" containerID="deff19bf2608edce62c28cf9376105d35ef577bd27944a2a296bc3cd95e13fc5" exitCode=0
Jul 15 12:18:25.191525 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:25.191082    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv" event={"ID":"850d9870-468b-470c-b7b6-5e95c662ee17","Type":"ContainerDied","Data":"deff19bf2608edce62c28cf9376105d35ef577bd27944a2a296bc3cd95e13fc5"}
Jul 15 12:18:26.362363 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.362328    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:26.486789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.486702    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-bundle\") pod \"850d9870-468b-470c-b7b6-5e95c662ee17\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") "
Jul 15 12:18:26.486789 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.486757    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-util\") pod \"850d9870-468b-470c-b7b6-5e95c662ee17\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") "
Jul 15 12:18:26.487021 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.486834    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96x67\" (UniqueName: \"kubernetes.io/projected/850d9870-468b-470c-b7b6-5e95c662ee17-kube-api-access-96x67\") pod \"850d9870-468b-470c-b7b6-5e95c662ee17\" (UID: \"850d9870-468b-470c-b7b6-5e95c662ee17\") "
Jul 15 12:18:26.487441 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.487414    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-bundle" (OuterVolumeSpecName: "bundle") pod "850d9870-468b-470c-b7b6-5e95c662ee17" (UID: "850d9870-468b-470c-b7b6-5e95c662ee17"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:18:26.488975 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.488951    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/850d9870-468b-470c-b7b6-5e95c662ee17-kube-api-access-96x67" (OuterVolumeSpecName: "kube-api-access-96x67") pod "850d9870-468b-470c-b7b6-5e95c662ee17" (UID: "850d9870-468b-470c-b7b6-5e95c662ee17"). InnerVolumeSpecName "kube-api-access-96x67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:18:26.490913 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.490892    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-util" (OuterVolumeSpecName: "util") pod "850d9870-468b-470c-b7b6-5e95c662ee17" (UID: "850d9870-468b-470c-b7b6-5e95c662ee17"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:18:26.588164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.588118    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96x67\" (UniqueName: \"kubernetes.io/projected/850d9870-468b-470c-b7b6-5e95c662ee17-kube-api-access-96x67\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:18:26.588164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.588155    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:18:26.588164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:26.588164    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/850d9870-468b-470c-b7b6-5e95c662ee17-util\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:18:27.200666 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:27.200633    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv" event={"ID":"850d9870-468b-470c-b7b6-5e95c662ee17","Type":"ContainerDied","Data":"e4de1132997344f854b6df4865d6555eef473edfa3f2ef29480cd2f41b17d3fd"}
Jul 15 12:18:27.200666 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:27.200653    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405jwtv"
Jul 15 12:18:27.200858 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:27.200684    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4de1132997344f854b6df4865d6555eef473edfa3f2ef29480cd2f41b17d3fd"
Jul 15 12:18:31.961841 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.961806    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"]
Jul 15 12:18:31.962238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.962120    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="850d9870-468b-470c-b7b6-5e95c662ee17" containerName="pull"
Jul 15 12:18:31.962238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.962131    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="850d9870-468b-470c-b7b6-5e95c662ee17" containerName="pull"
Jul 15 12:18:31.962238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.962155    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="850d9870-468b-470c-b7b6-5e95c662ee17" containerName="util"
Jul 15 12:18:31.962238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.962160    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="850d9870-468b-470c-b7b6-5e95c662ee17" containerName="util"
Jul 15 12:18:31.962238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.962168    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="850d9870-468b-470c-b7b6-5e95c662ee17" containerName="extract"
Jul 15 12:18:31.962238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.962174    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="850d9870-468b-470c-b7b6-5e95c662ee17" containerName="extract"
Jul 15 12:18:31.962238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.962217    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="850d9870-468b-470c-b7b6-5e95c662ee17" containerName="extract"
Jul 15 12:18:31.964512 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.964496    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"
Jul 15 12:18:31.967428 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.967406    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zvfd6\""
Jul 15 12:18:31.967553 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.967406    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:18:31.967553 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.967462    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 15 12:18:31.979603 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:31.979578    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"]
Jul 15 12:18:32.139214 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:32.139178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3554987-d2f1-455d-ad7b-4183d0532c75-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rs4pk\" (UID: \"d3554987-d2f1-455d-ad7b-4183d0532c75\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"
Jul 15 12:18:32.139402 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:32.139249    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjb7f\" (UniqueName: \"kubernetes.io/projected/d3554987-d2f1-455d-ad7b-4183d0532c75-kube-api-access-tjb7f\") pod \"cert-manager-operator-controller-manager-55c444bf86-rs4pk\" (UID: \"d3554987-d2f1-455d-ad7b-4183d0532c75\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"
Jul 15 12:18:32.240317 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:32.240204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjb7f\" (UniqueName: \"kubernetes.io/projected/d3554987-d2f1-455d-ad7b-4183d0532c75-kube-api-access-tjb7f\") pod \"cert-manager-operator-controller-manager-55c444bf86-rs4pk\" (UID: \"d3554987-d2f1-455d-ad7b-4183d0532c75\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"
Jul 15 12:18:32.240317 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:32.240256    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3554987-d2f1-455d-ad7b-4183d0532c75-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rs4pk\" (UID: \"d3554987-d2f1-455d-ad7b-4183d0532c75\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"
Jul 15 12:18:32.240617 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:32.240587    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3554987-d2f1-455d-ad7b-4183d0532c75-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rs4pk\" (UID: \"d3554987-d2f1-455d-ad7b-4183d0532c75\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"
Jul 15 12:18:32.249824 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:32.249800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjb7f\" (UniqueName: \"kubernetes.io/projected/d3554987-d2f1-455d-ad7b-4183d0532c75-kube-api-access-tjb7f\") pod \"cert-manager-operator-controller-manager-55c444bf86-rs4pk\" (UID: \"d3554987-d2f1-455d-ad7b-4183d0532c75\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"
Jul 15 12:18:32.273409 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:32.273382    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"
Jul 15 12:18:32.406066 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:32.406039    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk"]
Jul 15 12:18:32.408609 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:18:32.408576    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3554987_d2f1_455d_ad7b_4183d0532c75.slice/crio-6abc057f705caf0dfbc0c6e07a8f4c3b8e802c45af669464e1cd3285572340e6 WatchSource:0}: Error finding container 6abc057f705caf0dfbc0c6e07a8f4c3b8e802c45af669464e1cd3285572340e6: Status 404 returned error can't find the container with id 6abc057f705caf0dfbc0c6e07a8f4c3b8e802c45af669464e1cd3285572340e6
Jul 15 12:18:33.229920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:33.229868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk" event={"ID":"d3554987-d2f1-455d-ad7b-4183d0532c75","Type":"ContainerStarted","Data":"6abc057f705caf0dfbc0c6e07a8f4c3b8e802c45af669464e1cd3285572340e6"}
Jul 15 12:18:34.236914 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:34.236868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk" event={"ID":"d3554987-d2f1-455d-ad7b-4183d0532c75","Type":"ContainerStarted","Data":"b807d86a03cb291f29e5ce1005b388166a302be90c1a2c7a8039c081bf6234b9"}
Jul 15 12:18:34.266677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:34.266628    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rs4pk" podStartSLOduration=1.58885791 podStartE2EDuration="3.266612073s" totalImagesPullingTime="1.677754163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:18:34.265196789 +0000 UTC m=+441.213225442" watchObservedRunningTime="2026-07-15 12:18:34.266612073 +0000 UTC m=+441.214640724"
Jul 15 12:18:35.685972 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.685878    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"]
Jul 15 12:18:35.688324 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.688282    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.691679 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.691658    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vsmqr\""
Jul 15 12:18:35.691893 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.691878    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 12:18:35.693055 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.693039    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 12:18:35.706549 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.706522    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"]
Jul 15 12:18:35.769348 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.769314    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.769509 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.769398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.769509 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.769458    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cr89\" (UniqueName: \"kubernetes.io/projected/7294b767-122a-4209-8cdc-4119a9894621-kube-api-access-7cr89\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.870257 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.870221    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cr89\" (UniqueName: \"kubernetes.io/projected/7294b767-122a-4209-8cdc-4119a9894621-kube-api-access-7cr89\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.870422 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.870271    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.870422 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.870333    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.870704 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.870683    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.870745 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.870695    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.881867 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.881836    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cr89\" (UniqueName: \"kubernetes.io/projected/7294b767-122a-4209-8cdc-4119a9894621-kube-api-access-7cr89\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:35.997797 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:35.997706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:36.123502 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:36.123469    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"]
Jul 15 12:18:36.126987 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:18:36.126954    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7294b767_122a_4209_8cdc_4119a9894621.slice/crio-1a5576130edf960e9d6721b23d5c5509c8cfa88cbda1cf08696ec2069dba571b WatchSource:0}: Error finding container 1a5576130edf960e9d6721b23d5c5509c8cfa88cbda1cf08696ec2069dba571b: Status 404 returned error can't find the container with id 1a5576130edf960e9d6721b23d5c5509c8cfa88cbda1cf08696ec2069dba571b
Jul 15 12:18:36.253757 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:36.253661    2571 generic.go:356] "Generic (PLEG): container finished" podID="7294b767-122a-4209-8cdc-4119a9894621" containerID="124a60dc599dbf4b4d76f920ebc16492a38913c468d13f433191b261e77771b3" exitCode=0
Jul 15 12:18:36.253757 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:36.253693    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf" event={"ID":"7294b767-122a-4209-8cdc-4119a9894621","Type":"ContainerDied","Data":"124a60dc599dbf4b4d76f920ebc16492a38913c468d13f433191b261e77771b3"}
Jul 15 12:18:36.253757 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:36.253753    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf" event={"ID":"7294b767-122a-4209-8cdc-4119a9894621","Type":"ContainerStarted","Data":"1a5576130edf960e9d6721b23d5c5509c8cfa88cbda1cf08696ec2069dba571b"}
Jul 15 12:18:38.265733 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:38.265698    2571 generic.go:356] "Generic (PLEG): container finished" podID="7294b767-122a-4209-8cdc-4119a9894621" containerID="902b4f3b4be07d3dd81b8174c46b2baff2cd6f069fbe77fde4c7e2229ca52e5b" exitCode=0
Jul 15 12:18:38.266093 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:38.265777    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf" event={"ID":"7294b767-122a-4209-8cdc-4119a9894621","Type":"ContainerDied","Data":"902b4f3b4be07d3dd81b8174c46b2baff2cd6f069fbe77fde4c7e2229ca52e5b"}
Jul 15 12:18:39.272111 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:39.272078    2571 generic.go:356] "Generic (PLEG): container finished" podID="7294b767-122a-4209-8cdc-4119a9894621" containerID="14378756b1ae80cf7a9959182b339caabffb660061cc36bf7909878cde04275f" exitCode=0
Jul 15 12:18:39.272596 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:39.272177    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf" event={"ID":"7294b767-122a-4209-8cdc-4119a9894621","Type":"ContainerDied","Data":"14378756b1ae80cf7a9959182b339caabffb660061cc36bf7909878cde04275f"}
Jul 15 12:18:40.399150 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.399128    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:40.402820 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.402793    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-util\") pod \"7294b767-122a-4209-8cdc-4119a9894621\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") "
Jul 15 12:18:40.402938 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.402869    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-bundle\") pod \"7294b767-122a-4209-8cdc-4119a9894621\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") "
Jul 15 12:18:40.402938 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.402923    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cr89\" (UniqueName: \"kubernetes.io/projected/7294b767-122a-4209-8cdc-4119a9894621-kube-api-access-7cr89\") pod \"7294b767-122a-4209-8cdc-4119a9894621\" (UID: \"7294b767-122a-4209-8cdc-4119a9894621\") "
Jul 15 12:18:40.403268 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.403230    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-bundle" (OuterVolumeSpecName: "bundle") pod "7294b767-122a-4209-8cdc-4119a9894621" (UID: "7294b767-122a-4209-8cdc-4119a9894621"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:18:40.404917 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.404895    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7294b767-122a-4209-8cdc-4119a9894621-kube-api-access-7cr89" (OuterVolumeSpecName: "kube-api-access-7cr89") pod "7294b767-122a-4209-8cdc-4119a9894621" (UID: "7294b767-122a-4209-8cdc-4119a9894621"). InnerVolumeSpecName "kube-api-access-7cr89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:18:40.408017 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.407994    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-util" (OuterVolumeSpecName: "util") pod "7294b767-122a-4209-8cdc-4119a9894621" (UID: "7294b767-122a-4209-8cdc-4119a9894621"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:18:40.504097 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.504049    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:18:40.504097 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.504084    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cr89\" (UniqueName: \"kubernetes.io/projected/7294b767-122a-4209-8cdc-4119a9894621-kube-api-access-7cr89\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:18:40.504097 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:40.504093    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7294b767-122a-4209-8cdc-4119a9894621-util\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:18:41.283533 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:41.283500    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf" event={"ID":"7294b767-122a-4209-8cdc-4119a9894621","Type":"ContainerDied","Data":"1a5576130edf960e9d6721b23d5c5509c8cfa88cbda1cf08696ec2069dba571b"}
Jul 15 12:18:41.283703 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:41.283552    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a5576130edf960e9d6721b23d5c5509c8cfa88cbda1cf08696ec2069dba571b"
Jul 15 12:18:41.283703 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:41.283510    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr24rf"
Jul 15 12:18:48.279904 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.279875    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"]
Jul 15 12:18:48.280282 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.280205    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7294b767-122a-4209-8cdc-4119a9894621" containerName="pull"
Jul 15 12:18:48.280282 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.280219    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7294b767-122a-4209-8cdc-4119a9894621" containerName="pull"
Jul 15 12:18:48.280282 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.280242    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7294b767-122a-4209-8cdc-4119a9894621" containerName="util"
Jul 15 12:18:48.280282 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.280247    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7294b767-122a-4209-8cdc-4119a9894621" containerName="util"
Jul 15 12:18:48.280282 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.280255    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7294b767-122a-4209-8cdc-4119a9894621" containerName="extract"
Jul 15 12:18:48.280282 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.280260    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7294b767-122a-4209-8cdc-4119a9894621" containerName="extract"
Jul 15 12:18:48.280499 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.280325    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7294b767-122a-4209-8cdc-4119a9894621" containerName="extract"
Jul 15 12:18:48.282455 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.282440    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"
Jul 15 12:18:48.285513 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.285491    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:18:48.285630 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.285611    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 12:18:48.287083 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.287062    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vzssv\""
Jul 15 12:18:48.291575 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.291552    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"]
Jul 15 12:18:48.369223 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.369186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30b38ee4-e21b-4c49-b1a2-f3ac2357ab61-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tqjxg\" (UID: \"30b38ee4-e21b-4c49-b1a2-f3ac2357ab61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"
Jul 15 12:18:48.369450 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.369281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcm5w\" (UniqueName: \"kubernetes.io/projected/30b38ee4-e21b-4c49-b1a2-f3ac2357ab61-kube-api-access-kcm5w\") pod \"openshift-lws-operator-fd8ccff4c-tqjxg\" (UID: \"30b38ee4-e21b-4c49-b1a2-f3ac2357ab61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"
Jul 15 12:18:48.469877 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.469840    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm5w\" (UniqueName: \"kubernetes.io/projected/30b38ee4-e21b-4c49-b1a2-f3ac2357ab61-kube-api-access-kcm5w\") pod \"openshift-lws-operator-fd8ccff4c-tqjxg\" (UID: \"30b38ee4-e21b-4c49-b1a2-f3ac2357ab61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"
Jul 15 12:18:48.470081 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.469899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30b38ee4-e21b-4c49-b1a2-f3ac2357ab61-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tqjxg\" (UID: \"30b38ee4-e21b-4c49-b1a2-f3ac2357ab61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"
Jul 15 12:18:48.470270 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.470250    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30b38ee4-e21b-4c49-b1a2-f3ac2357ab61-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tqjxg\" (UID: \"30b38ee4-e21b-4c49-b1a2-f3ac2357ab61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"
Jul 15 12:18:48.479468 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.479444    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcm5w\" (UniqueName: \"kubernetes.io/projected/30b38ee4-e21b-4c49-b1a2-f3ac2357ab61-kube-api-access-kcm5w\") pod \"openshift-lws-operator-fd8ccff4c-tqjxg\" (UID: \"30b38ee4-e21b-4c49-b1a2-f3ac2357ab61\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"
Jul 15 12:18:48.604769 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.604734    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"
Jul 15 12:18:48.732047 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:48.732020    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg"]
Jul 15 12:18:48.733722 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:18:48.733692    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30b38ee4_e21b_4c49_b1a2_f3ac2357ab61.slice/crio-0d6252e32b96c30ed87ca97a6cc2fe30a9391f7e517be5d737835dd8cddd3e9c WatchSource:0}: Error finding container 0d6252e32b96c30ed87ca97a6cc2fe30a9391f7e517be5d737835dd8cddd3e9c: Status 404 returned error can't find the container with id 0d6252e32b96c30ed87ca97a6cc2fe30a9391f7e517be5d737835dd8cddd3e9c
Jul 15 12:18:49.322480 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:49.322445    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg" event={"ID":"30b38ee4-e21b-4c49-b1a2-f3ac2357ab61","Type":"ContainerStarted","Data":"0d6252e32b96c30ed87ca97a6cc2fe30a9391f7e517be5d737835dd8cddd3e9c"}
Jul 15 12:18:51.335014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:51.334979    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg" event={"ID":"30b38ee4-e21b-4c49-b1a2-f3ac2357ab61","Type":"ContainerStarted","Data":"d84f069125daefa3ca3242e92fbc149a44b8cb25fe210cf008d99c6bd2837e12"}
Jul 15 12:18:51.352547 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:51.352493    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tqjxg" podStartSLOduration=1.678276292 podStartE2EDuration="3.352477046s" totalImagesPullingTime="1.674200754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:18:51.351832797 +0000 UTC m=+458.299861447" watchObservedRunningTime="2026-07-15 12:18:51.352477046 +0000 UTC m=+458.300505697"
Jul 15 12:18:54.402745 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.402712    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"]
Jul 15 12:18:54.409000 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.408983    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.412453 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.412424    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 12:18:54.413395 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.413372    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 12:18:54.413511 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.413416    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vsmqr\""
Jul 15 12:18:54.414008 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.413985    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"]
Jul 15 12:18:54.522976 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.522948    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.523151 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.523011    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.523151 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.523062    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w7s5\" (UniqueName: \"kubernetes.io/projected/2a85aff0-00af-4490-b065-103fa78474e0-kube-api-access-8w7s5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.624403 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.624358    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.624403 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.624402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w7s5\" (UniqueName: \"kubernetes.io/projected/2a85aff0-00af-4490-b065-103fa78474e0-kube-api-access-8w7s5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.624660 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.624449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.624717 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.624703    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.624768 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.624732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.632621 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.632599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w7s5\" (UniqueName: \"kubernetes.io/projected/2a85aff0-00af-4490-b065-103fa78474e0-kube-api-access-8w7s5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.719352 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.719241    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:54.866262 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:54.866231    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"]
Jul 15 12:18:54.867910 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:18:54.867885    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a85aff0_00af_4490_b065_103fa78474e0.slice/crio-41b326349c0eb47770e0d0422cb1698beb763b69d9008d290979c64d6c3f4004 WatchSource:0}: Error finding container 41b326349c0eb47770e0d0422cb1698beb763b69d9008d290979c64d6c3f4004: Status 404 returned error can't find the container with id 41b326349c0eb47770e0d0422cb1698beb763b69d9008d290979c64d6c3f4004
Jul 15 12:18:55.354670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:55.354634    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a85aff0-00af-4490-b065-103fa78474e0" containerID="0c294f1418d6cbe7dc5857de2fb6ddd3151e4e9b468b25381d58bdda368c6ed7" exitCode=0
Jul 15 12:18:55.354670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:55.354668    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq" event={"ID":"2a85aff0-00af-4490-b065-103fa78474e0","Type":"ContainerDied","Data":"0c294f1418d6cbe7dc5857de2fb6ddd3151e4e9b468b25381d58bdda368c6ed7"}
Jul 15 12:18:55.354931 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:55.354717    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq" event={"ID":"2a85aff0-00af-4490-b065-103fa78474e0","Type":"ContainerStarted","Data":"41b326349c0eb47770e0d0422cb1698beb763b69d9008d290979c64d6c3f4004"}
Jul 15 12:18:57.364863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:57.364827    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a85aff0-00af-4490-b065-103fa78474e0" containerID="4ec5162fb63db4de934dfdc6dfe5de6e642aaea38a28654d31a6d5600f3fdff7" exitCode=0
Jul 15 12:18:57.365273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:57.364916    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq" event={"ID":"2a85aff0-00af-4490-b065-103fa78474e0","Type":"ContainerDied","Data":"4ec5162fb63db4de934dfdc6dfe5de6e642aaea38a28654d31a6d5600f3fdff7"}
Jul 15 12:18:58.371691 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:58.371653    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a85aff0-00af-4490-b065-103fa78474e0" containerID="650f571076bdea37ed5f155785bcf4a917598eaf3af970afe75528577204117d" exitCode=0
Jul 15 12:18:58.372074 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:58.371721    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq" event={"ID":"2a85aff0-00af-4490-b065-103fa78474e0","Type":"ContainerDied","Data":"650f571076bdea37ed5f155785bcf4a917598eaf3af970afe75528577204117d"}
Jul 15 12:18:59.505019 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.504994    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:18:59.569245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.569207    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-util\") pod \"2a85aff0-00af-4490-b065-103fa78474e0\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") "
Jul 15 12:18:59.569461 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.569265    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-bundle\") pod \"2a85aff0-00af-4490-b065-103fa78474e0\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") "
Jul 15 12:18:59.569461 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.569328    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w7s5\" (UniqueName: \"kubernetes.io/projected/2a85aff0-00af-4490-b065-103fa78474e0-kube-api-access-8w7s5\") pod \"2a85aff0-00af-4490-b065-103fa78474e0\" (UID: \"2a85aff0-00af-4490-b065-103fa78474e0\") "
Jul 15 12:18:59.570028 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.569995    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-bundle" (OuterVolumeSpecName: "bundle") pod "2a85aff0-00af-4490-b065-103fa78474e0" (UID: "2a85aff0-00af-4490-b065-103fa78474e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:18:59.571498 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.571468    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a85aff0-00af-4490-b065-103fa78474e0-kube-api-access-8w7s5" (OuterVolumeSpecName: "kube-api-access-8w7s5") pod "2a85aff0-00af-4490-b065-103fa78474e0" (UID: "2a85aff0-00af-4490-b065-103fa78474e0"). InnerVolumeSpecName "kube-api-access-8w7s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:18:59.574643 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.574612    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-util" (OuterVolumeSpecName: "util") pod "2a85aff0-00af-4490-b065-103fa78474e0" (UID: "2a85aff0-00af-4490-b065-103fa78474e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:18:59.670884 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.670852    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:18:59.670884 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.670884    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w7s5\" (UniqueName: \"kubernetes.io/projected/2a85aff0-00af-4490-b065-103fa78474e0-kube-api-access-8w7s5\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:18:59.671149 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:18:59.670896    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a85aff0-00af-4490-b065-103fa78474e0-util\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:19:00.382189 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:00.382143    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq" event={"ID":"2a85aff0-00af-4490-b065-103fa78474e0","Type":"ContainerDied","Data":"41b326349c0eb47770e0d0422cb1698beb763b69d9008d290979c64d6c3f4004"}
Jul 15 12:19:00.382189 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:00.382183    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgm5wq"
Jul 15 12:19:00.382431 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:00.382201    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41b326349c0eb47770e0d0422cb1698beb763b69d9008d290979c64d6c3f4004"
Jul 15 12:19:12.226032 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.225997    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"]
Jul 15 12:19:12.226517 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.226335    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a85aff0-00af-4490-b065-103fa78474e0" containerName="pull"
Jul 15 12:19:12.226517 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.226346    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a85aff0-00af-4490-b065-103fa78474e0" containerName="pull"
Jul 15 12:19:12.226517 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.226359    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a85aff0-00af-4490-b065-103fa78474e0" containerName="extract"
Jul 15 12:19:12.226517 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.226364    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a85aff0-00af-4490-b065-103fa78474e0" containerName="extract"
Jul 15 12:19:12.226517 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.226372    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a85aff0-00af-4490-b065-103fa78474e0" containerName="util"
Jul 15 12:19:12.226517 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.226378    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a85aff0-00af-4490-b065-103fa78474e0" containerName="util"
Jul 15 12:19:12.226517 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.226435    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a85aff0-00af-4490-b065-103fa78474e0" containerName="extract"
Jul 15 12:19:12.230600 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.230583    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.234201 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.234179    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b7chz\""
Jul 15 12:19:12.234503 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.234486    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 12:19:12.234847 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.234826    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 12:19:12.234847 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.234845    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 12:19:12.234991 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.234827    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 12:19:12.248914 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.248890    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"]
Jul 15 12:19:12.380447 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.380414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71a101ef-6051-408e-8357-0e85bb124e55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.380625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.380455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71a101ef-6051-408e-8357-0e85bb124e55-webhook-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.380625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.380501    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71a101ef-6051-408e-8357-0e85bb124e55-tmp\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.380625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.380571    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqz8z\" (UniqueName: \"kubernetes.io/projected/71a101ef-6051-408e-8357-0e85bb124e55-kube-api-access-hqz8z\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.380625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.380616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71a101ef-6051-408e-8357-0e85bb124e55-manifests\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.481804 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.481704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71a101ef-6051-408e-8357-0e85bb124e55-tmp\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.481804 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.481752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqz8z\" (UniqueName: \"kubernetes.io/projected/71a101ef-6051-408e-8357-0e85bb124e55-kube-api-access-hqz8z\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.482031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.481869    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71a101ef-6051-408e-8357-0e85bb124e55-manifests\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.482031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.481903    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71a101ef-6051-408e-8357-0e85bb124e55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.482031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.481937    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71a101ef-6051-408e-8357-0e85bb124e55-webhook-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.482277 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.482252    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71a101ef-6051-408e-8357-0e85bb124e55-manifests\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.483993 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.483966    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71a101ef-6051-408e-8357-0e85bb124e55-tmp\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.484222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.484205    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71a101ef-6051-408e-8357-0e85bb124e55-webhook-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.484263 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.484239    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71a101ef-6051-408e-8357-0e85bb124e55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.493943 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.493919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqz8z\" (UniqueName: \"kubernetes.io/projected/71a101ef-6051-408e-8357-0e85bb124e55-kube-api-access-hqz8z\") pod \"opendatahub-operator-controller-manager-85d97db8bc-bz7z6\" (UID: \"71a101ef-6051-408e-8357-0e85bb124e55\") " pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.541237 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.541199    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:12.675804 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:12.675781    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"]
Jul 15 12:19:12.677187 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:19:12.677161    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a101ef_6051_408e_8357_0e85bb124e55.slice/crio-7451cb2193c7e8161adb57d0a25b1a1d480e996d39b97487caa463bda930c92c WatchSource:0}: Error finding container 7451cb2193c7e8161adb57d0a25b1a1d480e996d39b97487caa463bda930c92c: Status 404 returned error can't find the container with id 7451cb2193c7e8161adb57d0a25b1a1d480e996d39b97487caa463bda930c92c
Jul 15 12:19:13.449843 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:13.449808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6" event={"ID":"71a101ef-6051-408e-8357-0e85bb124e55","Type":"ContainerStarted","Data":"7451cb2193c7e8161adb57d0a25b1a1d480e996d39b97487caa463bda930c92c"}
Jul 15 12:19:16.468349 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:16.468307    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6" event={"ID":"71a101ef-6051-408e-8357-0e85bb124e55","Type":"ContainerStarted","Data":"a03bead88fe5b2382310e41c35a5fe7da218aad317c230d0189e9b8c03cdeefc"}
Jul 15 12:19:17.477067 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:17.477030    2571 generic.go:356] "Generic (PLEG): container finished" podID="71a101ef-6051-408e-8357-0e85bb124e55" containerID="a03bead88fe5b2382310e41c35a5fe7da218aad317c230d0189e9b8c03cdeefc" exitCode=0
Jul 15 12:19:17.477521 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:17.477085    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6" event={"ID":"71a101ef-6051-408e-8357-0e85bb124e55","Type":"ContainerDied","Data":"a03bead88fe5b2382310e41c35a5fe7da218aad317c230d0189e9b8c03cdeefc"}
Jul 15 12:19:18.483946 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:18.483913    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6" event={"ID":"71a101ef-6051-408e-8357-0e85bb124e55","Type":"ContainerStarted","Data":"76eba0aa603c6019256ab23ca2981e5793a8bef5a0bdc1c8c9d50b1ebcf1ee48"}
Jul 15 12:19:18.484389 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:18.484032    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:18.508823 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:18.508772    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6" podStartSLOduration=2.203736858 podStartE2EDuration="6.508753915s" totalImagesPullingTime="3.288727997s" totalInitContainerRuntime="1.01628906s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:19:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:19:18.507485425 +0000 UTC m=+485.455514077" watchObservedRunningTime="2026-07-15 12:19:18.508753915 +0000 UTC m=+485.456782566"
Jul 15 12:19:29.490444 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:29.490412    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85d97db8bc-bz7z6"
Jul 15 12:19:31.974404 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:31.974361    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tlmkb"]
Jul 15 12:19:31.982820 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:31.982789    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:31.986333 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:31.986106    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 12:19:31.986333 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:31.986160    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bv5g5\""
Jul 15 12:19:31.988205 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:31.988184    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tlmkb"]
Jul 15 12:19:32.044157 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.044122    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfpcs\" (UniqueName: \"kubernetes.io/projected/e9977c25-0acd-4edc-b8e8-3b1f9fac789e-kube-api-access-gfpcs\") pod \"odh-model-controller-7998c67dc4-tlmkb\" (UID: \"e9977c25-0acd-4edc-b8e8-3b1f9fac789e\") " pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:32.044348 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.044204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9977c25-0acd-4edc-b8e8-3b1f9fac789e-cert\") pod \"odh-model-controller-7998c67dc4-tlmkb\" (UID: \"e9977c25-0acd-4edc-b8e8-3b1f9fac789e\") " pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:32.145063 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.145031    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9977c25-0acd-4edc-b8e8-3b1f9fac789e-cert\") pod \"odh-model-controller-7998c67dc4-tlmkb\" (UID: \"e9977c25-0acd-4edc-b8e8-3b1f9fac789e\") " pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:32.145261 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.145075    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfpcs\" (UniqueName: \"kubernetes.io/projected/e9977c25-0acd-4edc-b8e8-3b1f9fac789e-kube-api-access-gfpcs\") pod \"odh-model-controller-7998c67dc4-tlmkb\" (UID: \"e9977c25-0acd-4edc-b8e8-3b1f9fac789e\") " pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:32.145261 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:19:32.145225    2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 15 12:19:32.145392 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:19:32.145327    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9977c25-0acd-4edc-b8e8-3b1f9fac789e-cert podName:e9977c25-0acd-4edc-b8e8-3b1f9fac789e nodeName:}" failed. No retries permitted until 2026-07-15 12:19:32.645281697 +0000 UTC m=+499.593310340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e9977c25-0acd-4edc-b8e8-3b1f9fac789e-cert") pod "odh-model-controller-7998c67dc4-tlmkb" (UID: "e9977c25-0acd-4edc-b8e8-3b1f9fac789e") : secret "odh-model-controller-webhook-cert" not found
Jul 15 12:19:32.164539 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.164502    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfpcs\" (UniqueName: \"kubernetes.io/projected/e9977c25-0acd-4edc-b8e8-3b1f9fac789e-kube-api-access-gfpcs\") pod \"odh-model-controller-7998c67dc4-tlmkb\" (UID: \"e9977c25-0acd-4edc-b8e8-3b1f9fac789e\") " pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:32.628648 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.628613    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5qhb5"]
Jul 15 12:19:32.632018 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.632000    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:32.635649 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.635626    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 12:19:32.644327 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.644285    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5qhb5"]
Jul 15 12:19:32.650081 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.650057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9977c25-0acd-4edc-b8e8-3b1f9fac789e-cert\") pod \"odh-model-controller-7998c67dc4-tlmkb\" (UID: \"e9977c25-0acd-4edc-b8e8-3b1f9fac789e\") " pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:32.650206 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.650102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5wpz\" (UniqueName: \"kubernetes.io/projected/67a12d95-032a-4ae6-a8a0-0c5c98047c2c-kube-api-access-z5wpz\") pod \"model-serving-api-54d89bd5fc-5qhb5\" (UID: \"67a12d95-032a-4ae6-a8a0-0c5c98047c2c\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:32.650206 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.650161    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a12d95-032a-4ae6-a8a0-0c5c98047c2c-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qhb5\" (UID: \"67a12d95-032a-4ae6-a8a0-0c5c98047c2c\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:32.652553 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.652528    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9977c25-0acd-4edc-b8e8-3b1f9fac789e-cert\") pod \"odh-model-controller-7998c67dc4-tlmkb\" (UID: \"e9977c25-0acd-4edc-b8e8-3b1f9fac789e\") " pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:32.751191 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.751153    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5wpz\" (UniqueName: \"kubernetes.io/projected/67a12d95-032a-4ae6-a8a0-0c5c98047c2c-kube-api-access-z5wpz\") pod \"model-serving-api-54d89bd5fc-5qhb5\" (UID: \"67a12d95-032a-4ae6-a8a0-0c5c98047c2c\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:32.751404 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.751229    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a12d95-032a-4ae6-a8a0-0c5c98047c2c-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qhb5\" (UID: \"67a12d95-032a-4ae6-a8a0-0c5c98047c2c\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:32.751404 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:19:32.751349    2571 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 15 12:19:32.751481 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:19:32.751405    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67a12d95-032a-4ae6-a8a0-0c5c98047c2c-tls-certs podName:67a12d95-032a-4ae6-a8a0-0c5c98047c2c nodeName:}" failed. No retries permitted until 2026-07-15 12:19:33.251386439 +0000 UTC m=+500.199415068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/67a12d95-032a-4ae6-a8a0-0c5c98047c2c-tls-certs") pod "model-serving-api-54d89bd5fc-5qhb5" (UID: "67a12d95-032a-4ae6-a8a0-0c5c98047c2c") : secret "model-serving-api-tls" not found
Jul 15 12:19:32.760346 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.760316    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5wpz\" (UniqueName: \"kubernetes.io/projected/67a12d95-032a-4ae6-a8a0-0c5c98047c2c-kube-api-access-z5wpz\") pod \"model-serving-api-54d89bd5fc-5qhb5\" (UID: \"67a12d95-032a-4ae6-a8a0-0c5c98047c2c\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:32.894333 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:32.894212    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:33.023795 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:33.023772    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tlmkb"]
Jul 15 12:19:33.025511 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:19:33.025481    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9977c25_0acd_4edc_b8e8_3b1f9fac789e.slice/crio-23deba4811e299312713a26f4ce5b3cf4ba21de7e14722d065fa59f1f799c613 WatchSource:0}: Error finding container 23deba4811e299312713a26f4ce5b3cf4ba21de7e14722d065fa59f1f799c613: Status 404 returned error can't find the container with id 23deba4811e299312713a26f4ce5b3cf4ba21de7e14722d065fa59f1f799c613
Jul 15 12:19:33.253586 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:33.253480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a12d95-032a-4ae6-a8a0-0c5c98047c2c-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qhb5\" (UID: \"67a12d95-032a-4ae6-a8a0-0c5c98047c2c\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:33.255863 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:33.255837    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a12d95-032a-4ae6-a8a0-0c5c98047c2c-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qhb5\" (UID: \"67a12d95-032a-4ae6-a8a0-0c5c98047c2c\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:33.543431 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:33.543334    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:33.556790 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:33.556761    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb" event={"ID":"e9977c25-0acd-4edc-b8e8-3b1f9fac789e","Type":"ContainerStarted","Data":"23deba4811e299312713a26f4ce5b3cf4ba21de7e14722d065fa59f1f799c613"}
Jul 15 12:19:33.684599 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:33.684571    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5qhb5"]
Jul 15 12:19:33.686409 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:19:33.686386    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a12d95_032a_4ae6_a8a0_0c5c98047c2c.slice/crio-3a151bd173dee35f8c23336fcc998db0ca1ad8e7b3df983e773595b5c8f06a4b WatchSource:0}: Error finding container 3a151bd173dee35f8c23336fcc998db0ca1ad8e7b3df983e773595b5c8f06a4b: Status 404 returned error can't find the container with id 3a151bd173dee35f8c23336fcc998db0ca1ad8e7b3df983e773595b5c8f06a4b
Jul 15 12:19:34.572688 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:34.572642    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5" event={"ID":"67a12d95-032a-4ae6-a8a0-0c5c98047c2c","Type":"ContainerStarted","Data":"3a151bd173dee35f8c23336fcc998db0ca1ad8e7b3df983e773595b5c8f06a4b"}
Jul 15 12:19:37.590602 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:37.590569    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb" event={"ID":"e9977c25-0acd-4edc-b8e8-3b1f9fac789e","Type":"ContainerStarted","Data":"c1b46d926f92be4a484e23e79148189c9ba7ba1ca91ffcd7b376b3d86d530dae"}
Jul 15 12:19:37.591044 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:37.590690    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:37.592263 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:37.592231    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5" event={"ID":"67a12d95-032a-4ae6-a8a0-0c5c98047c2c","Type":"ContainerStarted","Data":"ec81686f9aa6b765c786f9b26caa349fcd57bd4a093f3092a465f0927d4edc37"}
Jul 15 12:19:37.592422 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:37.592308    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:37.609235 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:37.609185    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb" podStartSLOduration=2.991606722 podStartE2EDuration="6.609170414s" totalImagesPullingTime="3.617563692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:19:37.60912256 +0000 UTC m=+504.557151212" watchObservedRunningTime="2026-07-15 12:19:37.609170414 +0000 UTC m=+504.557199065"
Jul 15 12:19:37.626715 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:37.626674    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5" podStartSLOduration=2.734221819 podStartE2EDuration="5.62665847s" totalImagesPullingTime="2.892436651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:19:37.62548496 +0000 UTC m=+504.573513624" watchObservedRunningTime="2026-07-15 12:19:37.62665847 +0000 UTC m=+504.574687120"
Jul 15 12:19:39.438314 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.437759    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"]
Jul 15 12:19:39.443607 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.443580    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.446578 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.446553    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 12:19:39.448189 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.448167    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 12:19:39.448189 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.448171    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 12:19:39.448417 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.448172    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7xzqk\""
Jul 15 12:19:39.451229 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.451208    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"]
Jul 15 12:19:39.515181 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.515149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghxg\" (UniqueName: \"kubernetes.io/projected/775f3bd1-7205-4193-be5c-5922ae8ff6c8-kube-api-access-cghxg\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.515391 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.515211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/775f3bd1-7205-4193-be5c-5922ae8ff6c8-cert\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.515391 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.515258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/775f3bd1-7205-4193-be5c-5922ae8ff6c8-metrics-cert\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.515391 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.515283    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/775f3bd1-7205-4193-be5c-5922ae8ff6c8-manager-config\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.616058 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.616027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/775f3bd1-7205-4193-be5c-5922ae8ff6c8-cert\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.616263 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.616070    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/775f3bd1-7205-4193-be5c-5922ae8ff6c8-metrics-cert\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.616263 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.616089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/775f3bd1-7205-4193-be5c-5922ae8ff6c8-manager-config\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.616263 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.616141    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghxg\" (UniqueName: \"kubernetes.io/projected/775f3bd1-7205-4193-be5c-5922ae8ff6c8-kube-api-access-cghxg\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.616889 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.616856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/775f3bd1-7205-4193-be5c-5922ae8ff6c8-manager-config\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.618614 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.618590    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/775f3bd1-7205-4193-be5c-5922ae8ff6c8-cert\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.618750 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.618733    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/775f3bd1-7205-4193-be5c-5922ae8ff6c8-metrics-cert\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.626552 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.626527    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghxg\" (UniqueName: \"kubernetes.io/projected/775f3bd1-7205-4193-be5c-5922ae8ff6c8-kube-api-access-cghxg\") pod \"lws-controller-manager-786df675f-rbtxx\" (UID: \"775f3bd1-7205-4193-be5c-5922ae8ff6c8\") " pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.754585 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.754498    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:39.887421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:39.887243    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"]
Jul 15 12:19:39.890456 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:19:39.890424    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775f3bd1_7205_4193_be5c_5922ae8ff6c8.slice/crio-95ad8aed46680a090e36beb4d1dd0a77e59af4f0859f7ad44d0b0a48e9b4f9bb WatchSource:0}: Error finding container 95ad8aed46680a090e36beb4d1dd0a77e59af4f0859f7ad44d0b0a48e9b4f9bb: Status 404 returned error can't find the container with id 95ad8aed46680a090e36beb4d1dd0a77e59af4f0859f7ad44d0b0a48e9b4f9bb
Jul 15 12:19:40.608131 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:40.608095    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx" event={"ID":"775f3bd1-7205-4193-be5c-5922ae8ff6c8","Type":"ContainerStarted","Data":"95ad8aed46680a090e36beb4d1dd0a77e59af4f0859f7ad44d0b0a48e9b4f9bb"}
Jul 15 12:19:42.618369 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:42.618328    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx" event={"ID":"775f3bd1-7205-4193-be5c-5922ae8ff6c8","Type":"ContainerStarted","Data":"ddb4d46c0068055a52a4d1677eb25efd5e35e389b0477d291b86c4273e022ec8"}
Jul 15 12:19:42.618804 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:42.618439    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:42.638158 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:42.638100    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx" podStartSLOduration=1.8999486939999999 podStartE2EDuration="3.638083662s" totalImagesPullingTime="1.738134968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:19:42.635363363 +0000 UTC m=+509.583392014" watchObservedRunningTime="2026-07-15 12:19:42.638083662 +0000 UTC m=+509.586112313"
Jul 15 12:19:48.602530 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:48.602499    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5qhb5"
Jul 15 12:19:48.628833 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:48.628801    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tlmkb"
Jul 15 12:19:48.921855 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:48.921772    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"]
Jul 15 12:19:48.929888 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:48.929859    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:48.932710 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:48.932683    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 12:19:48.932826 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:48.932712    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tj8qj\""
Jul 15 12:19:48.937274 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:48.937245    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"]
Jul 15 12:19:49.011775 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.011739    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.011927 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.011790    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.011927 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.011811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.011927 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.011870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.011927 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.011891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.012090 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.011952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.012090 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.011991    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9nk9\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-kube-api-access-k9nk9\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.012090 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.012016    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.012090 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.012050    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113133 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113133 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113420 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113420 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113420 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113420 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113258    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113420 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113301    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113420 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9nk9\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-kube-api-access-k9nk9\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113725 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113651    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113725 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113663    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113817 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113726    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113817 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113806    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.113983 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.113963    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.114088 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.114066    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.115862 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.115837    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.115964 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.115840    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.122327 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.122272    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.122504 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.122482    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9nk9\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-kube-api-access-k9nk9\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.167328 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.167268    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"]
Jul 15 12:19:49.171222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.171203    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.182233 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.182210    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"]
Jul 15 12:19:49.242744 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.242707    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:49.315818 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.315788    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.315960 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.315833    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.315960 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.315864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.315960 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.315934    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkktp\" (UniqueName: \"kubernetes.io/projected/d9d83a82-44ba-400e-a878-1ee710a699a7-kube-api-access-qkktp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.316123 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.315974    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.316123 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.316012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9d83a82-44ba-400e-a878-1ee710a699a7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.316233 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.316116    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.316233 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.316177    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.316318 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.316244    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.395267 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.395242    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"]
Jul 15 12:19:49.396738 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:19:49.396710    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec4ca2b3_8b0c_4d58_92a5_40e1835fd458.slice/crio-60acfde2badba841c525c6dc3b9489ef7ca9a042b0abfe39d160443f5838b515 WatchSource:0}: Error finding container 60acfde2badba841c525c6dc3b9489ef7ca9a042b0abfe39d160443f5838b515: Status 404 returned error can't find the container with id 60acfde2badba841c525c6dc3b9489ef7ca9a042b0abfe39d160443f5838b515
Jul 15 12:19:49.417323 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.417278    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.417432 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.417336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.417432 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.417359    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.417432 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.417385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.417432 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.417412    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.417706 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.417444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkktp\" (UniqueName: \"kubernetes.io/projected/d9d83a82-44ba-400e-a878-1ee710a699a7-kube-api-access-qkktp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.417706 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.417516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.417706 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.417549    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9d83a82-44ba-400e-a878-1ee710a699a7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.418093 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.417967    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.418093 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.418019    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.418093 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.418032    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.424767 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.418404    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.424767 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.418432    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.424767 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.419249    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9d83a82-44ba-400e-a878-1ee710a699a7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.424767 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.420885    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.426766 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.426747    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.428787 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.428766    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9d83a82-44ba-400e-a878-1ee710a699a7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.445507 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.445457    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkktp\" (UniqueName: \"kubernetes.io/projected/d9d83a82-44ba-400e-a878-1ee710a699a7-kube-api-access-qkktp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf428fjz\" (UID: \"d9d83a82-44ba-400e-a878-1ee710a699a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.484736 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.484703    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:49.615197 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.615173    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"]
Jul 15 12:19:49.616615 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:19:49.616584    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d83a82_44ba_400e_a878_1ee710a699a7.slice/crio-2e988acaff9ba0a05aa7a4db625ffbfc0c3b0a71b60ef52ff960e5a83f014bb5 WatchSource:0}: Error finding container 2e988acaff9ba0a05aa7a4db625ffbfc0c3b0a71b60ef52ff960e5a83f014bb5: Status 404 returned error can't find the container with id 2e988acaff9ba0a05aa7a4db625ffbfc0c3b0a71b60ef52ff960e5a83f014bb5
Jul 15 12:19:49.655808 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.655773    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz" event={"ID":"d9d83a82-44ba-400e-a878-1ee710a699a7","Type":"ContainerStarted","Data":"2e988acaff9ba0a05aa7a4db625ffbfc0c3b0a71b60ef52ff960e5a83f014bb5"}
Jul 15 12:19:49.657027 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:49.656997    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q" event={"ID":"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458","Type":"ContainerStarted","Data":"60acfde2badba841c525c6dc3b9489ef7ca9a042b0abfe39d160443f5838b515"}
Jul 15 12:19:52.183883 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.183842    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:19:52.184185 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.183914    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:19:52.184185 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.183944    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:19:52.189077 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.189050    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:19:52.189173 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.189125    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:19:52.189173 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.189166    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:19:52.675755 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.675720    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz" event={"ID":"d9d83a82-44ba-400e-a878-1ee710a699a7","Type":"ContainerStarted","Data":"6921df26aa1315e511775ace11be12851ad5c2f1a4dce3b347cc4873b4430142"}
Jul 15 12:19:52.677378 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.677350    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q" event={"ID":"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458","Type":"ContainerStarted","Data":"9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017"}
Jul 15 12:19:52.696266 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.696224    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz" podStartSLOduration=1.12612723 podStartE2EDuration="3.696208327s" totalImagesPullingTime="2.570081097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:19:52.694808988 +0000 UTC m=+519.642837678" watchObservedRunningTime="2026-07-15 12:19:52.696208327 +0000 UTC m=+519.644236977"
Jul 15 12:19:52.714015 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:52.713961    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q" podStartSLOduration=1.929538803 podStartE2EDuration="4.713944309s" totalImagesPullingTime="2.784405506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:19:52.712248793 +0000 UTC m=+519.660277445" watchObservedRunningTime="2026-07-15 12:19:52.713944309 +0000 UTC m=+519.661972959"
Jul 15 12:19:53.242969 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:53.242933    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:19:53.244481 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:53.244456    2571 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 15 12:19:53.244594 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:53.244503    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q" podUID="ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 15 12:19:53.485264 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:53.485229    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:53.489869 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:53.489840    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:53.627274 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:53.627247    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-786df675f-rbtxx"
Jul 15 12:19:53.683971 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:53.683926    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:53.684856 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:53.684832    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf428fjz"
Jul 15 12:19:53.735642 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:53.735611    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"]
Jul 15 12:19:54.243347 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:54.243281    2571 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 15 12:19:54.243830 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:54.243371    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q" podUID="ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 15 12:19:55.243897 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:55.243858    2571 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 15 12:19:55.244270 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:55.243918    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q" podUID="ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 15 12:19:55.692991 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:19:55.692920    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q" podUID="ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" containerName="istio-proxy" containerID="cri-o://9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017" gracePeriod=30
Jul 15 12:20:00.941188 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:00.941155    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:20:01.127826 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.127792    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-envoy\") pod \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") "
Jul 15 12:20:01.128029 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.127851    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-certs\") pod \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") "
Jul 15 12:20:01.128029 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.127882    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-socket\") pod \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") "
Jul 15 12:20:01.128029 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.127921    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9nk9\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-kube-api-access-k9nk9\") pod \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") "
Jul 15 12:20:01.128029 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.127946    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-data\") pod \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") "
Jul 15 12:20:01.128244 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128035    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istiod-ca-cert\") pod \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") "
Jul 15 12:20:01.128244 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128059    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-credential-socket\") pod \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") "
Jul 15 12:20:01.128244 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128098    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-token\") pod \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") "
Jul 15 12:20:01.128244 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128132    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-podinfo\") pod \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\" (UID: \"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458\") "
Jul 15 12:20:01.128244 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128192    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" (UID: "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:01.128539 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128277    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" (UID: "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:01.128539 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128407    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" (UID: "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:01.128539 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128529    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-certs\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:01.128690 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128593    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-workload-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:01.128690 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128608    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-data\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:01.128690 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128640    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" (UID: "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:01.128813 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.128690    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" (UID: "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:20:01.130739 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.130710    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" (UID: "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:01.130860 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.130767    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" (UID: "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 12:20:01.130860 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.130784    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" (UID: "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:20:01.130860 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.130815    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-kube-api-access-k9nk9" (OuterVolumeSpecName: "kube-api-access-k9nk9") pod "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" (UID: "ec4ca2b3-8b0c-4d58-92a5-40e1835fd458"). InnerVolumeSpecName "kube-api-access-k9nk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:20:01.229770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.229738    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istiod-ca-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:01.229770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.229765    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-credential-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:01.229770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.229775    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-token\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:01.229991 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.229783    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-podinfo\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:01.229991 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.229792    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-istio-envoy\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:01.229991 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.229799    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9nk9\" (UniqueName: \"kubernetes.io/projected/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458-kube-api-access-k9nk9\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:01.722594 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.722560    2571 generic.go:356] "Generic (PLEG): container finished" podID="ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" containerID="9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017" exitCode=0
Jul 15 12:20:01.722799 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.722615    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"
Jul 15 12:20:01.722799 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.722648    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q" event={"ID":"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458","Type":"ContainerDied","Data":"9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017"}
Jul 15 12:20:01.722799 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.722701    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q" event={"ID":"ec4ca2b3-8b0c-4d58-92a5-40e1835fd458","Type":"ContainerDied","Data":"60acfde2badba841c525c6dc3b9489ef7ca9a042b0abfe39d160443f5838b515"}
Jul 15 12:20:01.722799 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.722725    2571 scope.go:117] "RemoveContainer" containerID="9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017"
Jul 15 12:20:01.731554 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.731531    2571 scope.go:117] "RemoveContainer" containerID="9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017"
Jul 15 12:20:01.731873 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:20:01.731855    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017\": container with ID starting with 9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017 not found: ID does not exist" containerID="9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017"
Jul 15 12:20:01.731939 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.731884    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017"} err="failed to get container status \"9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017\": rpc error: code = NotFound desc = could not find container \"9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017\": container with ID starting with 9ec5f0e713fa873d9b07371288db583130675c7dffeda18d3b861e742b759017 not found: ID does not exist"
Jul 15 12:20:01.741772 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.741742    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"]
Jul 15 12:20:01.745679 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:01.745652    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mkv9q"]
Jul 15 12:20:03.627590 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:03.627556    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" path="/var/lib/kubelet/pods/ec4ca2b3-8b0c-4d58-92a5-40e1835fd458/volumes"
Jul 15 12:20:32.977408 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:32.977354    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p58g9"]
Jul 15 12:20:32.977971 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:32.977848    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" containerName="istio-proxy"
Jul 15 12:20:32.977971 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:32.977864    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" containerName="istio-proxy"
Jul 15 12:20:32.977971 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:32.977932    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec4ca2b3-8b0c-4d58-92a5-40e1835fd458" containerName="istio-proxy"
Jul 15 12:20:32.988900 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:32.988864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p58g9"
Jul 15 12:20:32.992426 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:32.992349    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 12:20:32.993975 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:32.993928    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 12:20:32.994198 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:32.994167    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4wp2l\""
Jul 15 12:20:32.997703 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:32.997231    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p58g9"]
Jul 15 12:20:33.112442 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.112391    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmxnz\" (UniqueName: \"kubernetes.io/projected/fc33b21c-d26e-42c1-aec5-fece6b447a94-kube-api-access-cmxnz\") pod \"kuadrant-operator-catalog-p58g9\" (UID: \"fc33b21c-d26e-42c1-aec5-fece6b447a94\") " pod="kuadrant-system/kuadrant-operator-catalog-p58g9"
Jul 15 12:20:33.213266 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.213227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmxnz\" (UniqueName: \"kubernetes.io/projected/fc33b21c-d26e-42c1-aec5-fece6b447a94-kube-api-access-cmxnz\") pod \"kuadrant-operator-catalog-p58g9\" (UID: \"fc33b21c-d26e-42c1-aec5-fece6b447a94\") " pod="kuadrant-system/kuadrant-operator-catalog-p58g9"
Jul 15 12:20:33.229776 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.229709    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmxnz\" (UniqueName: \"kubernetes.io/projected/fc33b21c-d26e-42c1-aec5-fece6b447a94-kube-api-access-cmxnz\") pod \"kuadrant-operator-catalog-p58g9\" (UID: \"fc33b21c-d26e-42c1-aec5-fece6b447a94\") " pod="kuadrant-system/kuadrant-operator-catalog-p58g9"
Jul 15 12:20:33.300578 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.300534    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p58g9"
Jul 15 12:20:33.340513 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.340474    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p58g9"]
Jul 15 12:20:33.430802 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.430778    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p58g9"]
Jul 15 12:20:33.432518 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:20:33.432491    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc33b21c_d26e_42c1_aec5_fece6b447a94.slice/crio-568749782ec12bafa55690029fbe342a55138529fe1ab1a403a0b3d878a0e443 WatchSource:0}: Error finding container 568749782ec12bafa55690029fbe342a55138529fe1ab1a403a0b3d878a0e443: Status 404 returned error can't find the container with id 568749782ec12bafa55690029fbe342a55138529fe1ab1a403a0b3d878a0e443
Jul 15 12:20:33.549042 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.549008    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zdtxv"]
Jul 15 12:20:33.553556 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.553537    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zdtxv"
Jul 15 12:20:33.559799 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.559773    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zdtxv"]
Jul 15 12:20:33.615898 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.615862    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svs9t\" (UniqueName: \"kubernetes.io/projected/8427db78-842c-4b64-8c03-e497654987d5-kube-api-access-svs9t\") pod \"kuadrant-operator-catalog-zdtxv\" (UID: \"8427db78-842c-4b64-8c03-e497654987d5\") " pod="kuadrant-system/kuadrant-operator-catalog-zdtxv"
Jul 15 12:20:33.717371 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.717324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svs9t\" (UniqueName: \"kubernetes.io/projected/8427db78-842c-4b64-8c03-e497654987d5-kube-api-access-svs9t\") pod \"kuadrant-operator-catalog-zdtxv\" (UID: \"8427db78-842c-4b64-8c03-e497654987d5\") " pod="kuadrant-system/kuadrant-operator-catalog-zdtxv"
Jul 15 12:20:33.725810 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.725781    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svs9t\" (UniqueName: \"kubernetes.io/projected/8427db78-842c-4b64-8c03-e497654987d5-kube-api-access-svs9t\") pod \"kuadrant-operator-catalog-zdtxv\" (UID: \"8427db78-842c-4b64-8c03-e497654987d5\") " pod="kuadrant-system/kuadrant-operator-catalog-zdtxv"
Jul 15 12:20:33.863787 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.863696    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zdtxv"
Jul 15 12:20:33.886338 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:33.886284    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p58g9" event={"ID":"fc33b21c-d26e-42c1-aec5-fece6b447a94","Type":"ContainerStarted","Data":"568749782ec12bafa55690029fbe342a55138529fe1ab1a403a0b3d878a0e443"}
Jul 15 12:20:34.008660 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:34.008507    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zdtxv"]
Jul 15 12:20:34.056784 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:20:34.056744    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8427db78_842c_4b64_8c03_e497654987d5.slice/crio-7be88df5460f227eaa85b87a0c5220441309b68c61fa96c4dad061b9c69bf99e WatchSource:0}: Error finding container 7be88df5460f227eaa85b87a0c5220441309b68c61fa96c4dad061b9c69bf99e: Status 404 returned error can't find the container with id 7be88df5460f227eaa85b87a0c5220441309b68c61fa96c4dad061b9c69bf99e
Jul 15 12:20:34.895480 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:34.895442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zdtxv" event={"ID":"8427db78-842c-4b64-8c03-e497654987d5","Type":"ContainerStarted","Data":"7be88df5460f227eaa85b87a0c5220441309b68c61fa96c4dad061b9c69bf99e"}
Jul 15 12:20:35.903253 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:35.903213    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p58g9" event={"ID":"fc33b21c-d26e-42c1-aec5-fece6b447a94","Type":"ContainerStarted","Data":"016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087"}
Jul 15 12:20:35.903694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:35.903250    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-p58g9" podUID="fc33b21c-d26e-42c1-aec5-fece6b447a94" containerName="registry-server" containerID="cri-o://016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087" gracePeriod=2
Jul 15 12:20:35.905197 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:35.905168    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zdtxv" event={"ID":"8427db78-842c-4b64-8c03-e497654987d5","Type":"ContainerStarted","Data":"b5e72cbd26cb9a767ff3df21db714c43621d37a714ec63e44a719c9ec0fba77b"}
Jul 15 12:20:35.921825 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:35.921763    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-p58g9" podStartSLOduration=1.594991947 podStartE2EDuration="3.921745664s" totalImagesPullingTime="2.326753717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:35.919419708 +0000 UTC m=+562.867448361" watchObservedRunningTime="2026-07-15 12:20:35.921745664 +0000 UTC m=+562.869774315"
Jul 15 12:20:35.937147 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:35.937096    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zdtxv" podStartSLOduration=1.231848383 podStartE2EDuration="2.937079823s" totalImagesPullingTime="1.70523144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:35.936270194 +0000 UTC m=+562.884298845" watchObservedRunningTime="2026-07-15 12:20:35.937079823 +0000 UTC m=+562.885108474"
Jul 15 12:20:36.154770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.154748    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p58g9"
Jul 15 12:20:36.239267 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.239236    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmxnz\" (UniqueName: \"kubernetes.io/projected/fc33b21c-d26e-42c1-aec5-fece6b447a94-kube-api-access-cmxnz\") pod \"fc33b21c-d26e-42c1-aec5-fece6b447a94\" (UID: \"fc33b21c-d26e-42c1-aec5-fece6b447a94\") "
Jul 15 12:20:36.241385 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.241360    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc33b21c-d26e-42c1-aec5-fece6b447a94-kube-api-access-cmxnz" (OuterVolumeSpecName: "kube-api-access-cmxnz") pod "fc33b21c-d26e-42c1-aec5-fece6b447a94" (UID: "fc33b21c-d26e-42c1-aec5-fece6b447a94"). InnerVolumeSpecName "kube-api-access-cmxnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:20:36.340571 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.340522    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmxnz\" (UniqueName: \"kubernetes.io/projected/fc33b21c-d26e-42c1-aec5-fece6b447a94-kube-api-access-cmxnz\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:36.910828 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.910787    2571 generic.go:356] "Generic (PLEG): container finished" podID="fc33b21c-d26e-42c1-aec5-fece6b447a94" containerID="016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087" exitCode=0
Jul 15 12:20:36.910828 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.910833    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p58g9"
Jul 15 12:20:36.911340 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.910876    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p58g9" event={"ID":"fc33b21c-d26e-42c1-aec5-fece6b447a94","Type":"ContainerDied","Data":"016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087"}
Jul 15 12:20:36.911340 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.910935    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p58g9" event={"ID":"fc33b21c-d26e-42c1-aec5-fece6b447a94","Type":"ContainerDied","Data":"568749782ec12bafa55690029fbe342a55138529fe1ab1a403a0b3d878a0e443"}
Jul 15 12:20:36.911340 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.910957    2571 scope.go:117] "RemoveContainer" containerID="016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087"
Jul 15 12:20:36.920183 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.920164    2571 scope.go:117] "RemoveContainer" containerID="016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087"
Jul 15 12:20:36.920467 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:20:36.920449    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087\": container with ID starting with 016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087 not found: ID does not exist" containerID="016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087"
Jul 15 12:20:36.920528 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.920475    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087"} err="failed to get container status \"016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087\": rpc error: code = NotFound desc = could not find container \"016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087\": container with ID starting with 016d3de8f86252ba5d32f83f58b9a0924caa3c53ee26bbfaf8b37818be2ba087 not found: ID does not exist"
Jul 15 12:20:36.932332 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.932305    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p58g9"]
Jul 15 12:20:36.935849 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:36.935829    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p58g9"]
Jul 15 12:20:37.627262 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:37.627225    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc33b21c-d26e-42c1-aec5-fece6b447a94" path="/var/lib/kubelet/pods/fc33b21c-d26e-42c1-aec5-fece6b447a94/volumes"
Jul 15 12:20:43.864795 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:43.864746    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zdtxv"
Jul 15 12:20:43.865265 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:43.864819    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zdtxv"
Jul 15 12:20:43.887797 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:43.887773    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zdtxv"
Jul 15 12:20:43.968079 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:43.968047    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zdtxv"
Jul 15 12:20:44.759527 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.759496    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"]
Jul 15 12:20:44.759868 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.759857    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc33b21c-d26e-42c1-aec5-fece6b447a94" containerName="registry-server"
Jul 15 12:20:44.759912 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.759870    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc33b21c-d26e-42c1-aec5-fece6b447a94" containerName="registry-server"
Jul 15 12:20:44.759946 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.759930    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc33b21c-d26e-42c1-aec5-fece6b447a94" containerName="registry-server"
Jul 15 12:20:44.763158 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.763139    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:44.766272 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.766256    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wkg9l\""
Jul 15 12:20:44.772175 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.772150    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"]
Jul 15 12:20:44.919116 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.919077    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:44.919548 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.919201    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6bp9\" (UniqueName: \"kubernetes.io/projected/310ca2e8-d740-47f6-a304-6ee2954a7e0f-kube-api-access-p6bp9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:44.919548 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:44.919238    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:45.020154 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.020049    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6bp9\" (UniqueName: \"kubernetes.io/projected/310ca2e8-d740-47f6-a304-6ee2954a7e0f-kube-api-access-p6bp9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:45.020154 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.020094    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:45.020154 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.020129    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:45.020567 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.020543    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:45.020567 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.020558    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:45.028697 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.028663    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6bp9\" (UniqueName: \"kubernetes.io/projected/310ca2e8-d740-47f6-a304-6ee2954a7e0f-kube-api-access-p6bp9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:45.073340 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.073258    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:45.208902 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.208875    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"]
Jul 15 12:20:45.210880 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:20:45.210851    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310ca2e8_d740_47f6_a304_6ee2954a7e0f.slice/crio-8dccf517df47a040cbe3d3edf6804aaa6d0671e4c19148a8feac45e8a7573be0 WatchSource:0}: Error finding container 8dccf517df47a040cbe3d3edf6804aaa6d0671e4c19148a8feac45e8a7573be0: Status 404 returned error can't find the container with id 8dccf517df47a040cbe3d3edf6804aaa6d0671e4c19148a8feac45e8a7573be0
Jul 15 12:20:45.354766 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.354731    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"]
Jul 15 12:20:45.358260 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.358244    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.366585 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.366555    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"]
Jul 15 12:20:45.524475 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.524428    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqjh5\" (UniqueName: \"kubernetes.io/projected/334a4515-0dd7-4a16-81ef-c286536a5a5d-kube-api-access-cqjh5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.524475 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.524484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.524708 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.524563    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.625377 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.625262    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.625377 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.625326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.625618 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.625408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqjh5\" (UniqueName: \"kubernetes.io/projected/334a4515-0dd7-4a16-81ef-c286536a5a5d-kube-api-access-cqjh5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.625714 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.625695    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.625769 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.625732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.633397 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.633370    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqjh5\" (UniqueName: \"kubernetes.io/projected/334a4515-0dd7-4a16-81ef-c286536a5a5d-kube-api-access-cqjh5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.689494 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.689450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:45.843100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.843073    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"]
Jul 15 12:20:45.844929 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:20:45.844907    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334a4515_0dd7_4a16_81ef_c286536a5a5d.slice/crio-61bef7f48a133b90d1a63f088f2807166d2ca1d45520a6eaf98f781dce2babba WatchSource:0}: Error finding container 61bef7f48a133b90d1a63f088f2807166d2ca1d45520a6eaf98f781dce2babba: Status 404 returned error can't find the container with id 61bef7f48a133b90d1a63f088f2807166d2ca1d45520a6eaf98f781dce2babba
Jul 15 12:20:45.956971 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.956939    2571 generic.go:356] "Generic (PLEG): container finished" podID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerID="79affae5a44f9d3a4bf9430ad5632b99b8db889f1e79fa52adfa060eb743d5f8" exitCode=0
Jul 15 12:20:45.957382 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.957013    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk" event={"ID":"334a4515-0dd7-4a16-81ef-c286536a5a5d","Type":"ContainerDied","Data":"79affae5a44f9d3a4bf9430ad5632b99b8db889f1e79fa52adfa060eb743d5f8"}
Jul 15 12:20:45.957382 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.957059    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk" event={"ID":"334a4515-0dd7-4a16-81ef-c286536a5a5d","Type":"ContainerStarted","Data":"61bef7f48a133b90d1a63f088f2807166d2ca1d45520a6eaf98f781dce2babba"}
Jul 15 12:20:45.958888 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.958863    2571 generic.go:356] "Generic (PLEG): container finished" podID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerID="0c79d90fc4e5b3b5753b1f5be03bdc824a9b247afe5ca9b62af71426794f7082" exitCode=0
Jul 15 12:20:45.959011 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.958888    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7" event={"ID":"310ca2e8-d740-47f6-a304-6ee2954a7e0f","Type":"ContainerDied","Data":"0c79d90fc4e5b3b5753b1f5be03bdc824a9b247afe5ca9b62af71426794f7082"}
Jul 15 12:20:45.959011 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.958924    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7" event={"ID":"310ca2e8-d740-47f6-a304-6ee2954a7e0f","Type":"ContainerStarted","Data":"8dccf517df47a040cbe3d3edf6804aaa6d0671e4c19148a8feac45e8a7573be0"}
Jul 15 12:20:45.967762 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.964783    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"]
Jul 15 12:20:45.970208 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.970189    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:45.973694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:45.973670    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"]
Jul 15 12:20:46.130784 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.130676    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.130784 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.130756    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqnzb\" (UniqueName: \"kubernetes.io/projected/be7cb190-74f2-4239-a3fc-591086fbe664-kube-api-access-hqnzb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.130993 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.130827    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.231883 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.231845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.232076 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.231951    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.232076 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.231992    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqnzb\" (UniqueName: \"kubernetes.io/projected/be7cb190-74f2-4239-a3fc-591086fbe664-kube-api-access-hqnzb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.232193 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.232163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.232246 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.232229    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.241113 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.241091    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqnzb\" (UniqueName: \"kubernetes.io/projected/be7cb190-74f2-4239-a3fc-591086fbe664-kube-api-access-hqnzb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.304101 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.304067    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:46.441602 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.441575    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"]
Jul 15 12:20:46.480170 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:20:46.480140    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7cb190_74f2_4239_a3fc_591086fbe664.slice/crio-17c7ccad0ac0765f56cbd3ea2d435a93331b9488f52b8d3633525b7c98d7ac3e WatchSource:0}: Error finding container 17c7ccad0ac0765f56cbd3ea2d435a93331b9488f52b8d3633525b7c98d7ac3e: Status 404 returned error can't find the container with id 17c7ccad0ac0765f56cbd3ea2d435a93331b9488f52b8d3633525b7c98d7ac3e
Jul 15 12:20:46.561069 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.561037    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"]
Jul 15 12:20:46.565146 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.565120    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.575496 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.575463    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"]
Jul 15 12:20:46.737228 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.737193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plhjg\" (UniqueName: \"kubernetes.io/projected/2fc9c788-7342-4cb5-9e4e-99e03dc98918-kube-api-access-plhjg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.737395 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.737308    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.737395 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.737379    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.838523 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.838498    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.838639 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.838556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhjg\" (UniqueName: \"kubernetes.io/projected/2fc9c788-7342-4cb5-9e4e-99e03dc98918-kube-api-access-plhjg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.838639 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.838589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.838849 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.838832    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.838886 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.838852    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.847515 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.847491    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhjg\" (UniqueName: \"kubernetes.io/projected/2fc9c788-7342-4cb5-9e4e-99e03dc98918-kube-api-access-plhjg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.876626 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.876603    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:46.967040 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.966994    2571 generic.go:356] "Generic (PLEG): container finished" podID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerID="4820f3bff1fed43e88bed0769f7385dfe46a46ff886de5cfbbe9e5547c0d990a" exitCode=0
Jul 15 12:20:46.967469 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.967124    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk" event={"ID":"334a4515-0dd7-4a16-81ef-c286536a5a5d","Type":"ContainerDied","Data":"4820f3bff1fed43e88bed0769f7385dfe46a46ff886de5cfbbe9e5547c0d990a"}
Jul 15 12:20:46.968974 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.968942    2571 generic.go:356] "Generic (PLEG): container finished" podID="be7cb190-74f2-4239-a3fc-591086fbe664" containerID="610a2445fc9a9f24a1b822a4b9f4ce79fa298d500b990ad21eb5f1d2093803b9" exitCode=0
Jul 15 12:20:46.969043 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.969018    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5" event={"ID":"be7cb190-74f2-4239-a3fc-591086fbe664","Type":"ContainerDied","Data":"610a2445fc9a9f24a1b822a4b9f4ce79fa298d500b990ad21eb5f1d2093803b9"}
Jul 15 12:20:46.969103 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.969066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5" event={"ID":"be7cb190-74f2-4239-a3fc-591086fbe664","Type":"ContainerStarted","Data":"17c7ccad0ac0765f56cbd3ea2d435a93331b9488f52b8d3633525b7c98d7ac3e"}
Jul 15 12:20:46.971252 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.971225    2571 generic.go:356] "Generic (PLEG): container finished" podID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerID="f53c0dc6e8d2f0477378851b62713af2fbfa96d7c2b3b88c4a6f849e35a928d2" exitCode=0
Jul 15 12:20:46.971581 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:46.971344    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7" event={"ID":"310ca2e8-d740-47f6-a304-6ee2954a7e0f","Type":"ContainerDied","Data":"f53c0dc6e8d2f0477378851b62713af2fbfa96d7c2b3b88c4a6f849e35a928d2"}
Jul 15 12:20:47.020575 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:47.020547    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"]
Jul 15 12:20:47.022637 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:20:47.022466    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc9c788_7342_4cb5_9e4e_99e03dc98918.slice/crio-d42117dbeee6cf90fa52516b0fecdcd6348a5af22040c059395be566e0d59c52 WatchSource:0}: Error finding container d42117dbeee6cf90fa52516b0fecdcd6348a5af22040c059395be566e0d59c52: Status 404 returned error can't find the container with id d42117dbeee6cf90fa52516b0fecdcd6348a5af22040c059395be566e0d59c52
Jul 15 12:20:47.979266 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:47.979239    2571 generic.go:356] "Generic (PLEG): container finished" podID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerID="969593a35215076d6f31126c663c5ad13f9beff6f6cd2f6963e2478482cb0007" exitCode=0
Jul 15 12:20:47.979674 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:47.979324    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk" event={"ID":"334a4515-0dd7-4a16-81ef-c286536a5a5d","Type":"ContainerDied","Data":"969593a35215076d6f31126c663c5ad13f9beff6f6cd2f6963e2478482cb0007"}
Jul 15 12:20:47.980892 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:47.980870    2571 generic.go:356] "Generic (PLEG): container finished" podID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerID="c1dbf7ed0c9b120d8777c1fa36ec1338dd7432c743d26859eb8b34de141ceee2" exitCode=0
Jul 15 12:20:47.981012 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:47.980957    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn" event={"ID":"2fc9c788-7342-4cb5-9e4e-99e03dc98918","Type":"ContainerDied","Data":"c1dbf7ed0c9b120d8777c1fa36ec1338dd7432c743d26859eb8b34de141ceee2"}
Jul 15 12:20:47.981012 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:47.980992    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn" event={"ID":"2fc9c788-7342-4cb5-9e4e-99e03dc98918","Type":"ContainerStarted","Data":"d42117dbeee6cf90fa52516b0fecdcd6348a5af22040c059395be566e0d59c52"}
Jul 15 12:20:47.982991 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:47.982957    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5" event={"ID":"be7cb190-74f2-4239-a3fc-591086fbe664","Type":"ContainerStarted","Data":"696c5763c50ce58baeaab13c1dcfe08c7ced107105561ddb3ad2d3a68e980a40"}
Jul 15 12:20:47.985078 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:47.985056    2571 generic.go:356] "Generic (PLEG): container finished" podID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerID="d018971554a979bf94ff4ec36da0cb52012a1dc5ab22ee7edf7b58b3f4df2da1" exitCode=0
Jul 15 12:20:47.985174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:47.985136    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7" event={"ID":"310ca2e8-d740-47f6-a304-6ee2954a7e0f","Type":"ContainerDied","Data":"d018971554a979bf94ff4ec36da0cb52012a1dc5ab22ee7edf7b58b3f4df2da1"}
Jul 15 12:20:48.997652 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:48.997619    2571 generic.go:356] "Generic (PLEG): container finished" podID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerID="99de2d7faa044b75bb4e8a0b015c4897ff40602e24ceba249448b498ece46d43" exitCode=0
Jul 15 12:20:48.998153 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:48.997711    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn" event={"ID":"2fc9c788-7342-4cb5-9e4e-99e03dc98918","Type":"ContainerDied","Data":"99de2d7faa044b75bb4e8a0b015c4897ff40602e24ceba249448b498ece46d43"}
Jul 15 12:20:48.999974 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:48.999950    2571 generic.go:356] "Generic (PLEG): container finished" podID="be7cb190-74f2-4239-a3fc-591086fbe664" containerID="696c5763c50ce58baeaab13c1dcfe08c7ced107105561ddb3ad2d3a68e980a40" exitCode=0
Jul 15 12:20:49.000076 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.000019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5" event={"ID":"be7cb190-74f2-4239-a3fc-591086fbe664","Type":"ContainerDied","Data":"696c5763c50ce58baeaab13c1dcfe08c7ced107105561ddb3ad2d3a68e980a40"}
Jul 15 12:20:49.169904 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.169877    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:49.261273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.261241    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-util\") pod \"334a4515-0dd7-4a16-81ef-c286536a5a5d\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") "
Jul 15 12:20:49.261436 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.261319    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-bundle\") pod \"334a4515-0dd7-4a16-81ef-c286536a5a5d\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") "
Jul 15 12:20:49.261436 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.261376    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqjh5\" (UniqueName: \"kubernetes.io/projected/334a4515-0dd7-4a16-81ef-c286536a5a5d-kube-api-access-cqjh5\") pod \"334a4515-0dd7-4a16-81ef-c286536a5a5d\" (UID: \"334a4515-0dd7-4a16-81ef-c286536a5a5d\") "
Jul 15 12:20:49.261828 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.261792    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-bundle" (OuterVolumeSpecName: "bundle") pod "334a4515-0dd7-4a16-81ef-c286536a5a5d" (UID: "334a4515-0dd7-4a16-81ef-c286536a5a5d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:49.263402 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.263382    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/334a4515-0dd7-4a16-81ef-c286536a5a5d-kube-api-access-cqjh5" (OuterVolumeSpecName: "kube-api-access-cqjh5") pod "334a4515-0dd7-4a16-81ef-c286536a5a5d" (UID: "334a4515-0dd7-4a16-81ef-c286536a5a5d"). InnerVolumeSpecName "kube-api-access-cqjh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:20:49.266413 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.266391    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-util" (OuterVolumeSpecName: "util") pod "334a4515-0dd7-4a16-81ef-c286536a5a5d" (UID: "334a4515-0dd7-4a16-81ef-c286536a5a5d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:49.294802 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.294738    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:49.362890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.362854    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-util\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:49.362890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.362885    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334a4515-0dd7-4a16-81ef-c286536a5a5d-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:49.362890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.362896    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqjh5\" (UniqueName: \"kubernetes.io/projected/334a4515-0dd7-4a16-81ef-c286536a5a5d-kube-api-access-cqjh5\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:49.463659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.463622    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-util\") pod \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") "
Jul 15 12:20:49.463830 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.463666    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6bp9\" (UniqueName: \"kubernetes.io/projected/310ca2e8-d740-47f6-a304-6ee2954a7e0f-kube-api-access-p6bp9\") pod \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") "
Jul 15 12:20:49.463830 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.463797    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-bundle\") pod \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\" (UID: \"310ca2e8-d740-47f6-a304-6ee2954a7e0f\") "
Jul 15 12:20:49.464384 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.464347    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-bundle" (OuterVolumeSpecName: "bundle") pod "310ca2e8-d740-47f6-a304-6ee2954a7e0f" (UID: "310ca2e8-d740-47f6-a304-6ee2954a7e0f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:49.465760 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.465738    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/310ca2e8-d740-47f6-a304-6ee2954a7e0f-kube-api-access-p6bp9" (OuterVolumeSpecName: "kube-api-access-p6bp9") pod "310ca2e8-d740-47f6-a304-6ee2954a7e0f" (UID: "310ca2e8-d740-47f6-a304-6ee2954a7e0f"). InnerVolumeSpecName "kube-api-access-p6bp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:20:49.469207 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.469185    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-util" (OuterVolumeSpecName: "util") pod "310ca2e8-d740-47f6-a304-6ee2954a7e0f" (UID: "310ca2e8-d740-47f6-a304-6ee2954a7e0f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:49.564671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.564641    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-util\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:49.564671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.564668    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6bp9\" (UniqueName: \"kubernetes.io/projected/310ca2e8-d740-47f6-a304-6ee2954a7e0f-kube-api-access-p6bp9\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:49.564865 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:49.564678    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/310ca2e8-d740-47f6-a304-6ee2954a7e0f-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:50.010242 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.010164    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7"
Jul 15 12:20:50.010242 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.010191    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7" event={"ID":"310ca2e8-d740-47f6-a304-6ee2954a7e0f","Type":"ContainerDied","Data":"8dccf517df47a040cbe3d3edf6804aaa6d0671e4c19148a8feac45e8a7573be0"}
Jul 15 12:20:50.010242 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.010242    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8dccf517df47a040cbe3d3edf6804aaa6d0671e4c19148a8feac45e8a7573be0"
Jul 15 12:20:50.012564 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.012515    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk" event={"ID":"334a4515-0dd7-4a16-81ef-c286536a5a5d","Type":"ContainerDied","Data":"61bef7f48a133b90d1a63f088f2807166d2ca1d45520a6eaf98f781dce2babba"}
Jul 15 12:20:50.012564 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.012558    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61bef7f48a133b90d1a63f088f2807166d2ca1d45520a6eaf98f781dce2babba"
Jul 15 12:20:50.012564 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.012525    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk"
Jul 15 12:20:50.014945 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.014922    2571 generic.go:356] "Generic (PLEG): container finished" podID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerID="10ee78c168ad10cd6bb078e451f813745dc78976c3dd7b180b38f600e940e3c5" exitCode=0
Jul 15 12:20:50.015050 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.014945    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn" event={"ID":"2fc9c788-7342-4cb5-9e4e-99e03dc98918","Type":"ContainerDied","Data":"10ee78c168ad10cd6bb078e451f813745dc78976c3dd7b180b38f600e940e3c5"}
Jul 15 12:20:50.016964 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.016942    2571 generic.go:356] "Generic (PLEG): container finished" podID="be7cb190-74f2-4239-a3fc-591086fbe664" containerID="3031117c208966d2131bc4211c3af5e75f515e03e7e1657913ab2b9cf50ee481" exitCode=0
Jul 15 12:20:50.017063 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:50.016975    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5" event={"ID":"be7cb190-74f2-4239-a3fc-591086fbe664","Type":"ContainerDied","Data":"3031117c208966d2131bc4211c3af5e75f515e03e7e1657913ab2b9cf50ee481"}
Jul 15 12:20:51.188141 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.188112    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:20:51.190107 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.190087    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:51.279133 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.279039    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-bundle\") pod \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") "
Jul 15 12:20:51.279133 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.279077    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-util\") pod \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") "
Jul 15 12:20:51.279133 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.279123    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plhjg\" (UniqueName: \"kubernetes.io/projected/2fc9c788-7342-4cb5-9e4e-99e03dc98918-kube-api-access-plhjg\") pod \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\" (UID: \"2fc9c788-7342-4cb5-9e4e-99e03dc98918\") "
Jul 15 12:20:51.279432 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.279165    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-bundle\") pod \"be7cb190-74f2-4239-a3fc-591086fbe664\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") "
Jul 15 12:20:51.279432 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.279233    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqnzb\" (UniqueName: \"kubernetes.io/projected/be7cb190-74f2-4239-a3fc-591086fbe664-kube-api-access-hqnzb\") pod \"be7cb190-74f2-4239-a3fc-591086fbe664\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") "
Jul 15 12:20:51.279432 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.279270    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-util\") pod \"be7cb190-74f2-4239-a3fc-591086fbe664\" (UID: \"be7cb190-74f2-4239-a3fc-591086fbe664\") "
Jul 15 12:20:51.279794 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.279757    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-bundle" (OuterVolumeSpecName: "bundle") pod "2fc9c788-7342-4cb5-9e4e-99e03dc98918" (UID: "2fc9c788-7342-4cb5-9e4e-99e03dc98918"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:51.279924 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.279828    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-bundle" (OuterVolumeSpecName: "bundle") pod "be7cb190-74f2-4239-a3fc-591086fbe664" (UID: "be7cb190-74f2-4239-a3fc-591086fbe664"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:51.281367 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.281346    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc9c788-7342-4cb5-9e4e-99e03dc98918-kube-api-access-plhjg" (OuterVolumeSpecName: "kube-api-access-plhjg") pod "2fc9c788-7342-4cb5-9e4e-99e03dc98918" (UID: "2fc9c788-7342-4cb5-9e4e-99e03dc98918"). InnerVolumeSpecName "kube-api-access-plhjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:20:51.281671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.281643    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be7cb190-74f2-4239-a3fc-591086fbe664-kube-api-access-hqnzb" (OuterVolumeSpecName: "kube-api-access-hqnzb") pod "be7cb190-74f2-4239-a3fc-591086fbe664" (UID: "be7cb190-74f2-4239-a3fc-591086fbe664"). InnerVolumeSpecName "kube-api-access-hqnzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:20:51.286119 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.286075    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-util" (OuterVolumeSpecName: "util") pod "be7cb190-74f2-4239-a3fc-591086fbe664" (UID: "be7cb190-74f2-4239-a3fc-591086fbe664"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:51.287038 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.287016    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-util" (OuterVolumeSpecName: "util") pod "2fc9c788-7342-4cb5-9e4e-99e03dc98918" (UID: "2fc9c788-7342-4cb5-9e4e-99e03dc98918"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:20:51.380413 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.380374    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:51.380413 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.380406    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqnzb\" (UniqueName: \"kubernetes.io/projected/be7cb190-74f2-4239-a3fc-591086fbe664-kube-api-access-hqnzb\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:51.380413 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.380417    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be7cb190-74f2-4239-a3fc-591086fbe664-util\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:51.380413 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.380425    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:51.380676 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.380433    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc9c788-7342-4cb5-9e4e-99e03dc98918-util\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:51.380676 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:51.380440    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plhjg\" (UniqueName: \"kubernetes.io/projected/2fc9c788-7342-4cb5-9e4e-99e03dc98918-kube-api-access-plhjg\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:20:52.029718 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:52.029619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn" event={"ID":"2fc9c788-7342-4cb5-9e4e-99e03dc98918","Type":"ContainerDied","Data":"d42117dbeee6cf90fa52516b0fecdcd6348a5af22040c059395be566e0d59c52"}
Jul 15 12:20:52.029718 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:52.029652    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn"
Jul 15 12:20:52.029718 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:52.029702    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d42117dbeee6cf90fa52516b0fecdcd6348a5af22040c059395be566e0d59c52"
Jul 15 12:20:52.031882 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:52.031815    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5" event={"ID":"be7cb190-74f2-4239-a3fc-591086fbe664","Type":"ContainerDied","Data":"17c7ccad0ac0765f56cbd3ea2d435a93331b9488f52b8d3633525b7c98d7ac3e"}
Jul 15 12:20:52.031882 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:52.031857    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17c7ccad0ac0765f56cbd3ea2d435a93331b9488f52b8d3633525b7c98d7ac3e"
Jul 15 12:20:52.032036 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:20:52.031886    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5"
Jul 15 12:21:01.151663 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.151625    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"]
Jul 15 12:21:01.152031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.151980    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerName="util"
Jul 15 12:21:01.152031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.151990    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerName="util"
Jul 15 12:21:01.152031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.151999    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be7cb190-74f2-4239-a3fc-591086fbe664" containerName="extract"
Jul 15 12:21:01.152031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152005    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7cb190-74f2-4239-a3fc-591086fbe664" containerName="extract"
Jul 15 12:21:01.152031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152015    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerName="extract"
Jul 15 12:21:01.152031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152021    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerName="extract"
Jul 15 12:21:01.152031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152029    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerName="pull"
Jul 15 12:21:01.152031 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152034    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerName="pull"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152047    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerName="pull"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152053    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerName="pull"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152060    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerName="extract"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152065    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerName="extract"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152073    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be7cb190-74f2-4239-a3fc-591086fbe664" containerName="util"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152078    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7cb190-74f2-4239-a3fc-591086fbe664" containerName="util"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152084    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerName="pull"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152089    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerName="pull"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152095    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerName="extract"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152099    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerName="extract"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152105    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerName="util"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152110    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerName="util"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152116    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerName="util"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152121    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerName="util"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152128    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be7cb190-74f2-4239-a3fc-591086fbe664" containerName="pull"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152133    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7cb190-74f2-4239-a3fc-591086fbe664" containerName="pull"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152186    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="be7cb190-74f2-4239-a3fc-591086fbe664" containerName="extract"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152195    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fc9c788-7342-4cb5-9e4e-99e03dc98918" containerName="extract"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152201    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="334a4515-0dd7-4a16-81ef-c286536a5a5d" containerName="extract"
Jul 15 12:21:01.152344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.152207    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="310ca2e8-d740-47f6-a304-6ee2954a7e0f" containerName="extract"
Jul 15 12:21:01.156424 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.156406    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"
Jul 15 12:21:01.159471 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.159443    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2s5s9\""
Jul 15 12:21:01.159599 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.159495    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 12:21:01.165184 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.165157    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"]
Jul 15 12:21:01.169811 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.169782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7fcn\" (UniqueName: \"kubernetes.io/projected/841fcb0b-ba47-44ef-aa77-0f569220a375-kube-api-access-n7fcn\") pod \"dns-operator-controller-manager-864dd78c4c-kbb8w\" (UID: \"841fcb0b-ba47-44ef-aa77-0f569220a375\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"
Jul 15 12:21:01.271227 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.271183    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7fcn\" (UniqueName: \"kubernetes.io/projected/841fcb0b-ba47-44ef-aa77-0f569220a375-kube-api-access-n7fcn\") pod \"dns-operator-controller-manager-864dd78c4c-kbb8w\" (UID: \"841fcb0b-ba47-44ef-aa77-0f569220a375\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"
Jul 15 12:21:01.284913 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.284878    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7fcn\" (UniqueName: \"kubernetes.io/projected/841fcb0b-ba47-44ef-aa77-0f569220a375-kube-api-access-n7fcn\") pod \"dns-operator-controller-manager-864dd78c4c-kbb8w\" (UID: \"841fcb0b-ba47-44ef-aa77-0f569220a375\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"
Jul 15 12:21:01.467066 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.466978    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"
Jul 15 12:21:01.603828 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:01.603799    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"]
Jul 15 12:21:01.605156 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:21:01.605130    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841fcb0b_ba47_44ef_aa77_0f569220a375.slice/crio-d2c26b1b47786a48d7f929efe0a5bd5a3133ed3a2996f974cf957b6426098727 WatchSource:0}: Error finding container d2c26b1b47786a48d7f929efe0a5bd5a3133ed3a2996f974cf957b6426098727: Status 404 returned error can't find the container with id d2c26b1b47786a48d7f929efe0a5bd5a3133ed3a2996f974cf957b6426098727
Jul 15 12:21:02.086925 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:02.086889    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w" event={"ID":"841fcb0b-ba47-44ef-aa77-0f569220a375","Type":"ContainerStarted","Data":"d2c26b1b47786a48d7f929efe0a5bd5a3133ed3a2996f974cf957b6426098727"}
Jul 15 12:21:05.105790 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:05.105755    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w" event={"ID":"841fcb0b-ba47-44ef-aa77-0f569220a375","Type":"ContainerStarted","Data":"7bdb2b862dd29c3bdb31245754cffb394dcc889bf10c626e6c680a01df4f2925"}
Jul 15 12:21:05.106225 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:05.105908    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"
Jul 15 12:21:05.132726 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:05.132668    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w" podStartSLOduration=1.079029624 podStartE2EDuration="4.132650465s" totalImagesPullingTime="3.053620841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:05.131118396 +0000 UTC m=+592.079147048" watchObservedRunningTime="2026-07-15 12:21:05.132650465 +0000 UTC m=+592.080679115"
Jul 15 12:21:06.067644 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.067610    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"]
Jul 15 12:21:06.075576 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.075556    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:06.078718 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.078691    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jps4v\""
Jul 15 12:21:06.085687 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.085663    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"]
Jul 15 12:21:06.115802 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.115774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" (UID: \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:06.116211 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.115939    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbxf\" (UniqueName: \"kubernetes.io/projected/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-kube-api-access-zsbxf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" (UID: \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:06.217307 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.217262    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbxf\" (UniqueName: \"kubernetes.io/projected/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-kube-api-access-zsbxf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" (UID: \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:06.217476 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.217403    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" (UID: \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:06.217776 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.217759    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" (UID: \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:06.226148 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.226121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbxf\" (UniqueName: \"kubernetes.io/projected/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-kube-api-access-zsbxf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" (UID: \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:06.385782 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.385689    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:06.527156 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.527118    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c98558dfd-mvrnw"]
Jul 15 12:21:06.532645 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.532620    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.541856 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.541829    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"]
Jul 15 12:21:06.543557 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:21:06.543534    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5246d0fd_b3fe_4b26_b6b1_c73be1aff102.slice/crio-688fd956af2393fcddcd0473aa66ebfbbecf28c43e68a9941569dd030a4acf12 WatchSource:0}: Error finding container 688fd956af2393fcddcd0473aa66ebfbbecf28c43e68a9941569dd030a4acf12: Status 404 returned error can't find the container with id 688fd956af2393fcddcd0473aa66ebfbbecf28c43e68a9941569dd030a4acf12
Jul 15 12:21:06.556075 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.556052    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c98558dfd-mvrnw"]
Jul 15 12:21:06.621859 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.621821    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85j4w\" (UniqueName: \"kubernetes.io/projected/d22d3775-edfe-46f0-aa57-547e4035ab1e-kube-api-access-85j4w\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.621859 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.621866    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d22d3775-edfe-46f0-aa57-547e4035ab1e-console-oauth-config\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.622065 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.621898    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-oauth-serving-cert\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.622065 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.621929    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-trusted-ca-bundle\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.622065 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.621955    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-console-config\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.622065 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.621973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-service-ca\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.622065 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.622039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d22d3775-edfe-46f0-aa57-547e4035ab1e-console-serving-cert\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.723336 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.723232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d22d3775-edfe-46f0-aa57-547e4035ab1e-console-oauth-config\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.723336 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.723280    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-oauth-serving-cert\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.723336 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.723337    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-trusted-ca-bundle\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.723639 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.723364    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-console-config\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.723639 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.723381    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-service-ca\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.723639 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.723426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d22d3775-edfe-46f0-aa57-547e4035ab1e-console-serving-cert\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.723639 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.723453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85j4w\" (UniqueName: \"kubernetes.io/projected/d22d3775-edfe-46f0-aa57-547e4035ab1e-kube-api-access-85j4w\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.724129 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.724101    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-oauth-serving-cert\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.724222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.724108    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-service-ca\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.724315 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.724221    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-console-config\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.724315 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.724239    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22d3775-edfe-46f0-aa57-547e4035ab1e-trusted-ca-bundle\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.725907 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.725881    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d22d3775-edfe-46f0-aa57-547e4035ab1e-console-serving-cert\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.726015 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.725947    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d22d3775-edfe-46f0-aa57-547e4035ab1e-console-oauth-config\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.732539 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.732518    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85j4w\" (UniqueName: \"kubernetes.io/projected/d22d3775-edfe-46f0-aa57-547e4035ab1e-kube-api-access-85j4w\") pod \"console-5c98558dfd-mvrnw\" (UID: \"d22d3775-edfe-46f0-aa57-547e4035ab1e\") " pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.844014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.843976    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:06.978620 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:06.978596    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c98558dfd-mvrnw"]
Jul 15 12:21:06.979965 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:21:06.979937    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22d3775_edfe_46f0_aa57_547e4035ab1e.slice/crio-1c2bbe042ad7dd3c8b38fd3a578477c6131d8024d46db1b78c7ff1868088bbff WatchSource:0}: Error finding container 1c2bbe042ad7dd3c8b38fd3a578477c6131d8024d46db1b78c7ff1868088bbff: Status 404 returned error can't find the container with id 1c2bbe042ad7dd3c8b38fd3a578477c6131d8024d46db1b78c7ff1868088bbff
Jul 15 12:21:07.118815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:07.118775    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c98558dfd-mvrnw" event={"ID":"d22d3775-edfe-46f0-aa57-547e4035ab1e","Type":"ContainerStarted","Data":"10d0e7e065c6d54d6ec002283bea9c4b5a05db9595fdd8b2d45dd6f9749bc724"}
Jul 15 12:21:07.119307 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:07.118841    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c98558dfd-mvrnw" event={"ID":"d22d3775-edfe-46f0-aa57-547e4035ab1e","Type":"ContainerStarted","Data":"1c2bbe042ad7dd3c8b38fd3a578477c6131d8024d46db1b78c7ff1868088bbff"}
Jul 15 12:21:07.120143 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:07.120108    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m" event={"ID":"5246d0fd-b3fe-4b26-b6b1-c73be1aff102","Type":"ContainerStarted","Data":"688fd956af2393fcddcd0473aa66ebfbbecf28c43e68a9941569dd030a4acf12"}
Jul 15 12:21:07.140564 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:07.140514    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c98558dfd-mvrnw" podStartSLOduration=1.140499315 podStartE2EDuration="1.140499315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:07.1387668 +0000 UTC m=+594.086795452" watchObservedRunningTime="2026-07-15 12:21:07.140499315 +0000 UTC m=+594.088527944"
Jul 15 12:21:13.155165 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:13.155104    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m" event={"ID":"5246d0fd-b3fe-4b26-b6b1-c73be1aff102","Type":"ContainerStarted","Data":"36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603"}
Jul 15 12:21:13.155700 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:13.155249    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:13.179660 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:13.179605    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m" podStartSLOduration=1.573017259 podStartE2EDuration="7.179589461s" totalImagesPullingTime="5.606572202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:13.176201036 +0000 UTC m=+600.124229686" watchObservedRunningTime="2026-07-15 12:21:13.179589461 +0000 UTC m=+600.127618112"
Jul 15 12:21:14.857086 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:14.857053    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"]
Jul 15 12:21:14.860364 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:14.860344    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:14.863549 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:14.863529    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 12:21:14.863668 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:14.863535    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wkg9l\""
Jul 15 12:21:14.863668 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:14.863565    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 12:21:14.869563 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:14.869542    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"]
Jul 15 12:21:15.002532 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.002493    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed462f5d-c528-449b-b38c-eef5d438a0cb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x55x2\" (UID: \"ed462f5d-c528-449b-b38c-eef5d438a0cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.002713 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.002540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh7jq\" (UniqueName: \"kubernetes.io/projected/ed462f5d-c528-449b-b38c-eef5d438a0cb-kube-api-access-wh7jq\") pod \"kuadrant-console-plugin-66b5774985-x55x2\" (UID: \"ed462f5d-c528-449b-b38c-eef5d438a0cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.002713 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.002623    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed462f5d-c528-449b-b38c-eef5d438a0cb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x55x2\" (UID: \"ed462f5d-c528-449b-b38c-eef5d438a0cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.103117 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.103080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed462f5d-c528-449b-b38c-eef5d438a0cb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x55x2\" (UID: \"ed462f5d-c528-449b-b38c-eef5d438a0cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.103281 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.103182    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed462f5d-c528-449b-b38c-eef5d438a0cb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x55x2\" (UID: \"ed462f5d-c528-449b-b38c-eef5d438a0cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.103281 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.103210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh7jq\" (UniqueName: \"kubernetes.io/projected/ed462f5d-c528-449b-b38c-eef5d438a0cb-kube-api-access-wh7jq\") pod \"kuadrant-console-plugin-66b5774985-x55x2\" (UID: \"ed462f5d-c528-449b-b38c-eef5d438a0cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.103882 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.103861    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed462f5d-c528-449b-b38c-eef5d438a0cb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x55x2\" (UID: \"ed462f5d-c528-449b-b38c-eef5d438a0cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.105554 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.105534    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed462f5d-c528-449b-b38c-eef5d438a0cb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x55x2\" (UID: \"ed462f5d-c528-449b-b38c-eef5d438a0cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.113109 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.113047    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh7jq\" (UniqueName: \"kubernetes.io/projected/ed462f5d-c528-449b-b38c-eef5d438a0cb-kube-api-access-wh7jq\") pod \"kuadrant-console-plugin-66b5774985-x55x2\" (UID: \"ed462f5d-c528-449b-b38c-eef5d438a0cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.172072 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.172033    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"
Jul 15 12:21:15.308777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.308753    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2"]
Jul 15 12:21:15.310659 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:21:15.310633    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded462f5d_c528_449b_b38c_eef5d438a0cb.slice/crio-d83fc6cef92e674148eaaba0b1802cca7364a1eb2959ab021c374f66b574b79a WatchSource:0}: Error finding container d83fc6cef92e674148eaaba0b1802cca7364a1eb2959ab021c374f66b574b79a: Status 404 returned error can't find the container with id d83fc6cef92e674148eaaba0b1802cca7364a1eb2959ab021c374f66b574b79a
Jul 15 12:21:15.854087 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.854061    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:21:15.854325 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:15.854091    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:21:16.114016 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:16.113926    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbb8w"
Jul 15 12:21:16.175500 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:16.175464    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2" event={"ID":"ed462f5d-c528-449b-b38c-eef5d438a0cb","Type":"ContainerStarted","Data":"d83fc6cef92e674148eaaba0b1802cca7364a1eb2959ab021c374f66b574b79a"}
Jul 15 12:21:16.844275 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:16.844232    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:16.844491 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:16.844325    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:16.851041 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:16.851011    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:17.186824 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:17.186752    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c98558dfd-mvrnw"
Jul 15 12:21:17.234631 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:17.234595    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dfb9d665-rzxz9"]
Jul 15 12:21:24.162517 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:24.162484    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:26.039215 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.039176    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"]
Jul 15 12:21:26.039700 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.039451    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" containerName="manager" containerID="cri-o://36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603" gracePeriod=2
Jul 15 12:21:26.051694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.051663    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"]
Jul 15 12:21:26.054963 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.054936    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"]
Jul 15 12:21:26.055423 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.055407    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" containerName="manager"
Jul 15 12:21:26.055536 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.055426    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" containerName="manager"
Jul 15 12:21:26.055536 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.055519    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" containerName="manager"
Jul 15 12:21:26.060708 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.060678    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:26.062025 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:21:26.061760    2571 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\": pods \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:26.064229 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:21:26.064196    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" is forbidden: User \"system:node:ip-10-0-142-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-29.ec2.internal' and this object" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:26.066146 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.066124    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"]
Jul 15 12:21:26.071850 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.071825    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"]
Jul 15 12:21:26.071956 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.071945    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:26.089672 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.089603    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"]
Jul 15 12:21:26.094894 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:21:26.094837    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" is forbidden: User \"system:node:ip-10-0-142-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-29.ec2.internal' and this object" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:26.214643 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.214609    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91bd62d3-e367-4b0f-babf-c4dbf6185288-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d48kj\" (UID: \"91bd62d3-e367-4b0f-babf-c4dbf6185288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:26.214822 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.214654    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b59e2a-60d0-4985-bbeb-71bda07963c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8bzdh\" (UID: \"03b59e2a-60d0-4985-bbeb-71bda07963c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:26.214822 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.214685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzvrj\" (UniqueName: \"kubernetes.io/projected/03b59e2a-60d0-4985-bbeb-71bda07963c5-kube-api-access-jzvrj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8bzdh\" (UID: \"03b59e2a-60d0-4985-bbeb-71bda07963c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:26.214822 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.214705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl8lp\" (UniqueName: \"kubernetes.io/projected/91bd62d3-e367-4b0f-babf-c4dbf6185288-kube-api-access-wl8lp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d48kj\" (UID: \"91bd62d3-e367-4b0f-babf-c4dbf6185288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:26.316271 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.316232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91bd62d3-e367-4b0f-babf-c4dbf6185288-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d48kj\" (UID: \"91bd62d3-e367-4b0f-babf-c4dbf6185288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:26.316271 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.316273    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b59e2a-60d0-4985-bbeb-71bda07963c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8bzdh\" (UID: \"03b59e2a-60d0-4985-bbeb-71bda07963c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:26.316572 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.316310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzvrj\" (UniqueName: \"kubernetes.io/projected/03b59e2a-60d0-4985-bbeb-71bda07963c5-kube-api-access-jzvrj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8bzdh\" (UID: \"03b59e2a-60d0-4985-bbeb-71bda07963c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:26.316572 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.316340    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl8lp\" (UniqueName: \"kubernetes.io/projected/91bd62d3-e367-4b0f-babf-c4dbf6185288-kube-api-access-wl8lp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d48kj\" (UID: \"91bd62d3-e367-4b0f-babf-c4dbf6185288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:26.316697 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.316640    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91bd62d3-e367-4b0f-babf-c4dbf6185288-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d48kj\" (UID: \"91bd62d3-e367-4b0f-babf-c4dbf6185288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:26.316760 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.316688    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b59e2a-60d0-4985-bbeb-71bda07963c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8bzdh\" (UID: \"03b59e2a-60d0-4985-bbeb-71bda07963c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:26.325487 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.325452    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl8lp\" (UniqueName: \"kubernetes.io/projected/91bd62d3-e367-4b0f-babf-c4dbf6185288-kube-api-access-wl8lp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d48kj\" (UID: \"91bd62d3-e367-4b0f-babf-c4dbf6185288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:26.325670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.325452    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzvrj\" (UniqueName: \"kubernetes.io/projected/03b59e2a-60d0-4985-bbeb-71bda07963c5-kube-api-access-jzvrj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8bzdh\" (UID: \"03b59e2a-60d0-4985-bbeb-71bda07963c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:26.426096 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.426048    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:26.433254 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:26.433224    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:39.044350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.044235    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:39.047062 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:21:39.047030    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" is forbidden: User \"system:node:ip-10-0-142-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-29.ec2.internal' and this object" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:39.078823 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.078792    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"]
Jul 15 12:21:39.079435 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:21:39.079412    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bd62d3_e367_4b0f_babf_c4dbf6185288.slice/crio-ec337612d5bb79d5e7fb3bdfdd0537800e94e6d56427e0d091af88f3878e32b6 WatchSource:0}: Error finding container ec337612d5bb79d5e7fb3bdfdd0537800e94e6d56427e0d091af88f3878e32b6: Status 404 returned error can't find the container with id ec337612d5bb79d5e7fb3bdfdd0537800e94e6d56427e0d091af88f3878e32b6
Jul 15 12:21:39.093506 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.093479    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"]
Jul 15 12:21:39.094961 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:21:39.094936    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b59e2a_60d0_4985_bbeb_71bda07963c5.slice/crio-7d12a547242c6d246fae73fba1ae4239eb23975a45e33c994fdca97420e762a8 WatchSource:0}: Error finding container 7d12a547242c6d246fae73fba1ae4239eb23975a45e33c994fdca97420e762a8: Status 404 returned error can't find the container with id 7d12a547242c6d246fae73fba1ae4239eb23975a45e33c994fdca97420e762a8
Jul 15 12:21:39.140571 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.140548    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsbxf\" (UniqueName: \"kubernetes.io/projected/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-kube-api-access-zsbxf\") pod \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\" (UID: \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\") "
Jul 15 12:21:39.140666 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.140652    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-extensions-socket-volume\") pod \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\" (UID: \"5246d0fd-b3fe-4b26-b6b1-c73be1aff102\") "
Jul 15 12:21:39.141103 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.141073    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5246d0fd-b3fe-4b26-b6b1-c73be1aff102" (UID: "5246d0fd-b3fe-4b26-b6b1-c73be1aff102"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:21:39.142521 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.142498    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-kube-api-access-zsbxf" (OuterVolumeSpecName: "kube-api-access-zsbxf") pod "5246d0fd-b3fe-4b26-b6b1-c73be1aff102" (UID: "5246d0fd-b3fe-4b26-b6b1-c73be1aff102"). InnerVolumeSpecName "kube-api-access-zsbxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:21:39.241551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.241437    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsbxf\" (UniqueName: \"kubernetes.io/projected/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-kube-api-access-zsbxf\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:39.241551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.241474    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5246d0fd-b3fe-4b26-b6b1-c73be1aff102-extensions-socket-volume\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:39.326704 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.326667    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2" event={"ID":"ed462f5d-c528-449b-b38c-eef5d438a0cb","Type":"ContainerStarted","Data":"06364dd3600ebad609cbbc68bc13108479f6abbdfec1790aac1160d9551e4a70"}
Jul 15 12:21:39.328261 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.328232    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh" event={"ID":"03b59e2a-60d0-4985-bbeb-71bda07963c5","Type":"ContainerStarted","Data":"8c0b3b30aa4ea07b10336d187df67b90592007a359fd88cefbd14dbd67b5147b"}
Jul 15 12:21:39.328408 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.328285    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh" event={"ID":"03b59e2a-60d0-4985-bbeb-71bda07963c5","Type":"ContainerStarted","Data":"7d12a547242c6d246fae73fba1ae4239eb23975a45e33c994fdca97420e762a8"}
Jul 15 12:21:39.328408 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.328334    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:39.329193 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:21:39.329162    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" is forbidden: User \"system:node:ip-10-0-142-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-29.ec2.internal' and this object" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:39.330206 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.330166    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj" event={"ID":"91bd62d3-e367-4b0f-babf-c4dbf6185288","Type":"ContainerStarted","Data":"00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51"}
Jul 15 12:21:39.330406 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.330219    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj" event={"ID":"91bd62d3-e367-4b0f-babf-c4dbf6185288","Type":"ContainerStarted","Data":"ec337612d5bb79d5e7fb3bdfdd0537800e94e6d56427e0d091af88f3878e32b6"}
Jul 15 12:21:39.330406 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.330264    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:39.331796 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.331771    2571 generic.go:356] "Generic (PLEG): container finished" podID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" containerID="36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603" exitCode=0
Jul 15 12:21:39.331908 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.331808    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:39.331908 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.331821    2571 scope.go:117] "RemoveContainer" containerID="36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603"
Jul 15 12:21:39.342230 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.342146    2571 scope.go:117] "RemoveContainer" containerID="36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603"
Jul 15 12:21:39.342590 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:21:39.342494    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603\": container with ID starting with 36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603 not found: ID does not exist" containerID="36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603"
Jul 15 12:21:39.342590 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.342528    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603"} err="failed to get container status \"36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603\": rpc error: code = NotFound desc = could not find container \"36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603\": container with ID starting with 36cbceac93326064efff1fdd8cfa93e321a7706380607925155268f9a30db603 not found: ID does not exist"
Jul 15 12:21:39.345967 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.345925    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x55x2" podStartSLOduration=1.700135819 podStartE2EDuration="25.345913568s" totalImagesPullingTime="23.645777749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:39.344116342 +0000 UTC m=+626.292144994" watchObservedRunningTime="2026-07-15 12:21:39.345913568 +0000 UTC m=+626.293942219"
Jul 15 12:21:39.364239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.364178    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh" podStartSLOduration=13.364156343 podStartE2EDuration="13.364156343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:39.361740624 +0000 UTC m=+626.309769299" watchObservedRunningTime="2026-07-15 12:21:39.364156343 +0000 UTC m=+626.312184996"
Jul 15 12:21:39.382756 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:21:39.382718    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dhq5m\" is forbidden: User \"system:node:ip-10-0-142-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-29.ec2.internal' and this object" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dhq5m"
Jul 15 12:21:39.383189 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.383149    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj" podStartSLOduration=13.383132413 podStartE2EDuration="13.383132413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:39.380373629 +0000 UTC m=+626.328402279" watchObservedRunningTime="2026-07-15 12:21:39.383132413 +0000 UTC m=+626.331161064"
Jul 15 12:21:39.632245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:39.632199    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5246d0fd-b3fe-4b26-b6b1-c73be1aff102" path="/var/lib/kubelet/pods/5246d0fd-b3fe-4b26-b6b1-c73be1aff102/volumes"
Jul 15 12:21:42.266462 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.266419    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66dfb9d665-rzxz9" podUID="091e55d9-ec51-417c-893c-31990940ce23" containerName="console" containerID="cri-o://8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc" gracePeriod=15
Jul 15 12:21:42.536795 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.536770    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:21:42.570005 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.569975    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-serving-cert\") pod \"091e55d9-ec51-417c-893c-31990940ce23\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") "
Jul 15 12:21:42.570156 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570022    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-oauth-config\") pod \"091e55d9-ec51-417c-893c-31990940ce23\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") "
Jul 15 12:21:42.570156 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570041    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-trusted-ca-bundle\") pod \"091e55d9-ec51-417c-893c-31990940ce23\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") "
Jul 15 12:21:42.570156 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570093    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8jcq\" (UniqueName: \"kubernetes.io/projected/091e55d9-ec51-417c-893c-31990940ce23-kube-api-access-b8jcq\") pod \"091e55d9-ec51-417c-893c-31990940ce23\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") "
Jul 15 12:21:42.570156 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570133    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-oauth-serving-cert\") pod \"091e55d9-ec51-417c-893c-31990940ce23\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") "
Jul 15 12:21:42.570417 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570187    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-console-config\") pod \"091e55d9-ec51-417c-893c-31990940ce23\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") "
Jul 15 12:21:42.570417 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570210    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-service-ca\") pod \"091e55d9-ec51-417c-893c-31990940ce23\" (UID: \"091e55d9-ec51-417c-893c-31990940ce23\") "
Jul 15 12:21:42.570626 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570578    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "091e55d9-ec51-417c-893c-31990940ce23" (UID: "091e55d9-ec51-417c-893c-31990940ce23"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:21:42.570847 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570619    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "091e55d9-ec51-417c-893c-31990940ce23" (UID: "091e55d9-ec51-417c-893c-31990940ce23"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:21:42.570929 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570881    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-service-ca" (OuterVolumeSpecName: "service-ca") pod "091e55d9-ec51-417c-893c-31990940ce23" (UID: "091e55d9-ec51-417c-893c-31990940ce23"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:21:42.570929 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.570904    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-console-config" (OuterVolumeSpecName: "console-config") pod "091e55d9-ec51-417c-893c-31990940ce23" (UID: "091e55d9-ec51-417c-893c-31990940ce23"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:21:42.572411 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.572387    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "091e55d9-ec51-417c-893c-31990940ce23" (UID: "091e55d9-ec51-417c-893c-31990940ce23"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:21:42.572758 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.572734    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "091e55d9-ec51-417c-893c-31990940ce23" (UID: "091e55d9-ec51-417c-893c-31990940ce23"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:21:42.572758 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.572746    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/091e55d9-ec51-417c-893c-31990940ce23-kube-api-access-b8jcq" (OuterVolumeSpecName: "kube-api-access-b8jcq") pod "091e55d9-ec51-417c-893c-31990940ce23" (UID: "091e55d9-ec51-417c-893c-31990940ce23"). InnerVolumeSpecName "kube-api-access-b8jcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:21:42.671270 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.671237    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8jcq\" (UniqueName: \"kubernetes.io/projected/091e55d9-ec51-417c-893c-31990940ce23-kube-api-access-b8jcq\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:42.671270 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.671265    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-oauth-serving-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:42.671270 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.671274    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-console-config\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:42.671531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.671282    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:42.671531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.671323    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-serving-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:42.671531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.671336    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/091e55d9-ec51-417c-893c-31990940ce23-console-oauth-config\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:42.671531 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:42.671349    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/091e55d9-ec51-417c-893c-31990940ce23-trusted-ca-bundle\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:43.356521 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.356483    2571 generic.go:356] "Generic (PLEG): container finished" podID="091e55d9-ec51-417c-893c-31990940ce23" containerID="8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc" exitCode=0
Jul 15 12:21:43.357004 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.356528    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dfb9d665-rzxz9"
Jul 15 12:21:43.357004 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.356565    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dfb9d665-rzxz9" event={"ID":"091e55d9-ec51-417c-893c-31990940ce23","Type":"ContainerDied","Data":"8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc"}
Jul 15 12:21:43.357004 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.356615    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dfb9d665-rzxz9" event={"ID":"091e55d9-ec51-417c-893c-31990940ce23","Type":"ContainerDied","Data":"86aba3c9ce0ef181e63a447f54469e77802d36eb772af235041d1fb904b85e9f"}
Jul 15 12:21:43.357004 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.356635    2571 scope.go:117] "RemoveContainer" containerID="8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc"
Jul 15 12:21:43.366118 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.366099    2571 scope.go:117] "RemoveContainer" containerID="8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc"
Jul 15 12:21:43.366393 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:21:43.366373    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc\": container with ID starting with 8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc not found: ID does not exist" containerID="8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc"
Jul 15 12:21:43.366452 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.366401    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc"} err="failed to get container status \"8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc\": rpc error: code = NotFound desc = could not find container \"8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc\": container with ID starting with 8ef4db101a513f69083acf9192817461e0212ab7008d8175efe903c61dde14cc not found: ID does not exist"
Jul 15 12:21:43.379892 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.379859    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dfb9d665-rzxz9"]
Jul 15 12:21:43.383153 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.383127    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66dfb9d665-rzxz9"]
Jul 15 12:21:43.628161 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:43.628072    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="091e55d9-ec51-417c-893c-31990940ce23" path="/var/lib/kubelet/pods/091e55d9-ec51-417c-893c-31990940ce23/volumes"
Jul 15 12:21:50.340823 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.340795    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:21:50.341261 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.341072    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:50.409001 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.408969    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"]
Jul 15 12:21:50.409239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.409185    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj" podUID="91bd62d3-e367-4b0f-babf-c4dbf6185288" containerName="manager" containerID="cri-o://00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51" gracePeriod=10
Jul 15 12:21:50.666221 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.666199    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:50.742181 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.742151    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91bd62d3-e367-4b0f-babf-c4dbf6185288-extensions-socket-volume\") pod \"91bd62d3-e367-4b0f-babf-c4dbf6185288\" (UID: \"91bd62d3-e367-4b0f-babf-c4dbf6185288\") "
Jul 15 12:21:50.742181 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.742186    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl8lp\" (UniqueName: \"kubernetes.io/projected/91bd62d3-e367-4b0f-babf-c4dbf6185288-kube-api-access-wl8lp\") pod \"91bd62d3-e367-4b0f-babf-c4dbf6185288\" (UID: \"91bd62d3-e367-4b0f-babf-c4dbf6185288\") "
Jul 15 12:21:50.742611 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.742588    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91bd62d3-e367-4b0f-babf-c4dbf6185288-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "91bd62d3-e367-4b0f-babf-c4dbf6185288" (UID: "91bd62d3-e367-4b0f-babf-c4dbf6185288"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:21:50.744239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.744215    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91bd62d3-e367-4b0f-babf-c4dbf6185288-kube-api-access-wl8lp" (OuterVolumeSpecName: "kube-api-access-wl8lp") pod "91bd62d3-e367-4b0f-babf-c4dbf6185288" (UID: "91bd62d3-e367-4b0f-babf-c4dbf6185288"). InnerVolumeSpecName "kube-api-access-wl8lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:21:50.843546 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.843506    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91bd62d3-e367-4b0f-babf-c4dbf6185288-extensions-socket-volume\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:50.843546 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:50.843534    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl8lp\" (UniqueName: \"kubernetes.io/projected/91bd62d3-e367-4b0f-babf-c4dbf6185288-kube-api-access-wl8lp\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:21:51.402845 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.402814    2571 generic.go:356] "Generic (PLEG): container finished" podID="91bd62d3-e367-4b0f-babf-c4dbf6185288" containerID="00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51" exitCode=0
Jul 15 12:21:51.403234 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.402858    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"
Jul 15 12:21:51.403234 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.402904    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj" event={"ID":"91bd62d3-e367-4b0f-babf-c4dbf6185288","Type":"ContainerDied","Data":"00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51"}
Jul 15 12:21:51.403234 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.402951    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj" event={"ID":"91bd62d3-e367-4b0f-babf-c4dbf6185288","Type":"ContainerDied","Data":"ec337612d5bb79d5e7fb3bdfdd0537800e94e6d56427e0d091af88f3878e32b6"}
Jul 15 12:21:51.403234 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.402974    2571 scope.go:117] "RemoveContainer" containerID="00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51"
Jul 15 12:21:51.412765 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.412597    2571 scope.go:117] "RemoveContainer" containerID="00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51"
Jul 15 12:21:51.412839 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:21:51.412823    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51\": container with ID starting with 00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51 not found: ID does not exist" containerID="00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51"
Jul 15 12:21:51.412881 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.412846    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51"} err="failed to get container status \"00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51\": rpc error: code = NotFound desc = could not find container \"00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51\": container with ID starting with 00e7bb9aed9e8955163cf2fa60a8e9fbb3cf5da9e2f348278f58235cf7019c51 not found: ID does not exist"
Jul 15 12:21:51.429305 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.429258    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"]
Jul 15 12:21:51.436255 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.436225    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d48kj"]
Jul 15 12:21:51.626990 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:21:51.626948    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91bd62d3-e367-4b0f-babf-c4dbf6185288" path="/var/lib/kubelet/pods/91bd62d3-e367-4b0f-babf-c4dbf6185288/volumes"
Jul 15 12:22:03.135822 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:03.135786    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"]
Jul 15 12:22:03.136380 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:03.136009    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh" podUID="03b59e2a-60d0-4985-bbeb-71bda07963c5" containerName="manager" containerID="cri-o://8c0b3b30aa4ea07b10336d187df67b90592007a359fd88cefbd14dbd67b5147b" gracePeriod=10
Jul 15 12:22:03.481829 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:03.481745    2571 generic.go:356] "Generic (PLEG): container finished" podID="03b59e2a-60d0-4985-bbeb-71bda07963c5" containerID="8c0b3b30aa4ea07b10336d187df67b90592007a359fd88cefbd14dbd67b5147b" exitCode=0
Jul 15 12:22:03.481977 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:03.481821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh" event={"ID":"03b59e2a-60d0-4985-bbeb-71bda07963c5","Type":"ContainerDied","Data":"8c0b3b30aa4ea07b10336d187df67b90592007a359fd88cefbd14dbd67b5147b"}
Jul 15 12:22:03.996273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:03.996240    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:22:04.061843 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.061810    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzvrj\" (UniqueName: \"kubernetes.io/projected/03b59e2a-60d0-4985-bbeb-71bda07963c5-kube-api-access-jzvrj\") pod \"03b59e2a-60d0-4985-bbeb-71bda07963c5\" (UID: \"03b59e2a-60d0-4985-bbeb-71bda07963c5\") "
Jul 15 12:22:04.062014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.061896    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b59e2a-60d0-4985-bbeb-71bda07963c5-extensions-socket-volume\") pod \"03b59e2a-60d0-4985-bbeb-71bda07963c5\" (UID: \"03b59e2a-60d0-4985-bbeb-71bda07963c5\") "
Jul 15 12:22:04.062318 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.062256    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03b59e2a-60d0-4985-bbeb-71bda07963c5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "03b59e2a-60d0-4985-bbeb-71bda07963c5" (UID: "03b59e2a-60d0-4985-bbeb-71bda07963c5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:22:04.063952 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.063932    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b59e2a-60d0-4985-bbeb-71bda07963c5-kube-api-access-jzvrj" (OuterVolumeSpecName: "kube-api-access-jzvrj") pod "03b59e2a-60d0-4985-bbeb-71bda07963c5" (UID: "03b59e2a-60d0-4985-bbeb-71bda07963c5"). InnerVolumeSpecName "kube-api-access-jzvrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:22:04.162769 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.162675    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b59e2a-60d0-4985-bbeb-71bda07963c5-extensions-socket-volume\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:22:04.162769 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.162707    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzvrj\" (UniqueName: \"kubernetes.io/projected/03b59e2a-60d0-4985-bbeb-71bda07963c5-kube-api-access-jzvrj\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:22:04.488777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.488685    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"
Jul 15 12:22:04.488777 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.488721    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh" event={"ID":"03b59e2a-60d0-4985-bbeb-71bda07963c5","Type":"ContainerDied","Data":"7d12a547242c6d246fae73fba1ae4239eb23975a45e33c994fdca97420e762a8"}
Jul 15 12:22:04.488999 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.488818    2571 scope.go:117] "RemoveContainer" containerID="8c0b3b30aa4ea07b10336d187df67b90592007a359fd88cefbd14dbd67b5147b"
Jul 15 12:22:04.512096 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.512066    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"]
Jul 15 12:22:04.515770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:04.515741    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8bzdh"]
Jul 15 12:22:05.626972 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:05.626934    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03b59e2a-60d0-4985-bbeb-71bda07963c5" path="/var/lib/kubelet/pods/03b59e2a-60d0-4985-bbeb-71bda07963c5/volumes"
Jul 15 12:22:06.930222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930191    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"]
Jul 15 12:22:06.930770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930750    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91bd62d3-e367-4b0f-babf-c4dbf6185288" containerName="manager"
Jul 15 12:22:06.930849 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930773    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="91bd62d3-e367-4b0f-babf-c4dbf6185288" containerName="manager"
Jul 15 12:22:06.930849 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930790    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b59e2a-60d0-4985-bbeb-71bda07963c5" containerName="manager"
Jul 15 12:22:06.930849 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930799    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b59e2a-60d0-4985-bbeb-71bda07963c5" containerName="manager"
Jul 15 12:22:06.930849 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930837    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="091e55d9-ec51-417c-893c-31990940ce23" containerName="console"
Jul 15 12:22:06.930849 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930846    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="091e55d9-ec51-417c-893c-31990940ce23" containerName="console"
Jul 15 12:22:06.931093 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930941    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b59e2a-60d0-4985-bbeb-71bda07963c5" containerName="manager"
Jul 15 12:22:06.931093 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930957    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="091e55d9-ec51-417c-893c-31990940ce23" containerName="console"
Jul 15 12:22:06.931093 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.930966    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="91bd62d3-e367-4b0f-babf-c4dbf6185288" containerName="manager"
Jul 15 12:22:06.934150 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.934128    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:06.937334 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.937311    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9f4qh\""
Jul 15 12:22:06.945345 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.945321    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"]
Jul 15 12:22:06.987896 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.987855    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:06.988094 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.987930    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:06.988094 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.988004    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:06.988094 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.988041    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:06.988094 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.988077    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk2dm\" (UniqueName: \"kubernetes.io/projected/66504273-8aab-423e-a6f8-4c6fa32729b1-kube-api-access-rk2dm\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:06.988260 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.988112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:06.988260 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.988176    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:06.988260 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.988217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:06.988260 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:06.988240    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66504273-8aab-423e-a6f8-4c6fa32729b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.089370 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089328    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.089586 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089382    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.089586 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66504273-8aab-423e-a6f8-4c6fa32729b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.089586 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.089759 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.089759 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089660    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.089759 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089687    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.089759 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089720    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk2dm\" (UniqueName: \"kubernetes.io/projected/66504273-8aab-423e-a6f8-4c6fa32729b1-kube-api-access-rk2dm\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.089759 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.090018 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089841    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.090018 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.089856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.090228 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.090201    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66504273-8aab-423e-a6f8-4c6fa32729b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.090285 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.090251    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.090364 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.090318    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.092157 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.092122    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.092338 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.092168    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.097818 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.097796    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66504273-8aab-423e-a6f8-4c6fa32729b1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.097934 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.097854    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk2dm\" (UniqueName: \"kubernetes.io/projected/66504273-8aab-423e-a6f8-4c6fa32729b1-kube-api-access-rk2dm\") pod \"maas-default-gateway-openshift-default-56654dcf7-82jbx\" (UID: \"66504273-8aab-423e-a6f8-4c6fa32729b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.244614 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.244517    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:07.389512 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.389480    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"]
Jul 15 12:22:07.390656 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:22:07.390636    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66504273_8aab_423e_a6f8_4c6fa32729b1.slice/crio-8717b2ca04545256e3d9835f5f21c178500c6f38c68c25efa1f519c5fd1b0ff0 WatchSource:0}: Error finding container 8717b2ca04545256e3d9835f5f21c178500c6f38c68c25efa1f519c5fd1b0ff0: Status 404 returned error can't find the container with id 8717b2ca04545256e3d9835f5f21c178500c6f38c68c25efa1f519c5fd1b0ff0
Jul 15 12:22:07.396853 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.396819    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:22:07.396948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.396889    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:22:07.396948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.396918    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:22:07.508757 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.508645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx" event={"ID":"66504273-8aab-423e-a6f8-4c6fa32729b1","Type":"ContainerStarted","Data":"8af25426072c5f8ce152d02c6bb13100c3cd13b4a5d23841dde736db335608d0"}
Jul 15 12:22:07.508757 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.508716    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx" event={"ID":"66504273-8aab-423e-a6f8-4c6fa32729b1","Type":"ContainerStarted","Data":"8717b2ca04545256e3d9835f5f21c178500c6f38c68c25efa1f519c5fd1b0ff0"}
Jul 15 12:22:07.530634 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:07.530578    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx" podStartSLOduration=1.530558096 podStartE2EDuration="1.530558096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:07.527722714 +0000 UTC m=+654.475751367" watchObservedRunningTime="2026-07-15 12:22:07.530558096 +0000 UTC m=+654.478586750"
Jul 15 12:22:08.245435 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:08.245396    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:08.250841 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:08.250809    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:08.514873 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:08.514785    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:08.515762 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:08.515743    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:22:23.456576 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.456537    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zntrx"]
Jul 15 12:22:23.497072 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.497030    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zntrx"]
Jul 15 12:22:23.497244 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.497152    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:23.499995 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.499972    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 12:22:23.559109 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.559070    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zntrx"]
Jul 15 12:22:23.639759 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.639722    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtzxn\" (UniqueName: \"kubernetes.io/projected/aaa0ddd1-40f2-4b56-9838-01089a6194ba-kube-api-access-wtzxn\") pod \"limitador-limitador-64c94fd64f-zntrx\" (UID: \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:23.639759 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.639772    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa0ddd1-40f2-4b56-9838-01089a6194ba-config-file\") pod \"limitador-limitador-64c94fd64f-zntrx\" (UID: \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:23.741421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.741326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtzxn\" (UniqueName: \"kubernetes.io/projected/aaa0ddd1-40f2-4b56-9838-01089a6194ba-kube-api-access-wtzxn\") pod \"limitador-limitador-64c94fd64f-zntrx\" (UID: \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:23.741421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.741368    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa0ddd1-40f2-4b56-9838-01089a6194ba-config-file\") pod \"limitador-limitador-64c94fd64f-zntrx\" (UID: \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:23.742054 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.742030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa0ddd1-40f2-4b56-9838-01089a6194ba-config-file\") pod \"limitador-limitador-64c94fd64f-zntrx\" (UID: \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:23.754560 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.754533    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtzxn\" (UniqueName: \"kubernetes.io/projected/aaa0ddd1-40f2-4b56-9838-01089a6194ba-kube-api-access-wtzxn\") pod \"limitador-limitador-64c94fd64f-zntrx\" (UID: \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:23.778568 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.778535    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:22:23.782127 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.782110    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:23.790465 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.790438    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:22:23.807739 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.807707    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:23.817279 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.817254    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:22:23.942443 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.942421    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zntrx"]
Jul 15 12:22:23.943683 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.943660    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/be2b26f3-d63a-4732-8740-17236a8b470a-config-file\") pod \"limitador-limitador-54d6d988d5-gpz49\" (UID: \"be2b26f3-d63a-4732-8740-17236a8b470a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:23.943817 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:23.943698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt5b2\" (UniqueName: \"kubernetes.io/projected/be2b26f3-d63a-4732-8740-17236a8b470a-kube-api-access-jt5b2\") pod \"limitador-limitador-54d6d988d5-gpz49\" (UID: \"be2b26f3-d63a-4732-8740-17236a8b470a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:23.944435 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:22:23.944413    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa0ddd1_40f2_4b56_9838_01089a6194ba.slice/crio-188742f1ee590f924faf798c74ed877b0ba35fcb94055f36e4caf26231ff4cd6 WatchSource:0}: Error finding container 188742f1ee590f924faf798c74ed877b0ba35fcb94055f36e4caf26231ff4cd6: Status 404 returned error can't find the container with id 188742f1ee590f924faf798c74ed877b0ba35fcb94055f36e4caf26231ff4cd6
Jul 15 12:22:24.044631 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:24.044532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt5b2\" (UniqueName: \"kubernetes.io/projected/be2b26f3-d63a-4732-8740-17236a8b470a-kube-api-access-jt5b2\") pod \"limitador-limitador-54d6d988d5-gpz49\" (UID: \"be2b26f3-d63a-4732-8740-17236a8b470a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:24.044815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:24.044680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/be2b26f3-d63a-4732-8740-17236a8b470a-config-file\") pod \"limitador-limitador-54d6d988d5-gpz49\" (UID: \"be2b26f3-d63a-4732-8740-17236a8b470a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:24.045327 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:24.045279    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/be2b26f3-d63a-4732-8740-17236a8b470a-config-file\") pod \"limitador-limitador-54d6d988d5-gpz49\" (UID: \"be2b26f3-d63a-4732-8740-17236a8b470a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:24.052606 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:24.052582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt5b2\" (UniqueName: \"kubernetes.io/projected/be2b26f3-d63a-4732-8740-17236a8b470a-kube-api-access-jt5b2\") pod \"limitador-limitador-54d6d988d5-gpz49\" (UID: \"be2b26f3-d63a-4732-8740-17236a8b470a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:24.093945 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:24.093912    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:24.230384 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:24.230352    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:22:24.231141 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:22:24.231125    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2b26f3_d63a_4732_8740_17236a8b470a.slice/crio-0b48d8850cf435f1a81377840a576ae698839ce2aee2659edf3a5b1ad794f8a1 WatchSource:0}: Error finding container 0b48d8850cf435f1a81377840a576ae698839ce2aee2659edf3a5b1ad794f8a1: Status 404 returned error can't find the container with id 0b48d8850cf435f1a81377840a576ae698839ce2aee2659edf3a5b1ad794f8a1
Jul 15 12:22:24.603152 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:24.603066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49" event={"ID":"be2b26f3-d63a-4732-8740-17236a8b470a","Type":"ContainerStarted","Data":"0b48d8850cf435f1a81377840a576ae698839ce2aee2659edf3a5b1ad794f8a1"}
Jul 15 12:22:24.605219 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:24.605151    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx" event={"ID":"aaa0ddd1-40f2-4b56-9838-01089a6194ba","Type":"ContainerStarted","Data":"188742f1ee590f924faf798c74ed877b0ba35fcb94055f36e4caf26231ff4cd6"}
Jul 15 12:22:27.627611 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:27.627583    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:27.628051 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:27.627638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49" event={"ID":"be2b26f3-d63a-4732-8740-17236a8b470a","Type":"ContainerStarted","Data":"fd23c377baed32e5198c4fa9b262ba2cd188053ac9664621b211e0eb5429dc46"}
Jul 15 12:22:27.628051 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:27.627887    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx" event={"ID":"aaa0ddd1-40f2-4b56-9838-01089a6194ba","Type":"ContainerStarted","Data":"cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab"}
Jul 15 12:22:27.628051 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:27.627938    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:27.646967 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:27.646919    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49" podStartSLOduration=1.948920311 podStartE2EDuration="4.646904812s" totalImagesPullingTime="2.697984501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:27.644903082 +0000 UTC m=+674.592931732" watchObservedRunningTime="2026-07-15 12:22:27.646904812 +0000 UTC m=+674.594933484"
Jul 15 12:22:27.661430 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:27.661387    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx" podStartSLOduration=1.684356658 podStartE2EDuration="4.661376933s" totalImagesPullingTime="2.977020275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:27.660177759 +0000 UTC m=+674.608206422" watchObservedRunningTime="2026-07-15 12:22:27.661376933 +0000 UTC m=+674.609405584"
Jul 15 12:22:38.633994 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:38.633963    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:38.634423 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:38.634043    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpz49"
Jul 15 12:22:38.693750 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:38.693720    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zntrx"]
Jul 15 12:22:38.693922 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:38.693890    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx" podUID="aaa0ddd1-40f2-4b56-9838-01089a6194ba" containerName="limitador" containerID="cri-o://cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab" gracePeriod=30
Jul 15 12:22:39.247104 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.247079    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:39.289129 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.289045    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa0ddd1-40f2-4b56-9838-01089a6194ba-config-file\") pod \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\" (UID: \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\") "
Jul 15 12:22:39.289129 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.289094    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtzxn\" (UniqueName: \"kubernetes.io/projected/aaa0ddd1-40f2-4b56-9838-01089a6194ba-kube-api-access-wtzxn\") pod \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\" (UID: \"aaa0ddd1-40f2-4b56-9838-01089a6194ba\") "
Jul 15 12:22:39.289432 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.289406    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaa0ddd1-40f2-4b56-9838-01089a6194ba-config-file" (OuterVolumeSpecName: "config-file") pod "aaa0ddd1-40f2-4b56-9838-01089a6194ba" (UID: "aaa0ddd1-40f2-4b56-9838-01089a6194ba"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:22:39.291169 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.291148    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaa0ddd1-40f2-4b56-9838-01089a6194ba-kube-api-access-wtzxn" (OuterVolumeSpecName: "kube-api-access-wtzxn") pod "aaa0ddd1-40f2-4b56-9838-01089a6194ba" (UID: "aaa0ddd1-40f2-4b56-9838-01089a6194ba"). InnerVolumeSpecName "kube-api-access-wtzxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:22:39.389874 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.389842    2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa0ddd1-40f2-4b56-9838-01089a6194ba-config-file\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:22:39.389874 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.389871    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtzxn\" (UniqueName: \"kubernetes.io/projected/aaa0ddd1-40f2-4b56-9838-01089a6194ba-kube-api-access-wtzxn\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:22:39.699801 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.699765    2571 generic.go:356] "Generic (PLEG): container finished" podID="aaa0ddd1-40f2-4b56-9838-01089a6194ba" containerID="cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab" exitCode=0
Jul 15 12:22:39.699801 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.699806    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx"
Jul 15 12:22:39.700339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.699861    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx" event={"ID":"aaa0ddd1-40f2-4b56-9838-01089a6194ba","Type":"ContainerDied","Data":"cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab"}
Jul 15 12:22:39.700339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.699923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zntrx" event={"ID":"aaa0ddd1-40f2-4b56-9838-01089a6194ba","Type":"ContainerDied","Data":"188742f1ee590f924faf798c74ed877b0ba35fcb94055f36e4caf26231ff4cd6"}
Jul 15 12:22:39.700339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.699958    2571 scope.go:117] "RemoveContainer" containerID="cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab"
Jul 15 12:22:39.709138 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.709118    2571 scope.go:117] "RemoveContainer" containerID="cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab"
Jul 15 12:22:39.709468 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:22:39.709448    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab\": container with ID starting with cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab not found: ID does not exist" containerID="cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab"
Jul 15 12:22:39.709535 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.709476    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab"} err="failed to get container status \"cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab\": rpc error: code = NotFound desc = could not find container \"cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab\": container with ID starting with cfcc2486f8201a1f00f6aa92ca7e43ba40fbb58b61442909ab8d88ceb0d919ab not found: ID does not exist"
Jul 15 12:22:39.717915 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.717888    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zntrx"]
Jul 15 12:22:39.723890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:39.723859    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zntrx"]
Jul 15 12:22:41.627399 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:41.627364    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaa0ddd1-40f2-4b56-9838-01089a6194ba" path="/var/lib/kubelet/pods/aaa0ddd1-40f2-4b56-9838-01089a6194ba/volumes"
Jul 15 12:22:53.848213 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:53.848174    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jf6bj"]
Jul 15 12:22:53.848702 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:53.848561    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa0ddd1-40f2-4b56-9838-01089a6194ba" containerName="limitador"
Jul 15 12:22:53.848702 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:53.848572    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa0ddd1-40f2-4b56-9838-01089a6194ba" containerName="limitador"
Jul 15 12:22:53.848702 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:53.848646    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa0ddd1-40f2-4b56-9838-01089a6194ba" containerName="limitador"
Jul 15 12:22:53.853400 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:53.853377    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jf6bj"
Jul 15 12:22:53.856248 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:53.856228    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lmljx\""
Jul 15 12:22:53.857583 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:53.857557    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jf6bj"]
Jul 15 12:22:53.925140 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:53.925103    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj8xg\" (UniqueName: \"kubernetes.io/projected/babe3da7-19cf-45e0-add8-cbbd3a95ea58-kube-api-access-mj8xg\") pod \"authorino-5d4b67c446-jf6bj\" (UID: \"babe3da7-19cf-45e0-add8-cbbd3a95ea58\") " pod="kuadrant-system/authorino-5d4b67c446-jf6bj"
Jul 15 12:22:53.991673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:53.991643    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jf6bj"]
Jul 15 12:22:53.991943 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:22:53.991922    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mj8xg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-jf6bj" podUID="babe3da7-19cf-45e0-add8-cbbd3a95ea58"
Jul 15 12:22:54.014590 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.014562    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-k48f9"]
Jul 15 12:22:54.016892 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.016876    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:54.019682 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.019659    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 12:22:54.025131 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.025105    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-k48f9"]
Jul 15 12:22:54.025984 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.025956    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj8xg\" (UniqueName: \"kubernetes.io/projected/babe3da7-19cf-45e0-add8-cbbd3a95ea58-kube-api-access-mj8xg\") pod \"authorino-5d4b67c446-jf6bj\" (UID: \"babe3da7-19cf-45e0-add8-cbbd3a95ea58\") " pod="kuadrant-system/authorino-5d4b67c446-jf6bj"
Jul 15 12:22:54.036875 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.036840    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj8xg\" (UniqueName: \"kubernetes.io/projected/babe3da7-19cf-45e0-add8-cbbd3a95ea58-kube-api-access-mj8xg\") pod \"authorino-5d4b67c446-jf6bj\" (UID: \"babe3da7-19cf-45e0-add8-cbbd3a95ea58\") " pod="kuadrant-system/authorino-5d4b67c446-jf6bj"
Jul 15 12:22:54.118875 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.118796    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-k48f9"]
Jul 15 12:22:54.119088 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:22:54.119068    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kq9ds tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-k48f9" podUID="50970115-3304-4bea-b675-1e7f205881ce"
Jul 15 12:22:54.126579 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.126553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9ds\" (UniqueName: \"kubernetes.io/projected/50970115-3304-4bea-b675-1e7f205881ce-kube-api-access-kq9ds\") pod \"authorino-76877994-k48f9\" (UID: \"50970115-3304-4bea-b675-1e7f205881ce\") " pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:54.126718 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.126621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50970115-3304-4bea-b675-1e7f205881ce-tls-cert\") pod \"authorino-76877994-k48f9\" (UID: \"50970115-3304-4bea-b675-1e7f205881ce\") " pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:54.228065 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.228027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9ds\" (UniqueName: \"kubernetes.io/projected/50970115-3304-4bea-b675-1e7f205881ce-kube-api-access-kq9ds\") pod \"authorino-76877994-k48f9\" (UID: \"50970115-3304-4bea-b675-1e7f205881ce\") " pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:54.228254 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.228088    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50970115-3304-4bea-b675-1e7f205881ce-tls-cert\") pod \"authorino-76877994-k48f9\" (UID: \"50970115-3304-4bea-b675-1e7f205881ce\") " pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:54.230551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.230526    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50970115-3304-4bea-b675-1e7f205881ce-tls-cert\") pod \"authorino-76877994-k48f9\" (UID: \"50970115-3304-4bea-b675-1e7f205881ce\") " pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:54.236017 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.235989    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9ds\" (UniqueName: \"kubernetes.io/projected/50970115-3304-4bea-b675-1e7f205881ce-kube-api-access-kq9ds\") pod \"authorino-76877994-k48f9\" (UID: \"50970115-3304-4bea-b675-1e7f205881ce\") " pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:54.782715 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.782683    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jf6bj"
Jul 15 12:22:54.782890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.782689    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:54.789229 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.789210    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jf6bj"
Jul 15 12:22:54.792216 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.792200    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:54.933898 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.933862    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq9ds\" (UniqueName: \"kubernetes.io/projected/50970115-3304-4bea-b675-1e7f205881ce-kube-api-access-kq9ds\") pod \"50970115-3304-4bea-b675-1e7f205881ce\" (UID: \"50970115-3304-4bea-b675-1e7f205881ce\") "
Jul 15 12:22:54.933898 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.933907    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj8xg\" (UniqueName: \"kubernetes.io/projected/babe3da7-19cf-45e0-add8-cbbd3a95ea58-kube-api-access-mj8xg\") pod \"babe3da7-19cf-45e0-add8-cbbd3a95ea58\" (UID: \"babe3da7-19cf-45e0-add8-cbbd3a95ea58\") "
Jul 15 12:22:54.934382 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.933953    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50970115-3304-4bea-b675-1e7f205881ce-tls-cert\") pod \"50970115-3304-4bea-b675-1e7f205881ce\" (UID: \"50970115-3304-4bea-b675-1e7f205881ce\") "
Jul 15 12:22:54.936012 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.935974    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/babe3da7-19cf-45e0-add8-cbbd3a95ea58-kube-api-access-mj8xg" (OuterVolumeSpecName: "kube-api-access-mj8xg") pod "babe3da7-19cf-45e0-add8-cbbd3a95ea58" (UID: "babe3da7-19cf-45e0-add8-cbbd3a95ea58"). InnerVolumeSpecName "kube-api-access-mj8xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:22:54.936137 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.936061    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50970115-3304-4bea-b675-1e7f205881ce-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "50970115-3304-4bea-b675-1e7f205881ce" (UID: "50970115-3304-4bea-b675-1e7f205881ce"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:22:54.936137 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:54.936066    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50970115-3304-4bea-b675-1e7f205881ce-kube-api-access-kq9ds" (OuterVolumeSpecName: "kube-api-access-kq9ds") pod "50970115-3304-4bea-b675-1e7f205881ce" (UID: "50970115-3304-4bea-b675-1e7f205881ce"). InnerVolumeSpecName "kube-api-access-kq9ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:22:55.035499 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:55.035413    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50970115-3304-4bea-b675-1e7f205881ce-tls-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:22:55.035499 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:55.035440    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq9ds\" (UniqueName: \"kubernetes.io/projected/50970115-3304-4bea-b675-1e7f205881ce-kube-api-access-kq9ds\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:22:55.035499 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:55.035450    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj8xg\" (UniqueName: \"kubernetes.io/projected/babe3da7-19cf-45e0-add8-cbbd3a95ea58-kube-api-access-mj8xg\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:22:55.788317 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:55.788272    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jf6bj"
Jul 15 12:22:55.788507 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:55.788272    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-k48f9"
Jul 15 12:22:55.823306 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:55.823247    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-k48f9"]
Jul 15 12:22:55.825619 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:55.825596    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-k48f9"]
Jul 15 12:22:55.848691 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:55.848663    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jf6bj"]
Jul 15 12:22:55.856254 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:55.856225    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jf6bj"]
Jul 15 12:22:57.626575 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:57.626537    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50970115-3304-4bea-b675-1e7f205881ce" path="/var/lib/kubelet/pods/50970115-3304-4bea-b675-1e7f205881ce/volumes"
Jul 15 12:22:57.626962 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:22:57.626774    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="babe3da7-19cf-45e0-add8-cbbd3a95ea58" path="/var/lib/kubelet/pods/babe3da7-19cf-45e0-add8-cbbd3a95ea58/volumes"
Jul 15 12:23:00.497993 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.497959    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6db5998898-s6mx2"]
Jul 15 12:23:00.500516 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.500499    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:00.503306 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.503268    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jfv4f\""
Jul 15 12:23:00.503450 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.503428    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 12:23:00.503526 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.503501    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 12:23:00.511281 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.511250    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6db5998898-s6mx2"]
Jul 15 12:23:00.584901 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.584846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1377617f-61b3-4023-847c-5fd4d176777b-webhook-cert\") pod \"maas-controller-6db5998898-s6mx2\" (UID: \"1377617f-61b3-4023-847c-5fd4d176777b\") " pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:00.585096 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.585007    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxvsl\" (UniqueName: \"kubernetes.io/projected/1377617f-61b3-4023-847c-5fd4d176777b-kube-api-access-sxvsl\") pod \"maas-controller-6db5998898-s6mx2\" (UID: \"1377617f-61b3-4023-847c-5fd4d176777b\") " pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:00.686150 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.686114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxvsl\" (UniqueName: \"kubernetes.io/projected/1377617f-61b3-4023-847c-5fd4d176777b-kube-api-access-sxvsl\") pod \"maas-controller-6db5998898-s6mx2\" (UID: \"1377617f-61b3-4023-847c-5fd4d176777b\") " pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:00.686362 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.686176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1377617f-61b3-4023-847c-5fd4d176777b-webhook-cert\") pod \"maas-controller-6db5998898-s6mx2\" (UID: \"1377617f-61b3-4023-847c-5fd4d176777b\") " pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:00.686362 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:23:00.686280    2571 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 15 12:23:00.686362 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:23:00.686350    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1377617f-61b3-4023-847c-5fd4d176777b-webhook-cert podName:1377617f-61b3-4023-847c-5fd4d176777b nodeName:}" failed. No retries permitted until 2026-07-15 12:23:01.186332859 +0000 UTC m=+708.134361488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1377617f-61b3-4023-847c-5fd4d176777b-webhook-cert") pod "maas-controller-6db5998898-s6mx2" (UID: "1377617f-61b3-4023-847c-5fd4d176777b") : secret "maas-controller-webhook-cert" not found
Jul 15 12:23:00.697265 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:00.697232    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxvsl\" (UniqueName: \"kubernetes.io/projected/1377617f-61b3-4023-847c-5fd4d176777b-kube-api-access-sxvsl\") pod \"maas-controller-6db5998898-s6mx2\" (UID: \"1377617f-61b3-4023-847c-5fd4d176777b\") " pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:01.190968 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:01.190924    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1377617f-61b3-4023-847c-5fd4d176777b-webhook-cert\") pod \"maas-controller-6db5998898-s6mx2\" (UID: \"1377617f-61b3-4023-847c-5fd4d176777b\") " pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:01.193427 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:01.193400    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1377617f-61b3-4023-847c-5fd4d176777b-webhook-cert\") pod \"maas-controller-6db5998898-s6mx2\" (UID: \"1377617f-61b3-4023-847c-5fd4d176777b\") " pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:01.412812 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:01.412767    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:01.547958 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:01.547929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6db5998898-s6mx2"]
Jul 15 12:23:01.550091 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:23:01.550069    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1377617f_61b3_4023_847c_5fd4d176777b.slice/crio-ceb8a58aac45148a4922501404d3ba41227ece86a10fff7183c4550561b15f69 WatchSource:0}: Error finding container ceb8a58aac45148a4922501404d3ba41227ece86a10fff7183c4550561b15f69: Status 404 returned error can't find the container with id ceb8a58aac45148a4922501404d3ba41227ece86a10fff7183c4550561b15f69
Jul 15 12:23:01.820650 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:01.820611    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db5998898-s6mx2" event={"ID":"1377617f-61b3-4023-847c-5fd4d176777b","Type":"ContainerStarted","Data":"ceb8a58aac45148a4922501404d3ba41227ece86a10fff7183c4550561b15f69"}
Jul 15 12:23:04.842317 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:04.842264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db5998898-s6mx2" event={"ID":"1377617f-61b3-4023-847c-5fd4d176777b","Type":"ContainerStarted","Data":"4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd"}
Jul 15 12:23:04.842726 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:04.842353    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:04.860676 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:04.860623    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6db5998898-s6mx2" podStartSLOduration=2.326751039 podStartE2EDuration="4.860605927s" totalImagesPullingTime="2.533854888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:23:04.86032744 +0000 UTC m=+711.808356092" watchObservedRunningTime="2026-07-15 12:23:04.860605927 +0000 UTC m=+711.808634578"
Jul 15 12:23:15.418786 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.418752    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6db5998898-s6mx2"]
Jul 15 12:23:15.419221 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.419010    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6db5998898-s6mx2" podUID="1377617f-61b3-4023-847c-5fd4d176777b" containerName="manager" containerID="cri-o://4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd" gracePeriod=30
Jul 15 12:23:15.420839 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.420819    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:15.672051 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.671984    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:15.725590 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.725553    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxvsl\" (UniqueName: \"kubernetes.io/projected/1377617f-61b3-4023-847c-5fd4d176777b-kube-api-access-sxvsl\") pod \"1377617f-61b3-4023-847c-5fd4d176777b\" (UID: \"1377617f-61b3-4023-847c-5fd4d176777b\") "
Jul 15 12:23:15.725745 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.725598    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1377617f-61b3-4023-847c-5fd4d176777b-webhook-cert\") pod \"1377617f-61b3-4023-847c-5fd4d176777b\" (UID: \"1377617f-61b3-4023-847c-5fd4d176777b\") "
Jul 15 12:23:15.727811 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.727775    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1377617f-61b3-4023-847c-5fd4d176777b-kube-api-access-sxvsl" (OuterVolumeSpecName: "kube-api-access-sxvsl") pod "1377617f-61b3-4023-847c-5fd4d176777b" (UID: "1377617f-61b3-4023-847c-5fd4d176777b"). InnerVolumeSpecName "kube-api-access-sxvsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:23:15.727811 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.727787    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1377617f-61b3-4023-847c-5fd4d176777b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1377617f-61b3-4023-847c-5fd4d176777b" (UID: "1377617f-61b3-4023-847c-5fd4d176777b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:15.826187 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.826153    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxvsl\" (UniqueName: \"kubernetes.io/projected/1377617f-61b3-4023-847c-5fd4d176777b-kube-api-access-sxvsl\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:23:15.826187 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.826181    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1377617f-61b3-4023-847c-5fd4d176777b-webhook-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:23:15.904375 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.904344    2571 generic.go:356] "Generic (PLEG): container finished" podID="1377617f-61b3-4023-847c-5fd4d176777b" containerID="4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd" exitCode=0
Jul 15 12:23:15.904375 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.904375    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db5998898-s6mx2"
Jul 15 12:23:15.904583 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.904413    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db5998898-s6mx2" event={"ID":"1377617f-61b3-4023-847c-5fd4d176777b","Type":"ContainerDied","Data":"4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd"}
Jul 15 12:23:15.904583 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.904466    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db5998898-s6mx2" event={"ID":"1377617f-61b3-4023-847c-5fd4d176777b","Type":"ContainerDied","Data":"ceb8a58aac45148a4922501404d3ba41227ece86a10fff7183c4550561b15f69"}
Jul 15 12:23:15.904583 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.904492    2571 scope.go:117] "RemoveContainer" containerID="4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd"
Jul 15 12:23:15.914124 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.914106    2571 scope.go:117] "RemoveContainer" containerID="4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd"
Jul 15 12:23:15.914402 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:23:15.914384    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd\": container with ID starting with 4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd not found: ID does not exist" containerID="4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd"
Jul 15 12:23:15.914474 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.914414    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd"} err="failed to get container status \"4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd\": rpc error: code = NotFound desc = could not find container \"4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd\": container with ID starting with 4efa97cafdcd24377bf73fd26cba0c5b4db53626d3005661efbf100defda46fd not found: ID does not exist"
Jul 15 12:23:15.927573 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.927514    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6db5998898-s6mx2"]
Jul 15 12:23:15.931337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:15.931315    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6db5998898-s6mx2"]
Jul 15 12:23:17.627515 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:17.627485    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1377617f-61b3-4023-847c-5fd4d176777b" path="/var/lib/kubelet/pods/1377617f-61b3-4023-847c-5fd4d176777b/volumes"
Jul 15 12:23:34.051377 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.051342    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"]
Jul 15 12:23:34.051953 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.051938    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1377617f-61b3-4023-847c-5fd4d176777b" containerName="manager"
Jul 15 12:23:34.052005 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.051956    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1377617f-61b3-4023-847c-5fd4d176777b" containerName="manager"
Jul 15 12:23:34.052070 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.052059    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1377617f-61b3-4023-847c-5fd4d176777b" containerName="manager"
Jul 15 12:23:34.057014 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.056993    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.060077 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.060054    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 12:23:34.060194 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.060099    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:23:34.060194 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.060120    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 12:23:34.066367 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.066344    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"]
Jul 15 12:23:34.194835 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.194795    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c106af1a-ef6f-4663-8ee5-2dcef5a0fe65-openshift-service-ca\") pod \"maas-api-b5c6f84b7-z9gbz\" (UID: \"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65\") " pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.194835 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.194837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp82q\" (UniqueName: \"kubernetes.io/projected/c106af1a-ef6f-4663-8ee5-2dcef5a0fe65-kube-api-access-qp82q\") pod \"maas-api-b5c6f84b7-z9gbz\" (UID: \"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65\") " pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.195046 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.194934    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c106af1a-ef6f-4663-8ee5-2dcef5a0fe65-maas-api-tls\") pod \"maas-api-b5c6f84b7-z9gbz\" (UID: \"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65\") " pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.296362 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.296325    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c106af1a-ef6f-4663-8ee5-2dcef5a0fe65-maas-api-tls\") pod \"maas-api-b5c6f84b7-z9gbz\" (UID: \"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65\") " pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.296536 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.296436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c106af1a-ef6f-4663-8ee5-2dcef5a0fe65-openshift-service-ca\") pod \"maas-api-b5c6f84b7-z9gbz\" (UID: \"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65\") " pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.296536 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.296466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp82q\" (UniqueName: \"kubernetes.io/projected/c106af1a-ef6f-4663-8ee5-2dcef5a0fe65-kube-api-access-qp82q\") pod \"maas-api-b5c6f84b7-z9gbz\" (UID: \"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65\") " pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.297095 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.297068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c106af1a-ef6f-4663-8ee5-2dcef5a0fe65-openshift-service-ca\") pod \"maas-api-b5c6f84b7-z9gbz\" (UID: \"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65\") " pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.298769 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.298743    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c106af1a-ef6f-4663-8ee5-2dcef5a0fe65-maas-api-tls\") pod \"maas-api-b5c6f84b7-z9gbz\" (UID: \"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65\") " pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.307254 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.307180    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp82q\" (UniqueName: \"kubernetes.io/projected/c106af1a-ef6f-4663-8ee5-2dcef5a0fe65-kube-api-access-qp82q\") pod \"maas-api-b5c6f84b7-z9gbz\" (UID: \"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65\") " pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.368707 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.368676    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:34.515346 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.515323    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"]
Jul 15 12:23:34.517630 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:23:34.517602    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc106af1a_ef6f_4663_8ee5_2dcef5a0fe65.slice/crio-d40b459329294aa32f2852dfa47ac1e23d68afc5ba23ed17fc4f852e201e4688 WatchSource:0}: Error finding container d40b459329294aa32f2852dfa47ac1e23d68afc5ba23ed17fc4f852e201e4688: Status 404 returned error can't find the container with id d40b459329294aa32f2852dfa47ac1e23d68afc5ba23ed17fc4f852e201e4688
Jul 15 12:23:34.519241 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.519225    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:23:34.674007 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.673911    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:23:34.700562 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.700525    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"]
Jul 15 12:23:34.704017 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.703999    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:34.706890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.706859    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vt5fj\""
Jul 15 12:23:34.707020 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.706947    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 12:23:34.713619 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.713592    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"]
Jul 15 12:23:34.801834 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.801799    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvwr4\" (UniqueName: \"kubernetes.io/projected/a6cf7468-50a6-4164-aeae-e5bcb393adf6-kube-api-access-vvwr4\") pod \"payload-pre-processing-74584bb9f8-2wfwq\" (UID: \"a6cf7468-50a6-4164-aeae-e5bcb393adf6\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:34.802052 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.801958    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6cf7468-50a6-4164-aeae-e5bcb393adf6-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-2wfwq\" (UID: \"a6cf7468-50a6-4164-aeae-e5bcb393adf6\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:34.902762 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.902715    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvwr4\" (UniqueName: \"kubernetes.io/projected/a6cf7468-50a6-4164-aeae-e5bcb393adf6-kube-api-access-vvwr4\") pod \"payload-pre-processing-74584bb9f8-2wfwq\" (UID: \"a6cf7468-50a6-4164-aeae-e5bcb393adf6\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:34.902945 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.902825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6cf7468-50a6-4164-aeae-e5bcb393adf6-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-2wfwq\" (UID: \"a6cf7468-50a6-4164-aeae-e5bcb393adf6\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:34.903559 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.903540    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6cf7468-50a6-4164-aeae-e5bcb393adf6-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-2wfwq\" (UID: \"a6cf7468-50a6-4164-aeae-e5bcb393adf6\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:34.911598 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:34.911575    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvwr4\" (UniqueName: \"kubernetes.io/projected/a6cf7468-50a6-4164-aeae-e5bcb393adf6-kube-api-access-vvwr4\") pod \"payload-pre-processing-74584bb9f8-2wfwq\" (UID: \"a6cf7468-50a6-4164-aeae-e5bcb393adf6\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:35.011725 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:35.011628    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz" event={"ID":"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65","Type":"ContainerStarted","Data":"d40b459329294aa32f2852dfa47ac1e23d68afc5ba23ed17fc4f852e201e4688"}
Jul 15 12:23:35.015838 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:35.015820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:35.150897 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:35.150871    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"]
Jul 15 12:23:35.152532 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:23:35.152502    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cf7468_50a6_4164_aeae_e5bcb393adf6.slice/crio-f1031a69647008f36dead29ef27e0500100a2378265118d2258b8ba3ebb1a651 WatchSource:0}: Error finding container f1031a69647008f36dead29ef27e0500100a2378265118d2258b8ba3ebb1a651: Status 404 returned error can't find the container with id f1031a69647008f36dead29ef27e0500100a2378265118d2258b8ba3ebb1a651
Jul 15 12:23:36.022909 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:36.022870    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq" event={"ID":"a6cf7468-50a6-4164-aeae-e5bcb393adf6","Type":"ContainerStarted","Data":"f1031a69647008f36dead29ef27e0500100a2378265118d2258b8ba3ebb1a651"}
Jul 15 12:23:37.032754 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:37.032586    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq" event={"ID":"a6cf7468-50a6-4164-aeae-e5bcb393adf6","Type":"ContainerStarted","Data":"3a044e486b3dcd40e67a389948d049791fe79d46b1b4d84bd31bf637d9a95ea5"}
Jul 15 12:23:37.032754 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:37.032682    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:37.035192 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:37.035150    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz" event={"ID":"c106af1a-ef6f-4663-8ee5-2dcef5a0fe65","Type":"ContainerStarted","Data":"dfc7ced4f8b56953e97fa9416ba57acb94e590b3b1d1cc4cfd34e8c52bc24e3e"}
Jul 15 12:23:37.035796 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:37.035771    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:37.049941 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:37.049868    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq" podStartSLOduration=1.392654774 podStartE2EDuration="3.049848113s" totalImagesPullingTime="1.657193339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:23:37.048056559 +0000 UTC m=+743.996085211" watchObservedRunningTime="2026-07-15 12:23:37.049848113 +0000 UTC m=+743.997876767"
Jul 15 12:23:37.066525 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:37.066424    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz" podStartSLOduration=0.775687762 podStartE2EDuration="3.066408051s" totalImagesPullingTime="2.290720289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:23:37.063528017 +0000 UTC m=+744.011556669" watchObservedRunningTime="2026-07-15 12:23:37.066408051 +0000 UTC m=+744.014436702"
Jul 15 12:23:43.079414 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:43.079376    2571 generic.go:356] "Generic (PLEG): container finished" podID="66504273-8aab-423e-a6f8-4c6fa32729b1" containerID="8af25426072c5f8ce152d02c6bb13100c3cd13b4a5d23841dde736db335608d0" exitCode=0
Jul 15 12:23:43.079847 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:43.079442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx" event={"ID":"66504273-8aab-423e-a6f8-4c6fa32729b1","Type":"ContainerDied","Data":"8af25426072c5f8ce152d02c6bb13100c3cd13b4a5d23841dde736db335608d0"}
Jul 15 12:23:43.079847 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:43.079816    2571 scope.go:117] "RemoveContainer" containerID="8af25426072c5f8ce152d02c6bb13100c3cd13b4a5d23841dde736db335608d0"
Jul 15 12:23:43.080776 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:43.080746    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:23:43.080872 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:43.080830    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:23:43.080938 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:43.080875    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:23:44.060007 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:44.059975    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b5c6f84b7-z9gbz"
Jul 15 12:23:44.087756 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:44.087721    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx" event={"ID":"66504273-8aab-423e-a6f8-4c6fa32729b1","Type":"ContainerStarted","Data":"c9bf0aa091165e2154b8b49156aebbb2945ed26c73a48eebfc14f6cedfeb58ed"}
Jul 15 12:23:44.245310 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:44.245251    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:23:44.245728 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:44.245693    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-82jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 15 12:23:44.245843 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:44.245757    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx" podUID="66504273-8aab-423e-a6f8-4c6fa32729b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 15 12:23:45.245091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:45.245044    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-82jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 15 12:23:45.245659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:45.245120    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx" podUID="66504273-8aab-423e-a6f8-4c6fa32729b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 15 12:23:46.245922 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:46.245490    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-82jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 15 12:23:46.245922 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:46.245558    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx" podUID="66504273-8aab-423e-a6f8-4c6fa32729b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 15 12:23:47.245484 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:47.245445    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-82jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 15 12:23:47.245816 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:47.245785    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx" podUID="66504273-8aab-423e-a6f8-4c6fa32729b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 15 12:23:48.046623 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:48.046584    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq" podUID="a6cf7468-50a6-4164-aeae-e5bcb393adf6" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.56:9004: connect: connection refused"
Jul 15 12:23:48.248652 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:48.248623    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:23:48.248997 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:48.248978    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:23:48.249643 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:48.249624    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-82jbx"
Jul 15 12:23:55.572943 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.572899    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"]
Jul 15 12:23:55.575903 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.575881    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.579203 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.579181    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 12:23:55.579332 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.579232    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 12:23:55.580623 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.580606    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p4ggq\""
Jul 15 12:23:55.580739 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.580641    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 12:23:55.587614 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.587595    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"]
Jul 15 12:23:55.597771 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.597747    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48d920f3-f58f-4b63-b396-b2e786eea1a4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.597872 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.597800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.597922 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.597890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-828fd\" (UniqueName: \"kubernetes.io/projected/48d920f3-f58f-4b63-b396-b2e786eea1a4-kube-api-access-828fd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.597973 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.597935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.598011 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.597976    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.598011 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.597993    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.699055 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.699024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.699239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.699064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.699239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.699090    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.699239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.699121    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48d920f3-f58f-4b63-b396-b2e786eea1a4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.699239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.699156    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.699239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.699200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-828fd\" (UniqueName: \"kubernetes.io/projected/48d920f3-f58f-4b63-b396-b2e786eea1a4-kube-api-access-828fd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.699954 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.699921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.700087 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.699957    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.707373 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.702143    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.707509 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.707456    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48d920f3-f58f-4b63-b396-b2e786eea1a4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.708339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.708316    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48d920f3-f58f-4b63-b396-b2e786eea1a4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.709426 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.709405    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-828fd\" (UniqueName: \"kubernetes.io/projected/48d920f3-f58f-4b63-b396-b2e786eea1a4-kube-api-access-828fd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc\" (UID: \"48d920f3-f58f-4b63-b396-b2e786eea1a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.887122 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.887030    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:23:55.957598 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:55.957568    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:23:56.021186 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:56.021158    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"]
Jul 15 12:23:56.023374 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:23:56.023349    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d920f3_f58f_4b63_b396_b2e786eea1a4.slice/crio-2664f3494ddbd5c3430b268d83c33048b7ae3ee4144789e077db23ccb88c4498 WatchSource:0}: Error finding container 2664f3494ddbd5c3430b268d83c33048b7ae3ee4144789e077db23ccb88c4498: Status 404 returned error can't find the container with id 2664f3494ddbd5c3430b268d83c33048b7ae3ee4144789e077db23ccb88c4498
Jul 15 12:23:56.153442 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:56.153348    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc" event={"ID":"48d920f3-f58f-4b63-b396-b2e786eea1a4","Type":"ContainerStarted","Data":"2664f3494ddbd5c3430b268d83c33048b7ae3ee4144789e077db23ccb88c4498"}
Jul 15 12:23:58.045250 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:58.045219    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-2wfwq"
Jul 15 12:23:58.167659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:58.167621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc" event={"ID":"48d920f3-f58f-4b63-b396-b2e786eea1a4","Type":"ContainerStarted","Data":"6d5bfac7d95da29ba276ccb77660c0ad4ae29b54697774c89e44f244c3081faa"}
Jul 15 12:23:58.189419 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:23:58.189369    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc" podStartSLOduration=1.985139175 podStartE2EDuration="3.189350805s" totalImagesPullingTime="1.20421163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:23:58.187056054 +0000 UTC m=+765.135084704" watchObservedRunningTime="2026-07-15 12:23:58.189350805 +0000 UTC m=+765.137379456"
Jul 15 12:24:04.752222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:24:04.752171    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:24:05.887372 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:24:05.887333    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:24:05.887892 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:24:05.887408    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:24:05.900013 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:24:05.899984    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:24:06.226962 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:24:06.226879    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc"
Jul 15 12:24:16.449665 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:24:16.449633    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:24:44.057002 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:24:44.056920    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:24:50.147184 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:24:50.147146    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:25:03.347148 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:25:03.347108    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:26:15.899047 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:26:15.899016    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:26:15.900871 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:26:15.900845    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:27:09.746978 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:09.746936    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:27:20.551174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:20.551140    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:27:31.848730 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:31.848696    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:27:40.549383 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:40.549301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:27:51.652635 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:51.652594    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:27:55.414083 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.414043    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69bf4cdfcb-n6xvq"]
Jul 15 12:27:55.417644 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.417624    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:27:55.421890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.421869    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 12:27:55.421890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.421880    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jfv4f\""
Jul 15 12:27:55.422047 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.421908    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 12:27:55.427187 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.427162    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69bf4cdfcb-n6xvq"]
Jul 15 12:27:55.515262 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.515228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp2md\" (UniqueName: \"kubernetes.io/projected/a4bdee59-0a0f-4bd3-be7f-19327a553db4-kube-api-access-mp2md\") pod \"maas-controller-69bf4cdfcb-n6xvq\" (UID: \"a4bdee59-0a0f-4bd3-be7f-19327a553db4\") " pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:27:55.515453 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.515284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4bdee59-0a0f-4bd3-be7f-19327a553db4-webhook-cert\") pod \"maas-controller-69bf4cdfcb-n6xvq\" (UID: \"a4bdee59-0a0f-4bd3-be7f-19327a553db4\") " pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:27:55.615867 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.615831    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4bdee59-0a0f-4bd3-be7f-19327a553db4-webhook-cert\") pod \"maas-controller-69bf4cdfcb-n6xvq\" (UID: \"a4bdee59-0a0f-4bd3-be7f-19327a553db4\") " pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:27:55.616025 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.615948    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp2md\" (UniqueName: \"kubernetes.io/projected/a4bdee59-0a0f-4bd3-be7f-19327a553db4-kube-api-access-mp2md\") pod \"maas-controller-69bf4cdfcb-n6xvq\" (UID: \"a4bdee59-0a0f-4bd3-be7f-19327a553db4\") " pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:27:55.618365 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.618339    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4bdee59-0a0f-4bd3-be7f-19327a553db4-webhook-cert\") pod \"maas-controller-69bf4cdfcb-n6xvq\" (UID: \"a4bdee59-0a0f-4bd3-be7f-19327a553db4\") " pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:27:55.624811 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.624789    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp2md\" (UniqueName: \"kubernetes.io/projected/a4bdee59-0a0f-4bd3-be7f-19327a553db4-kube-api-access-mp2md\") pod \"maas-controller-69bf4cdfcb-n6xvq\" (UID: \"a4bdee59-0a0f-4bd3-be7f-19327a553db4\") " pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:27:55.729257 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.729171    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:27:55.865635 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:55.865609    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69bf4cdfcb-n6xvq"]
Jul 15 12:27:55.867337 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:27:55.867304    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bdee59_0a0f_4bd3_be7f_19327a553db4.slice/crio-f11707201f434731cd1e84c8a14d95991200a728a294747e29ada82e0c5741a9 WatchSource:0}: Error finding container f11707201f434731cd1e84c8a14d95991200a728a294747e29ada82e0c5741a9: Status 404 returned error can't find the container with id f11707201f434731cd1e84c8a14d95991200a728a294747e29ada82e0c5741a9
Jul 15 12:27:56.490656 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:56.490614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq" event={"ID":"a4bdee59-0a0f-4bd3-be7f-19327a553db4","Type":"ContainerStarted","Data":"583f092beea6a6aefe180c9a989b227011873a54089db2576a18302ea55733b7"}
Jul 15 12:27:56.491051 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:56.490680    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq" event={"ID":"a4bdee59-0a0f-4bd3-be7f-19327a553db4","Type":"ContainerStarted","Data":"f11707201f434731cd1e84c8a14d95991200a728a294747e29ada82e0c5741a9"}
Jul 15 12:27:56.491051 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:56.490704    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:27:56.510108 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:27:56.510061    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq" podStartSLOduration=1.057851281 podStartE2EDuration="1.510046216s" totalImagesPullingTime="452.194935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:27:56.509177726 +0000 UTC m=+1003.457206379" watchObservedRunningTime="2026-07-15 12:27:56.510046216 +0000 UTC m=+1003.458074897"
Jul 15 12:28:07.498116 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:28:07.498086    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69bf4cdfcb-n6xvq"
Jul 15 12:28:19.556415 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:28:19.556382    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:28:32.347900 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:28:32.347866    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:29:09.151435 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:29:09.151396    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:29:17.159343 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:29:17.159296    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:29:27.653412 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:29:27.653377    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:29:39.156371 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:29:39.156334    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:29:49.057647 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:29:49.057606    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:29:57.957957 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:29:57.957917    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:30:00.150443 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:00.150407    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7"]
Jul 15 12:30:00.154182 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:00.154162    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7"
Jul 15 12:30:00.157436 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:00.157416    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:30:00.163624 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:00.163606    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7"
Jul 15 12:30:00.168938 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:00.168895    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7"]
Jul 15 12:30:00.307715 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:00.307685    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7"]
Jul 15 12:30:00.308957 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:30:00.308931    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f17948_26df_493d_ac27_5aa77015fea2.slice/crio-0f6f9af014357d93866d4f30ec96a26ea1122a16aa2b0c8eb8c2ee3d89109fcd WatchSource:0}: Error finding container 0f6f9af014357d93866d4f30ec96a26ea1122a16aa2b0c8eb8c2ee3d89109fcd: Status 404 returned error can't find the container with id 0f6f9af014357d93866d4f30ec96a26ea1122a16aa2b0c8eb8c2ee3d89109fcd
Jul 15 12:30:00.311329 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:00.311281    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:30:01.197079 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:01.197047    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7" event={"ID":"17f17948-26df-493d-ac27-5aa77015fea2","Type":"ContainerStarted","Data":"0f6f9af014357d93866d4f30ec96a26ea1122a16aa2b0c8eb8c2ee3d89109fcd"}
Jul 15 12:30:04.215171 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:04.215065    2571 generic.go:356] "Generic (PLEG): container finished" podID="17f17948-26df-493d-ac27-5aa77015fea2" containerID="3ef084687a1503211fe3aba240da4d55518ac0909f5ad9075504118f4bdbd9d0" exitCode=0
Jul 15 12:30:04.215171 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:04.215115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7" event={"ID":"17f17948-26df-493d-ac27-5aa77015fea2","Type":"ContainerDied","Data":"3ef084687a1503211fe3aba240da4d55518ac0909f5ad9075504118f4bdbd9d0"}
Jul 15 12:30:05.356093 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:05.356065    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7"
Jul 15 12:30:06.228415 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:06.228385    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7"
Jul 15 12:30:06.228589 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:06.228430    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735310-rrhl7" event={"ID":"17f17948-26df-493d-ac27-5aa77015fea2","Type":"ContainerDied","Data":"0f6f9af014357d93866d4f30ec96a26ea1122a16aa2b0c8eb8c2ee3d89109fcd"}
Jul 15 12:30:06.228589 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:06.228473    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f6f9af014357d93866d4f30ec96a26ea1122a16aa2b0c8eb8c2ee3d89109fcd"
Jul 15 12:30:09.857342 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:09.857306    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:30:19.451043 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:19.451006    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:30:42.151843 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:42.151749    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:30:53.062132 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:30:53.062095    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:31:13.955705 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:31:13.955666    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:31:15.937268 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:31:15.937229    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:31:15.940204 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:31:15.940180    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:31:25.656233 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:31:25.656202    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:31:40.950764 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:31:40.950723    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:31:50.465974 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:31:50.465937    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:31:59.757937 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:31:59.757901    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:32:09.654090 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:32:09.653873    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:32:20.242756 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:32:20.242719    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:34:07.651943 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:34:07.651903    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:34:18.156347 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:34:18.156307    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:34:26.919530 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:34:26.919489    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:34:38.354869 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:34:38.354836    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:34:47.452586 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:34:47.452552    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:34:59.344764 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:34:59.344728    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:35:08.253258 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:35:08.253175    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:35:18.948273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:35:18.948233    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:35:29.345041 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:35:29.345002    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:35:39.850889 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:35:39.850854    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:35:50.245831 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:35:50.245798    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:36:15.955122 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:36:15.955087    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:36:15.984467 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:36:15.984439    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:36:15.989038 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:36:15.989014    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:36:23.047084 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:36:23.047041    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:36:32.457040 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:36:32.457009    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:36:44.644276 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:36:44.644195    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:37:00.556761 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:37:00.556724    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:37:11.450162 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:37:11.450127    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:37:20.544349 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:37:20.544313    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:37:38.050500 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:37:38.050460    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:37:45.554634 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:37:45.554604    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:37:54.953982 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:37:54.953951    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:38:08.354336 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:38:08.354225    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:38:17.358851 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:38:17.358814    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:38:27.056070 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:38:27.056034    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:38:39.020916 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:38:39.020877    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:38:48.655470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:38:48.655433    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:38:55.055557 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:38:55.055522    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:39:11.662021 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:11.661985    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:39:23.762960 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:23.762921    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:39:34.154647 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:34.154610    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:39:45.576159 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.576078    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"]
Jul 15 12:39:45.576769 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.576751    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f17948-26df-493d-ac27-5aa77015fea2" containerName="cleanup"
Jul 15 12:39:45.576854 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.576770    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f17948-26df-493d-ac27-5aa77015fea2" containerName="cleanup"
Jul 15 12:39:45.576894 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.576879    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f17948-26df-493d-ac27-5aa77015fea2" containerName="cleanup"
Jul 15 12:39:45.580718 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.580693    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.583593 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.583578    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e10a8061-openshift-default-dockercfg-pclg7\""
Jul 15 12:39:45.594115 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.594091    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"]
Jul 15 12:39:45.612735 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.612706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-podinfo\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.612874 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.612741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-certs\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.612874 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.612770    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-credential-socket\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.612959 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.612872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-socket\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.612959 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.612917    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-token\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.613038 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.613017    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-data\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.613077 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.613056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-envoy\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.613119 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.613089    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jvkc\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-kube-api-access-5jvkc\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.613158 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.613141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fe505b3-3bbd-40ec-8c29-db13253dd078-istiod-ca-cert\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714344 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714276    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-socket\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714522 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714361    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-token\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714522 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-data\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714522 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714469    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-envoy\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714522 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714501    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jvkc\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-kube-api-access-5jvkc\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714753 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714553    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fe505b3-3bbd-40ec-8c29-db13253dd078-istiod-ca-cert\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714753 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-podinfo\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714753 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714619    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-certs\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714753 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-credential-socket\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.714753 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714739    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-socket\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.715016 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.714810    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-data\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.715234 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.715208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-certs\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.715376 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.715283    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-credential-socket\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.715770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.715746    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fe505b3-3bbd-40ec-8c29-db13253dd078-istiod-ca-cert\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.717126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.717105    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-podinfo\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.717238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.717126    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-envoy\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.722723 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.722691    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-token\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.722832 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.722806    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jvkc\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-kube-api-access-5jvkc\") pod \"e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") " pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:45.894114 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:45.894025    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:46.035317 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.035268    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"]
Jul 15 12:39:46.037195 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:39:46.037165    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe505b3_3bbd_40ec_8c29_db13253dd078.slice/crio-4ce2f30b5f16d05fc19198449ad2d93170731e79d80167e3cea0a8fa66b95cca WatchSource:0}: Error finding container 4ce2f30b5f16d05fc19198449ad2d93170731e79d80167e3cea0a8fa66b95cca: Status 404 returned error can't find the container with id 4ce2f30b5f16d05fc19198449ad2d93170731e79d80167e3cea0a8fa66b95cca
Jul 15 12:39:46.039543 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.039500    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:39:46.039624 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.039591    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:39:46.039665 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.039635    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:39:46.491642 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.491598    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" event={"ID":"1fe505b3-3bbd-40ec-8c29-db13253dd078","Type":"ContainerStarted","Data":"158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e"}
Jul 15 12:39:46.491867 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.491673    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" event={"ID":"1fe505b3-3bbd-40ec-8c29-db13253dd078","Type":"ContainerStarted","Data":"4ce2f30b5f16d05fc19198449ad2d93170731e79d80167e3cea0a8fa66b95cca"}
Jul 15 12:39:46.514058 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.514006    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" podStartSLOduration=1.5139864090000001 podStartE2EDuration="1.513986409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:39:46.512671591 +0000 UTC m=+1713.460700244" watchObservedRunningTime="2026-07-15 12:39:46.513986409 +0000 UTC m=+1713.462015060"
Jul 15 12:39:46.892448 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.892404    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"]
Jul 15 12:39:46.899523 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.899464    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:46.899920 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.899885    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:46.902855 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.902808    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e10a8061-serving-cert\""
Jul 15 12:39:46.903427 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.903404    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bnnf9\""
Jul 15 12:39:46.905137 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.905112    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"]
Jul 15 12:39:46.927279 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.927244    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnb82\" (UniqueName: \"kubernetes.io/projected/b0db8042-ee5d-45f0-9266-09ba474ebcba-kube-api-access-fnb82\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:46.927475 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.927323    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0db8042-ee5d-45f0-9266-09ba474ebcba-maas-api-tls\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:46.927475 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:46.927372    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0db8042-ee5d-45f0-9266-09ba474ebcba-openshift-service-ca\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:47.028433 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:47.028390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnb82\" (UniqueName: \"kubernetes.io/projected/b0db8042-ee5d-45f0-9266-09ba474ebcba-kube-api-access-fnb82\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:47.028648 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:47.028461    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0db8042-ee5d-45f0-9266-09ba474ebcba-maas-api-tls\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:47.028648 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:47.028528    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0db8042-ee5d-45f0-9266-09ba474ebcba-openshift-service-ca\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:47.028648 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:39:47.028559    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-serving-cert: secret "maas-api-e2e-ait-e10a8061-serving-cert" not found
Jul 15 12:39:47.028648 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:39:47.028624    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0db8042-ee5d-45f0-9266-09ba474ebcba-maas-api-tls podName:b0db8042-ee5d-45f0-9266-09ba474ebcba nodeName:}" failed. No retries permitted until 2026-07-15 12:39:47.528607699 +0000 UTC m=+1714.476636328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0db8042-ee5d-45f0-9266-09ba474ebcba-maas-api-tls") pod "maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z" (UID: "b0db8042-ee5d-45f0-9266-09ba474ebcba") : secret "maas-api-e2e-ait-e10a8061-serving-cert" not found
Jul 15 12:39:47.029394 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:47.029372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0db8042-ee5d-45f0-9266-09ba474ebcba-openshift-service-ca\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:47.037662 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:47.037622    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnb82\" (UniqueName: \"kubernetes.io/projected/b0db8042-ee5d-45f0-9266-09ba474ebcba-kube-api-access-fnb82\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:47.533213 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:47.533172    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0db8042-ee5d-45f0-9266-09ba474ebcba-maas-api-tls\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:47.535718 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:47.535690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0db8042-ee5d-45f0-9266-09ba474ebcba-maas-api-tls\") pod \"maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:47.814468 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:47.814431    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:47.899650 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:47.899620    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:48.158716 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:39:48.158688    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0db8042_ee5d_45f0_9266_09ba474ebcba.slice/crio-6058370f1f64bf087d5d97c8615a1556123afdb34a3774549f998b2fe59980f4 WatchSource:0}: Error finding container 6058370f1f64bf087d5d97c8615a1556123afdb34a3774549f998b2fe59980f4: Status 404 returned error can't find the container with id 6058370f1f64bf087d5d97c8615a1556123afdb34a3774549f998b2fe59980f4
Jul 15 12:39:48.158841 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:48.158784    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"]
Jul 15 12:39:48.160157 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:48.160139    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:39:48.505104 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:48.504999    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z" event={"ID":"b0db8042-ee5d-45f0-9266-09ba474ebcba","Type":"ContainerStarted","Data":"6058370f1f64bf087d5d97c8615a1556123afdb34a3774549f998b2fe59980f4"}
Jul 15 12:39:48.505379 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:48.505346    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:48.506794 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:48.506770    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:39:49.512693 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:49.512653    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z" event={"ID":"b0db8042-ee5d-45f0-9266-09ba474ebcba","Type":"ContainerStarted","Data":"211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d"}
Jul 15 12:39:49.513104 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:49.512737    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:39:49.531966 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:49.531916    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z" podStartSLOduration=2.994757252 podStartE2EDuration="3.53190116s" totalImagesPullingTime="537.143908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:39:49.52826655 +0000 UTC m=+1716.476295202" watchObservedRunningTime="2026-07-15 12:39:49.53190116 +0000 UTC m=+1716.479929815"
Jul 15 12:39:54.752742 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:54.752706    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:39:55.523991 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:39:55.523958    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:40:02.159538 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.159480    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"]
Jul 15 12:40:02.160019 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.159755    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z" podUID="b0db8042-ee5d-45f0-9266-09ba474ebcba" containerName="maas-api" containerID="cri-o://211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d" gracePeriod=30
Jul 15 12:40:02.421239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.421168    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:40:02.495654 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.495615    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0db8042-ee5d-45f0-9266-09ba474ebcba-maas-api-tls\") pod \"b0db8042-ee5d-45f0-9266-09ba474ebcba\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") "
Jul 15 12:40:02.495831 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.495736    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0db8042-ee5d-45f0-9266-09ba474ebcba-openshift-service-ca\") pod \"b0db8042-ee5d-45f0-9266-09ba474ebcba\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") "
Jul 15 12:40:02.495831 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.495775    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnb82\" (UniqueName: \"kubernetes.io/projected/b0db8042-ee5d-45f0-9266-09ba474ebcba-kube-api-access-fnb82\") pod \"b0db8042-ee5d-45f0-9266-09ba474ebcba\" (UID: \"b0db8042-ee5d-45f0-9266-09ba474ebcba\") "
Jul 15 12:40:02.496165 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.496131    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0db8042-ee5d-45f0-9266-09ba474ebcba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0db8042-ee5d-45f0-9266-09ba474ebcba" (UID: "b0db8042-ee5d-45f0-9266-09ba474ebcba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:40:02.498009 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.497976    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0db8042-ee5d-45f0-9266-09ba474ebcba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0db8042-ee5d-45f0-9266-09ba474ebcba" (UID: "b0db8042-ee5d-45f0-9266-09ba474ebcba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:40:02.498124 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.498013    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0db8042-ee5d-45f0-9266-09ba474ebcba-kube-api-access-fnb82" (OuterVolumeSpecName: "kube-api-access-fnb82") pod "b0db8042-ee5d-45f0-9266-09ba474ebcba" (UID: "b0db8042-ee5d-45f0-9266-09ba474ebcba"). InnerVolumeSpecName "kube-api-access-fnb82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:40:02.592473 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.592437    2571 generic.go:356] "Generic (PLEG): container finished" podID="b0db8042-ee5d-45f0-9266-09ba474ebcba" containerID="211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d" exitCode=0
Jul 15 12:40:02.592666 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.592486    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"
Jul 15 12:40:02.592666 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.592520    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z" event={"ID":"b0db8042-ee5d-45f0-9266-09ba474ebcba","Type":"ContainerDied","Data":"211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d"}
Jul 15 12:40:02.592666 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.592577    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z" event={"ID":"b0db8042-ee5d-45f0-9266-09ba474ebcba","Type":"ContainerDied","Data":"6058370f1f64bf087d5d97c8615a1556123afdb34a3774549f998b2fe59980f4"}
Jul 15 12:40:02.592666 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.592607    2571 scope.go:117] "RemoveContainer" containerID="211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d"
Jul 15 12:40:02.597370 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.597345    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0db8042-ee5d-45f0-9266-09ba474ebcba-maas-api-tls\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:02.597488 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.597375    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0db8042-ee5d-45f0-9266-09ba474ebcba-openshift-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:02.597488 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.597391    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnb82\" (UniqueName: \"kubernetes.io/projected/b0db8042-ee5d-45f0-9266-09ba474ebcba-kube-api-access-fnb82\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:02.605470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.605446    2571 scope.go:117] "RemoveContainer" containerID="211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d"
Jul 15 12:40:02.605807 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:40:02.605777    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d\": container with ID starting with 211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d not found: ID does not exist" containerID="211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d"
Jul 15 12:40:02.605914 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.605816    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d"} err="failed to get container status \"211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d\": rpc error: code = NotFound desc = could not find container \"211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d\": container with ID starting with 211b79b3d40c4ad81ce337588f103a6b28b777a4eae460fa4b40b8262663158d not found: ID does not exist"
Jul 15 12:40:02.616399 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.616353    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"]
Jul 15 12:40:02.619084 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:02.619047    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e10a8061-5bc6bc765b-k478z"]
Jul 15 12:40:03.506457 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:03.506366    2571 patch_prober.go:28] interesting pod/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 15 12:40:03.506457 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:03.506434    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 15 12:40:03.601127 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:03.601095    2571 generic.go:356] "Generic (PLEG): container finished" podID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerID="158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e" exitCode=0
Jul 15 12:40:03.601325 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:03.601143    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" event={"ID":"1fe505b3-3bbd-40ec-8c29-db13253dd078","Type":"ContainerDied","Data":"158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e"}
Jul 15 12:40:03.601597 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:03.601581    2571 scope.go:117] "RemoveContainer" containerID="158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e"
Jul 15 12:40:03.602592 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:03.602565    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:40:03.602658 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:03.602634    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:40:03.602698 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:03.602665    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:40:03.628753 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:03.628723    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0db8042-ee5d-45f0-9266-09ba474ebcba" path="/var/lib/kubelet/pods/b0db8042-ee5d-45f0-9266-09ba474ebcba/volumes"
Jul 15 12:40:04.615663 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:04.615624    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" event={"ID":"1fe505b3-3bbd-40ec-8c29-db13253dd078","Type":"ContainerStarted","Data":"1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f"}
Jul 15 12:40:04.894774 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:04.894675    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:40:04.894949 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:04.894863    2571 patch_prober.go:28] interesting pod/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 15 12:40:04.894949 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:04.894911    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 15 12:40:05.894380 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:05.894344    2571 patch_prober.go:28] interesting pod/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 15 12:40:05.894853 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:05.894404    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 15 12:40:05.952226 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:05.952183    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:40:06.895533 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:06.895498    2571 patch_prober.go:28] interesting pod/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 15 12:40:06.895922 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:06.895568    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 15 12:40:07.895270 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:07.895232    2571 patch_prober.go:28] interesting pod/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 15 12:40:07.895501 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:07.895311    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 15 12:40:08.898623 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:08.898592    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:40:08.899011 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:08.898959    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:40:08.899555 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:08.899534    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:40:17.057475 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.057435    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"]
Jul 15 12:40:17.058003 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.057714    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy" containerID="cri-o://1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f" gracePeriod=30
Jul 15 12:40:17.766409 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.766368    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"]
Jul 15 12:40:17.767074 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.767055    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0db8042-ee5d-45f0-9266-09ba474ebcba" containerName="maas-api"
Jul 15 12:40:17.767120 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.767079    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0db8042-ee5d-45f0-9266-09ba474ebcba" containerName="maas-api"
Jul 15 12:40:17.767222 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.767209    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0db8042-ee5d-45f0-9266-09ba474ebcba" containerName="maas-api"
Jul 15 12:40:17.770032 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.770011    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.773439 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.773418    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-af71886a-gw-openshift-default-dockercfg-4hxhw\""
Jul 15 12:40:17.782910 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.782884    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"]
Jul 15 12:40:17.854862 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.854826    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2vxf\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-kube-api-access-j2vxf\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.855033 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.854877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-credential-socket\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.855033 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.854943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-certs\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.855033 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.854979    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-envoy\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.855033 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.855002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-token\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.855033 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.855016    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istiod-ca-cert\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.855033 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.855033    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-socket\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.855283 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.855106    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-data\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.855283 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.855133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-podinfo\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.955955 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.955909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2vxf\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-kube-api-access-j2vxf\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.955977    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-credential-socket\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-certs\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-envoy\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956097    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-token\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istiod-ca-cert\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956164 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956145    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-socket\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956538 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956189    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-data\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956538 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-podinfo\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956538 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956479    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-credential-socket\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956705 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956597    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-data\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956705 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956665    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-socket\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956705 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956678    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-certs\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.956832 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.956807    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istiod-ca-cert\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.958361 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.958334    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-envoy\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.958698 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.958679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-podinfo\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.964330 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.964285    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-token\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:17.964435 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:17.964348    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2vxf\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-kube-api-access-j2vxf\") pod \"e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") " pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:18.080918 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:18.080883    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:18.216963 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:18.216932    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"]
Jul 15 12:40:18.218050 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:40:18.218019    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fd2449_0b62_4ed7_8aee_2e94be5df7f4.slice/crio-13789efecd85e32199d563a8778cc74bfc8ac193b4926faca17e99b064e11b78 WatchSource:0}: Error finding container 13789efecd85e32199d563a8778cc74bfc8ac193b4926faca17e99b064e11b78: Status 404 returned error can't find the container with id 13789efecd85e32199d563a8778cc74bfc8ac193b4926faca17e99b064e11b78
Jul 15 12:40:18.220305 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:18.220254    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:40:18.220381 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:18.220338    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:40:18.220381 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:18.220367    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:40:18.696912 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:18.696873    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" event={"ID":"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4","Type":"ContainerStarted","Data":"8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa"}
Jul 15 12:40:18.697120 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:18.696926    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" event={"ID":"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4","Type":"ContainerStarted","Data":"13789efecd85e32199d563a8778cc74bfc8ac193b4926faca17e99b064e11b78"}
Jul 15 12:40:18.719457 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:18.719409    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" podStartSLOduration=1.719392338 podStartE2EDuration="1.719392338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:40:18.717642677 +0000 UTC m=+1745.665671328" watchObservedRunningTime="2026-07-15 12:40:18.719392338 +0000 UTC m=+1745.667420989"
Jul 15 12:40:19.081886 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:19.081851    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:19.086915 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:19.086890    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:19.703623 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:19.703588    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:19.704537 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:19.704520    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:22.317406 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.317378    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:40:22.390648 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.390610    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-data\") pod \"1fe505b3-3bbd-40ec-8c29-db13253dd078\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") "
Jul 15 12:40:22.390815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.390687    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jvkc\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-kube-api-access-5jvkc\") pod \"1fe505b3-3bbd-40ec-8c29-db13253dd078\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") "
Jul 15 12:40:22.390815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.390735    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-token\") pod \"1fe505b3-3bbd-40ec-8c29-db13253dd078\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") "
Jul 15 12:40:22.390815 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.390785    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-socket\") pod \"1fe505b3-3bbd-40ec-8c29-db13253dd078\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") "
Jul 15 12:40:22.390948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.390816    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fe505b3-3bbd-40ec-8c29-db13253dd078-istiod-ca-cert\") pod \"1fe505b3-3bbd-40ec-8c29-db13253dd078\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") "
Jul 15 12:40:22.390948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.390847    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-podinfo\") pod \"1fe505b3-3bbd-40ec-8c29-db13253dd078\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") "
Jul 15 12:40:22.390948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.390897    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-certs\") pod \"1fe505b3-3bbd-40ec-8c29-db13253dd078\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") "
Jul 15 12:40:22.390948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.390926    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-credential-socket\") pod \"1fe505b3-3bbd-40ec-8c29-db13253dd078\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") "
Jul 15 12:40:22.391097 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.390962    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-envoy\") pod \"1fe505b3-3bbd-40ec-8c29-db13253dd078\" (UID: \"1fe505b3-3bbd-40ec-8c29-db13253dd078\") "
Jul 15 12:40:22.391162 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.391086    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fe505b3-3bbd-40ec-8c29-db13253dd078" (UID: "1fe505b3-3bbd-40ec-8c29-db13253dd078"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:40:22.391524 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.391409    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:22.391652 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.391470    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fe505b3-3bbd-40ec-8c29-db13253dd078" (UID: "1fe505b3-3bbd-40ec-8c29-db13253dd078"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:40:22.391652 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.391594    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fe505b3-3bbd-40ec-8c29-db13253dd078" (UID: "1fe505b3-3bbd-40ec-8c29-db13253dd078"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:40:22.391901 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.391755    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe505b3-3bbd-40ec-8c29-db13253dd078-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fe505b3-3bbd-40ec-8c29-db13253dd078" (UID: "1fe505b3-3bbd-40ec-8c29-db13253dd078"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:40:22.392067 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.392035    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fe505b3-3bbd-40ec-8c29-db13253dd078" (UID: "1fe505b3-3bbd-40ec-8c29-db13253dd078"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:40:22.393148 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.393116    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-kube-api-access-5jvkc" (OuterVolumeSpecName: "kube-api-access-5jvkc") pod "1fe505b3-3bbd-40ec-8c29-db13253dd078" (UID: "1fe505b3-3bbd-40ec-8c29-db13253dd078"). InnerVolumeSpecName "kube-api-access-5jvkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:40:22.393238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.393153    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fe505b3-3bbd-40ec-8c29-db13253dd078" (UID: "1fe505b3-3bbd-40ec-8c29-db13253dd078"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:40:22.393238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.393183    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fe505b3-3bbd-40ec-8c29-db13253dd078" (UID: "1fe505b3-3bbd-40ec-8c29-db13253dd078"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:40:22.393607 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.393586    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fe505b3-3bbd-40ec-8c29-db13253dd078" (UID: "1fe505b3-3bbd-40ec-8c29-db13253dd078"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 12:40:22.491998 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.491958    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-envoy\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:22.491998 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.491995    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-data\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:22.492219 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.492008    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jvkc\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-kube-api-access-5jvkc\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:22.492219 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.492022    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-token\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:22.492219 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.492034    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fe505b3-3bbd-40ec-8c29-db13253dd078-istiod-ca-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:22.492219 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.492045    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fe505b3-3bbd-40ec-8c29-db13253dd078-istio-podinfo\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:22.492219 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.492054    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-workload-certs\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:22.492219 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.492064    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fe505b3-3bbd-40ec-8c29-db13253dd078-credential-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:40:22.723936 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.723842    2571 generic.go:356] "Generic (PLEG): container finished" podID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerID="1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f" exitCode=0
Jul 15 12:40:22.723936 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.723897    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"
Jul 15 12:40:22.724181 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.723932    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" event={"ID":"1fe505b3-3bbd-40ec-8c29-db13253dd078","Type":"ContainerDied","Data":"1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f"}
Jul 15 12:40:22.724181 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.724000    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9" event={"ID":"1fe505b3-3bbd-40ec-8c29-db13253dd078","Type":"ContainerDied","Data":"4ce2f30b5f16d05fc19198449ad2d93170731e79d80167e3cea0a8fa66b95cca"}
Jul 15 12:40:22.724181 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.724030    2571 scope.go:117] "RemoveContainer" containerID="1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f"
Jul 15 12:40:22.734204 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.734187    2571 scope.go:117] "RemoveContainer" containerID="158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e"
Jul 15 12:40:22.744076 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.744055    2571 scope.go:117] "RemoveContainer" containerID="1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f"
Jul 15 12:40:22.744609 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:40:22.744589    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f\": container with ID starting with 1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f not found: ID does not exist" containerID="1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f"
Jul 15 12:40:22.744701 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.744621    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f"} err="failed to get container status \"1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f\": rpc error: code = NotFound desc = could not find container \"1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f\": container with ID starting with 1f988627542d5e76e2c69bda43d0011fc29c7bd61ee3581c68892617bc577d9f not found: ID does not exist"
Jul 15 12:40:22.744701 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.744646    2571 scope.go:117] "RemoveContainer" containerID="158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e"
Jul 15 12:40:22.744921 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:40:22.744898    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e\": container with ID starting with 158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e not found: ID does not exist" containerID="158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e"
Jul 15 12:40:22.744969 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.744942    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e"} err="failed to get container status \"158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e\": rpc error: code = NotFound desc = could not find container \"158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e\": container with ID starting with 158d9e1307acc113b90cf34c72b937b1889e17b77853e88624dd983de927b16e not found: ID does not exist"
Jul 15 12:40:22.746988 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.746965    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"]
Jul 15 12:40:22.750305 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:22.750272    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e10a8061-openshift-default-7474488fd7-fz5j9"]
Jul 15 12:40:23.629416 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:23.629383    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" path="/var/lib/kubelet/pods/1fe505b3-3bbd-40ec-8c29-db13253dd078/volumes"
Jul 15 12:40:26.157336 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:26.157301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:40:33.800080 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:33.800050    2571 generic.go:356] "Generic (PLEG): container finished" podID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerID="8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa" exitCode=0
Jul 15 12:40:33.800660 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:33.800131    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" event={"ID":"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4","Type":"ContainerDied","Data":"8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa"}
Jul 15 12:40:33.800732 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:33.800697    2571 scope.go:117] "RemoveContainer" containerID="8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa"
Jul 15 12:40:33.801817 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:33.801785    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:40:33.801941 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:33.801855    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:40:33.801941 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:33.801887    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:40:34.703964 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:34.703919    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:34.808252 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:34.808218    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" event={"ID":"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4","Type":"ContainerStarted","Data":"b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e"}
Jul 15 12:40:35.081543 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:35.081511    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:35.082833 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:35.082807    2571 patch_prober.go:28] interesting pod/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 12:40:35.082944 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:35.082854    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 12:40:36.082045 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:36.082000    2571 patch_prober.go:28] interesting pod/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 12:40:36.082567 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:36.082106    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 12:40:37.081239 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:37.081202    2571 patch_prober.go:28] interesting pod/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 12:40:37.081425 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:37.081266    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 12:40:38.082208 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:38.082169    2571 patch_prober.go:28] interesting pod/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 12:40:38.082664 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:38.082239    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 12:40:39.081530 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:39.081488    2571 patch_prober.go:28] interesting pod/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 12:40:39.081710 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:39.081557    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 12:40:40.082346 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:40.082271    2571 patch_prober.go:28] interesting pod/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 15 12:40:40.082746 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:40.082396    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 15 12:40:41.086064 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:41.086031    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:41.086566 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:41.086316    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:40:41.087128 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:40:41.087110    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:41:16.025545 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:16.025508    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:41:16.031060 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:16.031039    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:41:23.474582 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.474541    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"]
Jul 15 12:41:23.475005 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.474991    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy"
Jul 15 12:41:23.475005 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.475006    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy"
Jul 15 12:41:23.475081 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.475014    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy"
Jul 15 12:41:23.475081 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.475019    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy"
Jul 15 12:41:23.475144 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.475098    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy"
Jul 15 12:41:23.475144 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.475107    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe505b3-3bbd-40ec-8c29-db13253dd078" containerName="istio-proxy"
Jul 15 12:41:23.477354 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.477339    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"
Jul 15 12:41:23.480238 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.480219    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:41:23.486092 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.486056    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"]
Jul 15 12:41:23.553080 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.553041    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"]
Jul 15 12:41:23.553345 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.553278    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy" containerID="cri-o://b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e" gracePeriod=30
Jul 15 12:41:23.589232 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.589200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e639dd2-9d68-491e-85f0-f90562be3e6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2\" (UID: \"1e639dd2-9d68-491e-85f0-f90562be3e6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"
Jul 15 12:41:23.690925 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.690880    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e639dd2-9d68-491e-85f0-f90562be3e6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2\" (UID: \"1e639dd2-9d68-491e-85f0-f90562be3e6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"
Jul 15 12:41:23.691598 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.691575    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e639dd2-9d68-491e-85f0-f90562be3e6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2\" (UID: \"1e639dd2-9d68-491e-85f0-f90562be3e6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"
Jul 15 12:41:23.790270 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.790181    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"
Jul 15 12:41:23.949422 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:23.949392    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"]
Jul 15 12:41:23.949802 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:41:23.949771    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e639dd2_9d68_491e_85f0_f90562be3e6b.slice/crio-287f5f29eef0a594df4e29464ccfeb27e0c923f66cab950f709e1b3d1030512b WatchSource:0}: Error finding container 287f5f29eef0a594df4e29464ccfeb27e0c923f66cab950f709e1b3d1030512b: Status 404 returned error can't find the container with id 287f5f29eef0a594df4e29464ccfeb27e0c923f66cab950f709e1b3d1030512b
Jul 15 12:41:24.107751 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:24.107718    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2" event={"ID":"1e639dd2-9d68-491e-85f0-f90562be3e6b","Type":"ContainerStarted","Data":"287f5f29eef0a594df4e29464ccfeb27e0c923f66cab950f709e1b3d1030512b"}
Jul 15 12:41:25.115186 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:25.115140    2571 generic.go:356] "Generic (PLEG): container finished" podID="1e639dd2-9d68-491e-85f0-f90562be3e6b" containerID="bcb0c66485758996e4c8f1223796e127beb6f59d6d26714362d84d026248309d" exitCode=0
Jul 15 12:41:25.115645 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:25.115204    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2" event={"ID":"1e639dd2-9d68-491e-85f0-f90562be3e6b","Type":"ContainerDied","Data":"bcb0c66485758996e4c8f1223796e127beb6f59d6d26714362d84d026248309d"}
Jul 15 12:41:26.088510 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:26.088471    2571 patch_prober.go:28] interesting pod/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 12:41:26.088713 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:26.088558    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 12:41:26.249429 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:26.249397    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:41:26.260942 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:26.260917    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"
Jul 15 12:41:26.323593 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:26.323554    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e639dd2-9d68-491e-85f0-f90562be3e6b-maas-api-service-ca\") pod \"1e639dd2-9d68-491e-85f0-f90562be3e6b\" (UID: \"1e639dd2-9d68-491e-85f0-f90562be3e6b\") "
Jul 15 12:41:26.323928 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:26.323904    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e639dd2-9d68-491e-85f0-f90562be3e6b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e639dd2-9d68-491e-85f0-f90562be3e6b" (UID: "1e639dd2-9d68-491e-85f0-f90562be3e6b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:41:26.424758 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:26.424665    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e639dd2-9d68-491e-85f0-f90562be3e6b-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:27.128068 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:27.128038    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2"
Jul 15 12:41:27.128245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:27.128076    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2" event={"ID":"1e639dd2-9d68-491e-85f0-f90562be3e6b","Type":"ContainerDied","Data":"287f5f29eef0a594df4e29464ccfeb27e0c923f66cab950f709e1b3d1030512b"}
Jul 15 12:41:27.128245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:27.128133    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="287f5f29eef0a594df4e29464ccfeb27e0c923f66cab950f709e1b3d1030512b"
Jul 15 12:41:28.810057 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.810035    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:41:28.949504 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949470    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-envoy\") pod \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") "
Jul 15 12:41:28.949680 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949519    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2vxf\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-kube-api-access-j2vxf\") pod \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") "
Jul 15 12:41:28.949680 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949590    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-certs\") pod \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") "
Jul 15 12:41:28.949680 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949648    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-credential-socket\") pod \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") "
Jul 15 12:41:28.949799 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949700    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-token\") pod \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") "
Jul 15 12:41:28.949799 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949736    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-podinfo\") pod \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") "
Jul 15 12:41:28.949902 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949798    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-data\") pod \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") "
Jul 15 12:41:28.949902 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949837    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-socket\") pod \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") "
Jul 15 12:41:28.949902 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949861    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istiod-ca-cert\") pod \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\" (UID: \"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4\") "
Jul 15 12:41:28.950119 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949935    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" (UID: "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:41:28.950119 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.949953    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" (UID: "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:41:28.950232 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.950163    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" (UID: "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:41:28.950303 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.950267    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-certs\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:28.950369 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.950304    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-credential-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:28.950369 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.950319    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-workload-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:28.950369 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.950267    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" (UID: "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:41:28.950773 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.950738    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" (UID: "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:41:28.951835 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.951807    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" (UID: "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:41:28.951938 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.951835    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" (UID: "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:41:28.951938 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.951865    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-kube-api-access-j2vxf" (OuterVolumeSpecName: "kube-api-access-j2vxf") pod "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" (UID: "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4"). InnerVolumeSpecName "kube-api-access-j2vxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:41:28.952526 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:28.952503    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" (UID: "f4fd2449-0b62-4ed7-8aee-2e94be5df7f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 12:41:29.050990 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.050955    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-token\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:29.050990 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.050982    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-podinfo\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:29.050990 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.050990    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-data\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:29.050990 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.051000    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istiod-ca-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:29.051256 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.051008    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-istio-envoy\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:29.051256 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.051016    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2vxf\" (UniqueName: \"kubernetes.io/projected/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4-kube-api-access-j2vxf\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:41:29.141308 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.141200    2571 generic.go:356] "Generic (PLEG): container finished" podID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerID="b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e" exitCode=0
Jul 15 12:41:29.141308 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.141246    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"
Jul 15 12:41:29.141523 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.141300    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" event={"ID":"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4","Type":"ContainerDied","Data":"b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e"}
Jul 15 12:41:29.141523 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.141355    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg" event={"ID":"f4fd2449-0b62-4ed7-8aee-2e94be5df7f4","Type":"ContainerDied","Data":"13789efecd85e32199d563a8778cc74bfc8ac193b4926faca17e99b064e11b78"}
Jul 15 12:41:29.141523 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.141377    2571 scope.go:117] "RemoveContainer" containerID="b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e"
Jul 15 12:41:29.151255 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.151236    2571 scope.go:117] "RemoveContainer" containerID="8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa"
Jul 15 12:41:29.159873 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.159858    2571 scope.go:117] "RemoveContainer" containerID="b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e"
Jul 15 12:41:29.160229 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:41:29.160178    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e\": container with ID starting with b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e not found: ID does not exist" containerID="b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e"
Jul 15 12:41:29.160353 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.160238    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e"} err="failed to get container status \"b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e\": rpc error: code = NotFound desc = could not find container \"b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e\": container with ID starting with b79245d0edda1874a240504e85bbb115bda382f0aa8b2124ba1ecfa78de6743e not found: ID does not exist"
Jul 15 12:41:29.160353 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.160264    2571 scope.go:117] "RemoveContainer" containerID="8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa"
Jul 15 12:41:29.160702 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:41:29.160677    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa\": container with ID starting with 8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa not found: ID does not exist" containerID="8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa"
Jul 15 12:41:29.160791 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.160711    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa"} err="failed to get container status \"8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa\": rpc error: code = NotFound desc = could not find container \"8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa\": container with ID starting with 8614229e9a987ab3e30d4b5cb4b3f7eafd5b361009ed6380afbc73851565c6fa not found: ID does not exist"
Jul 15 12:41:29.164074 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.164046    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"]
Jul 15 12:41:29.166473 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.166453    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-af71886a-gw-openshift-default-86df5698cf-l66sg"]
Jul 15 12:41:29.628561 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:29.628528    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" path="/var/lib/kubelet/pods/f4fd2449-0b62-4ed7-8aee-2e94be5df7f4/volumes"
Jul 15 12:41:35.707171 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707127    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"]
Jul 15 12:41:35.707673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707601    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e639dd2-9d68-491e-85f0-f90562be3e6b" containerName="revoke-keys"
Jul 15 12:41:35.707673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707614    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e639dd2-9d68-491e-85f0-f90562be3e6b" containerName="revoke-keys"
Jul 15 12:41:35.707673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707633    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy"
Jul 15 12:41:35.707673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707639    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy"
Jul 15 12:41:35.707673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707653    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy"
Jul 15 12:41:35.707673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707659    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy"
Jul 15 12:41:35.707994 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707729    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy"
Jul 15 12:41:35.707994 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707738    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4fd2449-0b62-4ed7-8aee-2e94be5df7f4" containerName="istio-proxy"
Jul 15 12:41:35.707994 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.707744    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e639dd2-9d68-491e-85f0-f90562be3e6b" containerName="revoke-keys"
Jul 15 12:41:35.716584 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.716568    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.719994 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.719972    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f7995e41-openshift-default-dockercfg-glfvz\""
Jul 15 12:41:35.725674 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.725652    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"]
Jul 15 12:41:35.814498 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.814463    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-certs\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.814697 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.814505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-token\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.814697 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.814531    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istiod-ca-cert\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.814697 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.814632    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-credential-socket\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.814839 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.814719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brwjz\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-kube-api-access-brwjz\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.814839 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.814803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-envoy\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.814942 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.814837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-socket\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.814942 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.814863    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-data\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.815045 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.814946    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-podinfo\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.915740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.915700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-certs\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.915740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.915740    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-token\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916004 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.915767    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istiod-ca-cert\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916004 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.915813    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-credential-socket\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916004 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.915865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brwjz\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-kube-api-access-brwjz\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.916079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-envoy\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.916134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-socket\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.916163    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-data\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916384 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.916201    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-podinfo\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916384 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.916214    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-certs\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916384 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.916281    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-credential-socket\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916505 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.916438    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-socket\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916630 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.916608    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-data\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.916630 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.916621    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istiod-ca-cert\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.918490 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.918460    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-envoy\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.918723 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.918706    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-podinfo\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.924822 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.924793    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-token\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:35.925092 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:35.925075    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brwjz\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-kube-api-access-brwjz\") pod \"e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") " pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:36.028404 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:36.028281    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:36.172798 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:36.172756    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"]
Jul 15 12:41:36.174861 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:41:36.174832    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a87ce31_35dd_446b_8504_67ddd6ed7fe2.slice/crio-1d230bf0d4d88aad8dcc53e6ef202ee6505c4d0d17f6804fd1df11d544815c5c WatchSource:0}: Error finding container 1d230bf0d4d88aad8dcc53e6ef202ee6505c4d0d17f6804fd1df11d544815c5c: Status 404 returned error can't find the container with id 1d230bf0d4d88aad8dcc53e6ef202ee6505c4d0d17f6804fd1df11d544815c5c
Jul 15 12:41:36.176904 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:36.176868    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:41:36.177018 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:36.176947    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:41:36.177018 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:36.176991    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:41:36.185022 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:36.184994    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" event={"ID":"7a87ce31-35dd-446b-8504-67ddd6ed7fe2","Type":"ContainerStarted","Data":"1d230bf0d4d88aad8dcc53e6ef202ee6505c4d0d17f6804fd1df11d544815c5c"}
Jul 15 12:41:37.196949 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:37.196909    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" event={"ID":"7a87ce31-35dd-446b-8504-67ddd6ed7fe2","Type":"ContainerStarted","Data":"4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc"}
Jul 15 12:41:37.224040 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:37.223989    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" podStartSLOduration=2.22397221 podStartE2EDuration="2.22397221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:41:37.222435561 +0000 UTC m=+1824.170464213" watchObservedRunningTime="2026-07-15 12:41:37.22397221 +0000 UTC m=+1824.172000931"
Jul 15 12:41:38.029102 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:38.029069    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:38.033961 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:38.033938    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:38.202620 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:38.202584    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:38.203474 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:38.203453    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:45.649717 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:45.649678    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:41:53.611822 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:53.611153    2571 patch_prober.go:28] interesting pod/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": read tcp 10.133.0.2:49906->10.133.0.64:15021: read: connection reset by peer" start-of-body=
Jul 15 12:41:53.611822 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:53.611226    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": read tcp 10.133.0.2:49906->10.133.0.64:15021: read: connection reset by peer"
Jul 15 12:41:54.301251 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:54.301210    2571 generic.go:356] "Generic (PLEG): container finished" podID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerID="4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc" exitCode=0
Jul 15 12:41:54.301432 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:54.301275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" event={"ID":"7a87ce31-35dd-446b-8504-67ddd6ed7fe2","Type":"ContainerDied","Data":"4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc"}
Jul 15 12:41:54.301740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:54.301726    2571 scope.go:117] "RemoveContainer" containerID="4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc"
Jul 15 12:41:54.302784 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:54.302753    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:41:54.302850 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:54.302826    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:41:54.302897 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:54.302858    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:41:55.309786 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:55.309755    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" event={"ID":"7a87ce31-35dd-446b-8504-67ddd6ed7fe2","Type":"ContainerStarted","Data":"133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b"}
Jul 15 12:41:56.028648 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:56.028543    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:41:56.029056 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:56.029010    2571 patch_prober.go:28] interesting pod/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 15 12:41:56.029147 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:56.029098    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 15 12:41:57.029092 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:57.029044    2571 patch_prober.go:28] interesting pod/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 15 12:41:57.029690 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:57.029113    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 15 12:41:58.029842 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:58.029799    2571 patch_prober.go:28] interesting pod/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 15 12:41:58.030491 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:58.030459    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 15 12:41:59.053463 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:59.053422    2571 patch_prober.go:28] interesting pod/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 15 12:41:59.054000 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:41:59.053500    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 15 12:42:00.033073 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:42:00.033033    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:42:00.033417 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:42:00.033393    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:42:00.034127 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:42:00.034108    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:42:45.054633 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:42:45.054549    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:42:58.138320 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:42:58.138268    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"]
Jul 15 12:42:58.138750 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:42:58.138511    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy" containerID="cri-o://133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b" gracePeriod=30
Jul 15 12:43:00.036009 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:00.035967    2571 patch_prober.go:28] interesting pod/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 12:43:00.036521 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:00.036042    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 12:43:03.404002 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.403929    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:43:03.498948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.498915    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-data\") pod \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") "
Jul 15 12:43:03.498948 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.498953    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-podinfo\") pod \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") "
Jul 15 12:43:03.499228 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.498995    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-token\") pod \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") "
Jul 15 12:43:03.499228 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.499072    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-certs\") pod \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") "
Jul 15 12:43:03.499228 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.499148    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brwjz\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-kube-api-access-brwjz\") pod \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") "
Jul 15 12:43:03.499228 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.499171    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-socket\") pod \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") "
Jul 15 12:43:03.499228 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.499202    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-envoy\") pod \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") "
Jul 15 12:43:03.499522 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.499233    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-credential-socket\") pod \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") "
Jul 15 12:43:03.499522 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.499266    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istiod-ca-cert\") pod \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\" (UID: \"7a87ce31-35dd-446b-8504-67ddd6ed7fe2\") "
Jul 15 12:43:03.500091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.499993    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a87ce31-35dd-446b-8504-67ddd6ed7fe2" (UID: "7a87ce31-35dd-446b-8504-67ddd6ed7fe2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:43:03.500091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.500030    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a87ce31-35dd-446b-8504-67ddd6ed7fe2" (UID: "7a87ce31-35dd-446b-8504-67ddd6ed7fe2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:43:03.500091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.500050    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a87ce31-35dd-446b-8504-67ddd6ed7fe2" (UID: "7a87ce31-35dd-446b-8504-67ddd6ed7fe2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:43:03.500457 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.500112    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a87ce31-35dd-446b-8504-67ddd6ed7fe2" (UID: "7a87ce31-35dd-446b-8504-67ddd6ed7fe2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:43:03.500457 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.500248    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a87ce31-35dd-446b-8504-67ddd6ed7fe2" (UID: "7a87ce31-35dd-446b-8504-67ddd6ed7fe2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:43:03.501542 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.501516    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a87ce31-35dd-446b-8504-67ddd6ed7fe2" (UID: "7a87ce31-35dd-446b-8504-67ddd6ed7fe2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:43:03.501705 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.501679    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a87ce31-35dd-446b-8504-67ddd6ed7fe2" (UID: "7a87ce31-35dd-446b-8504-67ddd6ed7fe2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 12:43:03.501947 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.501926    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a87ce31-35dd-446b-8504-67ddd6ed7fe2" (UID: "7a87ce31-35dd-446b-8504-67ddd6ed7fe2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:43:03.502185 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.502169    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-kube-api-access-brwjz" (OuterVolumeSpecName: "kube-api-access-brwjz") pod "7a87ce31-35dd-446b-8504-67ddd6ed7fe2" (UID: "7a87ce31-35dd-446b-8504-67ddd6ed7fe2"). InnerVolumeSpecName "kube-api-access-brwjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:43:03.600605 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.600567    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-token\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:03.600605 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.600599    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-certs\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:03.600605 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.600609    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brwjz\" (UniqueName: \"kubernetes.io/projected/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-kube-api-access-brwjz\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:03.600865 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.600619    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-workload-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:03.600865 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.600628    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-envoy\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:03.600865 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.600636    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-credential-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:03.600865 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.600643    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istiod-ca-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:03.600865 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.600651    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-data\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:03.600865 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.600658    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a87ce31-35dd-446b-8504-67ddd6ed7fe2-istio-podinfo\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:03.720846 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.720753    2571 generic.go:356] "Generic (PLEG): container finished" podID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerID="133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b" exitCode=0
Jul 15 12:43:03.720846 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.720799    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" event={"ID":"7a87ce31-35dd-446b-8504-67ddd6ed7fe2","Type":"ContainerDied","Data":"133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b"}
Jul 15 12:43:03.720846 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.720848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn" event={"ID":"7a87ce31-35dd-446b-8504-67ddd6ed7fe2","Type":"ContainerDied","Data":"1d230bf0d4d88aad8dcc53e6ef202ee6505c4d0d17f6804fd1df11d544815c5c"}
Jul 15 12:43:03.721137 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.720876    2571 scope.go:117] "RemoveContainer" containerID="133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b"
Jul 15 12:43:03.721137 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.720802    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"
Jul 15 12:43:03.730654 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.730633    2571 scope.go:117] "RemoveContainer" containerID="4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc"
Jul 15 12:43:03.740478 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.740437    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"]
Jul 15 12:43:03.741551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.741529    2571 scope.go:117] "RemoveContainer" containerID="133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b"
Jul 15 12:43:03.741887 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:43:03.741867    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b\": container with ID starting with 133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b not found: ID does not exist" containerID="133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b"
Jul 15 12:43:03.741935 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.741899    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b"} err="failed to get container status \"133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b\": rpc error: code = NotFound desc = could not find container \"133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b\": container with ID starting with 133e5e7d1e78f0bffb8af73e15ee0905a5e03a653afde206824dae21facc4a8b not found: ID does not exist"
Jul 15 12:43:03.741935 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.741918    2571 scope.go:117] "RemoveContainer" containerID="4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc"
Jul 15 12:43:03.742189 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:43:03.742169    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc\": container with ID starting with 4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc not found: ID does not exist" containerID="4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc"
Jul 15 12:43:03.742247 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.742198    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc"} err="failed to get container status \"4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc\": rpc error: code = NotFound desc = could not find container \"4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc\": container with ID starting with 4b68d70aad7db9b598d17f19f1859a2f99d3a25fde64f1f2d314b7ac349f68fc not found: ID does not exist"
Jul 15 12:43:03.743329 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.743309    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f7995e41-openshift-default-6f874cd47-7cddn"]
Jul 15 12:43:03.979616 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.979524    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"]
Jul 15 12:43:03.980048 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.980028    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy"
Jul 15 12:43:03.980140 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.980050    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy"
Jul 15 12:43:03.980140 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.980063    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy"
Jul 15 12:43:03.980140 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.980070    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy"
Jul 15 12:43:03.980317 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.980199    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy"
Jul 15 12:43:03.985018 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.984994    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"
Jul 15 12:43:03.988264 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.988238    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:43:03.990464 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:03.990439    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"]
Jul 15 12:43:04.003836 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:04.003809    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e21a28-9173-424d-820a-727941791994-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt\" (UID: \"a8e21a28-9173-424d-820a-727941791994\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"
Jul 15 12:43:04.105368 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:04.105332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e21a28-9173-424d-820a-727941791994-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt\" (UID: \"a8e21a28-9173-424d-820a-727941791994\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"
Jul 15 12:43:04.105995 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:04.105973    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e21a28-9173-424d-820a-727941791994-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt\" (UID: \"a8e21a28-9173-424d-820a-727941791994\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"
Jul 15 12:43:04.298776 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:04.298749    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"
Jul 15 12:43:04.447872 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:04.447829    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"]
Jul 15 12:43:04.455281 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:43:04.455232    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e21a28_9173_424d_820a_727941791994.slice/crio-018b17e579cf8b0cc57d78887bfd5dc6999e3c8c2739f1dc908b5134a5ed3b13 WatchSource:0}: Error finding container 018b17e579cf8b0cc57d78887bfd5dc6999e3c8c2739f1dc908b5134a5ed3b13: Status 404 returned error can't find the container with id 018b17e579cf8b0cc57d78887bfd5dc6999e3c8c2739f1dc908b5134a5ed3b13
Jul 15 12:43:04.728350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:04.728314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt" event={"ID":"a8e21a28-9173-424d-820a-727941791994","Type":"ContainerStarted","Data":"018b17e579cf8b0cc57d78887bfd5dc6999e3c8c2739f1dc908b5134a5ed3b13"}
Jul 15 12:43:05.458974 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:05.458938    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:43:05.628711 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:05.628675    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" path="/var/lib/kubelet/pods/7a87ce31-35dd-446b-8504-67ddd6ed7fe2/volumes"
Jul 15 12:43:05.735930 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:05.735843    2571 generic.go:356] "Generic (PLEG): container finished" podID="a8e21a28-9173-424d-820a-727941791994" containerID="b857de1a320222b063caddd3dc7ca5c4871e054790e33b09c99219d11d617c33" exitCode=7
Jul 15 12:43:05.735930 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:05.735883    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt" event={"ID":"a8e21a28-9173-424d-820a-727941791994","Type":"ContainerDied","Data":"b857de1a320222b063caddd3dc7ca5c4871e054790e33b09c99219d11d617c33"}
Jul 15 12:43:05.736119 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:05.736069    2571 scope.go:117] "RemoveContainer" containerID="b857de1a320222b063caddd3dc7ca5c4871e054790e33b09c99219d11d617c33"
Jul 15 12:43:06.743083 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:06.742988    2571 generic.go:356] "Generic (PLEG): container finished" podID="a8e21a28-9173-424d-820a-727941791994" containerID="923b3031b6d20fe365e6af03d0d2978e5a243eefd1f4f30af053f0dca2b77cdd" exitCode=7
Jul 15 12:43:06.743573 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:06.743079    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt" event={"ID":"a8e21a28-9173-424d-820a-727941791994","Type":"ContainerDied","Data":"923b3031b6d20fe365e6af03d0d2978e5a243eefd1f4f30af053f0dca2b77cdd"}
Jul 15 12:43:06.743573 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:06.743137    2571 scope.go:117] "RemoveContainer" containerID="b857de1a320222b063caddd3dc7ca5c4871e054790e33b09c99219d11d617c33"
Jul 15 12:43:06.743573 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:06.743272    2571 scope.go:117] "RemoveContainer" containerID="923b3031b6d20fe365e6af03d0d2978e5a243eefd1f4f30af053f0dca2b77cdd"
Jul 15 12:43:06.743573 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:43:06.743504    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt_odh-ai-gateway-infra(a8e21a28-9173-424d-820a-727941791994)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt" podUID="a8e21a28-9173-424d-820a-727941791994"
Jul 15 12:43:07.750795 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:07.750766    2571 scope.go:117] "RemoveContainer" containerID="923b3031b6d20fe365e6af03d0d2978e5a243eefd1f4f30af053f0dca2b77cdd"
Jul 15 12:43:07.751280 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:43:07.751054    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt_odh-ai-gateway-infra(a8e21a28-9173-424d-820a-727941791994)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt" podUID="a8e21a28-9173-424d-820a-727941791994"
Jul 15 12:43:20.621470 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:20.621435    2571 scope.go:117] "RemoveContainer" containerID="923b3031b6d20fe365e6af03d0d2978e5a243eefd1f4f30af053f0dca2b77cdd"
Jul 15 12:43:21.834650 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:21.834617    2571 generic.go:356] "Generic (PLEG): container finished" podID="a8e21a28-9173-424d-820a-727941791994" containerID="53db80d82d9ec47605cabdfcb0a36fac166adf5009513809dc44940ea868ac31" exitCode=0
Jul 15 12:43:21.835120 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:21.834700    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt" event={"ID":"a8e21a28-9173-424d-820a-727941791994","Type":"ContainerDied","Data":"53db80d82d9ec47605cabdfcb0a36fac166adf5009513809dc44940ea868ac31"}
Jul 15 12:43:21.835120 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:21.834795    2571 scope.go:117] "RemoveContainer" containerID="923b3031b6d20fe365e6af03d0d2978e5a243eefd1f4f30af053f0dca2b77cdd"
Jul 15 12:43:22.859855 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:22.859822    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"]
Jul 15 12:43:22.988685 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:22.988662    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"
Jul 15 12:43:23.085797 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:23.085759    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e21a28-9173-424d-820a-727941791994-maas-api-service-ca\") pod \"a8e21a28-9173-424d-820a-727941791994\" (UID: \"a8e21a28-9173-424d-820a-727941791994\") "
Jul 15 12:43:23.086205 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:23.086182    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e21a28-9173-424d-820a-727941791994-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a8e21a28-9173-424d-820a-727941791994" (UID: "a8e21a28-9173-424d-820a-727941791994"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:43:23.186947 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:23.186856    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e21a28-9173-424d-820a-727941791994-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:23.848017 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:23.847978    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt" event={"ID":"a8e21a28-9173-424d-820a-727941791994","Type":"ContainerDied","Data":"018b17e579cf8b0cc57d78887bfd5dc6999e3c8c2739f1dc908b5134a5ed3b13"}
Jul 15 12:43:23.848192 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:23.848026    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="018b17e579cf8b0cc57d78887bfd5dc6999e3c8c2739f1dc908b5134a5ed3b13"
Jul 15 12:43:23.848192 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:23.847988    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"
Jul 15 12:43:23.880199 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:23.880169    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"]
Jul 15 12:43:23.882736 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:23.882709    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-z5dgt"]
Jul 15 12:43:25.627631 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:25.627599    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e21a28-9173-424d-820a-727941791994" path="/var/lib/kubelet/pods/a8e21a28-9173-424d-820a-727941791994/volumes"
Jul 15 12:43:54.016498 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.016448    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"]
Jul 15 12:43:54.016989 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.016880    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e21a28-9173-424d-820a-727941791994" containerName="revoke-keys"
Jul 15 12:43:54.016989 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.016892    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e21a28-9173-424d-820a-727941791994" containerName="revoke-keys"
Jul 15 12:43:54.016989 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.016918    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e21a28-9173-424d-820a-727941791994" containerName="revoke-keys"
Jul 15 12:43:54.016989 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.016924    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e21a28-9173-424d-820a-727941791994" containerName="revoke-keys"
Jul 15 12:43:54.016989 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.016983    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a87ce31-35dd-446b-8504-67ddd6ed7fe2" containerName="istio-proxy"
Jul 15 12:43:54.016989 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.016992    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e21a28-9173-424d-820a-727941791994" containerName="revoke-keys"
Jul 15 12:43:54.017193 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.016999    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e21a28-9173-424d-820a-727941791994" containerName="revoke-keys"
Jul 15 12:43:54.020109 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.020091    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"
Jul 15 12:43:54.023558 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.023342    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:43:54.027547 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.027416    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"]
Jul 15 12:43:54.070625 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.070597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c406175-4fd8-4deb-91be-bfce791aac2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-34aa8850-pndm7\" (UID: \"4c406175-4fd8-4deb-91be-bfce791aac2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"
Jul 15 12:43:54.171988 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.171942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c406175-4fd8-4deb-91be-bfce791aac2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-34aa8850-pndm7\" (UID: \"4c406175-4fd8-4deb-91be-bfce791aac2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"
Jul 15 12:43:54.172589 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.172570    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c406175-4fd8-4deb-91be-bfce791aac2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-34aa8850-pndm7\" (UID: \"4c406175-4fd8-4deb-91be-bfce791aac2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"
Jul 15 12:43:54.339557 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.339524    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"
Jul 15 12:43:54.472415 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:54.472381    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"]
Jul 15 12:43:54.472934 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:43:54.472909    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c406175_4fd8_4deb_91be_bfce791aac2f.slice/crio-dd345c44f481cb22391b13e30f3fa03a1e5235ddd1ac45e8cf83473deb932c5c WatchSource:0}: Error finding container dd345c44f481cb22391b13e30f3fa03a1e5235ddd1ac45e8cf83473deb932c5c: Status 404 returned error can't find the container with id dd345c44f481cb22391b13e30f3fa03a1e5235ddd1ac45e8cf83473deb932c5c
Jul 15 12:43:55.042551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:55.042471    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7" event={"ID":"4c406175-4fd8-4deb-91be-bfce791aac2f","Type":"ContainerStarted","Data":"9dd2ea07407c8423d43a92c3841ac57efd6f46e10c9c852c1ada134750c4e1f6"}
Jul 15 12:43:55.042551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:55.042525    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7" event={"ID":"4c406175-4fd8-4deb-91be-bfce791aac2f","Type":"ContainerStarted","Data":"dd345c44f481cb22391b13e30f3fa03a1e5235ddd1ac45e8cf83473deb932c5c"}
Jul 15 12:43:55.059158 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:55.059100    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7" podStartSLOduration=1.059079055 podStartE2EDuration="1.059079055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:43:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:43:55.058659721 +0000 UTC m=+1962.006688370" watchObservedRunningTime="2026-07-15 12:43:55.059079055 +0000 UTC m=+1962.007107710"
Jul 15 12:43:56.049779 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:56.049747    2571 generic.go:356] "Generic (PLEG): container finished" podID="4c406175-4fd8-4deb-91be-bfce791aac2f" containerID="9dd2ea07407c8423d43a92c3841ac57efd6f46e10c9c852c1ada134750c4e1f6" exitCode=0
Jul 15 12:43:56.050161 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:56.049841    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7" event={"ID":"4c406175-4fd8-4deb-91be-bfce791aac2f","Type":"ContainerDied","Data":"9dd2ea07407c8423d43a92c3841ac57efd6f46e10c9c852c1ada134750c4e1f6"}
Jul 15 12:43:57.189558 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:57.189530    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"
Jul 15 12:43:57.300995 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:57.300958    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c406175-4fd8-4deb-91be-bfce791aac2f-maas-api-service-ca\") pod \"4c406175-4fd8-4deb-91be-bfce791aac2f\" (UID: \"4c406175-4fd8-4deb-91be-bfce791aac2f\") "
Jul 15 12:43:57.301331 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:57.301305    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c406175-4fd8-4deb-91be-bfce791aac2f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c406175-4fd8-4deb-91be-bfce791aac2f" (UID: "4c406175-4fd8-4deb-91be-bfce791aac2f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:43:57.401985 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:57.401893    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c406175-4fd8-4deb-91be-bfce791aac2f-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:43:58.062557 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:58.062525    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7"
Jul 15 12:43:58.062709 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:58.062531    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-34aa8850-pndm7" event={"ID":"4c406175-4fd8-4deb-91be-bfce791aac2f","Type":"ContainerDied","Data":"dd345c44f481cb22391b13e30f3fa03a1e5235ddd1ac45e8cf83473deb932c5c"}
Jul 15 12:43:58.062709 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:43:58.062649    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd345c44f481cb22391b13e30f3fa03a1e5235ddd1ac45e8cf83473deb932c5c"
Jul 15 12:44:07.246824 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:44:07.246744    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:45:00.151245 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.151205    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc"]
Jul 15 12:45:00.151740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.151649    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e21a28-9173-424d-820a-727941791994" containerName="revoke-keys"
Jul 15 12:45:00.151740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.151662    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e21a28-9173-424d-820a-727941791994" containerName="revoke-keys"
Jul 15 12:45:00.151740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.151681    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c406175-4fd8-4deb-91be-bfce791aac2f" containerName="revoke-keys"
Jul 15 12:45:00.151740 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.151687    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c406175-4fd8-4deb-91be-bfce791aac2f" containerName="revoke-keys"
Jul 15 12:45:00.151883 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.151755    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e21a28-9173-424d-820a-727941791994" containerName="revoke-keys"
Jul 15 12:45:00.151883 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.151763    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c406175-4fd8-4deb-91be-bfce791aac2f" containerName="revoke-keys"
Jul 15 12:45:00.154971 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.154955    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc"
Jul 15 12:45:00.158070 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.158051    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:45:00.163213 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.163190    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc"]
Jul 15 12:45:00.166169 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.166149    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc"
Jul 15 12:45:00.313510 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.313474    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc"]
Jul 15 12:45:00.315598 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:45:00.315572    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef95bbb_59f2_450f_9a84_1b1056057e7c.slice/crio-cae707d68caaa2cf80a47e965a411bdca96a673490e70c69c0ddeb18c72bebb4 WatchSource:0}: Error finding container cae707d68caaa2cf80a47e965a411bdca96a673490e70c69c0ddeb18c72bebb4: Status 404 returned error can't find the container with id cae707d68caaa2cf80a47e965a411bdca96a673490e70c69c0ddeb18c72bebb4
Jul 15 12:45:00.428177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:00.428083    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc" event={"ID":"0ef95bbb-59f2-450f-9a84-1b1056057e7c","Type":"ContainerStarted","Data":"cae707d68caaa2cf80a47e965a411bdca96a673490e70c69c0ddeb18c72bebb4"}
Jul 15 12:45:01.439331 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:01.439282    2571 generic.go:356] "Generic (PLEG): container finished" podID="0ef95bbb-59f2-450f-9a84-1b1056057e7c" containerID="d959d0ddc54de0ceff738da74e37ab7b1ac9471825e72a5802b64a21ccfd7a09" exitCode=0
Jul 15 12:45:01.439732 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:01.439342    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc" event={"ID":"0ef95bbb-59f2-450f-9a84-1b1056057e7c","Type":"ContainerDied","Data":"d959d0ddc54de0ceff738da74e37ab7b1ac9471825e72a5802b64a21ccfd7a09"}
Jul 15 12:45:02.581624 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:02.581594    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc"
Jul 15 12:45:03.452460 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:03.452421    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc" event={"ID":"0ef95bbb-59f2-450f-9a84-1b1056057e7c","Type":"ContainerDied","Data":"cae707d68caaa2cf80a47e965a411bdca96a673490e70c69c0ddeb18c72bebb4"}
Jul 15 12:45:03.452460 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:03.452455    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-fg7nc"
Jul 15 12:45:03.452745 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:03.452476    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cae707d68caaa2cf80a47e965a411bdca96a673490e70c69c0ddeb18c72bebb4"
Jul 15 12:45:40.851217 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:40.851134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:45:48.456320 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:48.453420    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:45:56.847154 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:45:56.847118    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:46:08.148675 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:08.148637    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:46:08.963733 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:08.963691    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"]
Jul 15 12:46:08.964205 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:08.964187    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ef95bbb-59f2-450f-9a84-1b1056057e7c" containerName="cleanup"
Jul 15 12:46:08.964311 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:08.964207    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef95bbb-59f2-450f-9a84-1b1056057e7c" containerName="cleanup"
Jul 15 12:46:08.964382 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:08.964326    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ef95bbb-59f2-450f-9a84-1b1056057e7c" containerName="cleanup"
Jul 15 12:46:08.967555 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:08.967532    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"
Jul 15 12:46:08.970674 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:08.970640    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:46:08.976441 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:08.975929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"]
Jul 15 12:46:09.054072 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:09.054032    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18a6155-c376-4a95-befb-8edeaa548112-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm\" (UID: \"f18a6155-c376-4a95-befb-8edeaa548112\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"
Jul 15 12:46:09.154956 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:09.154916    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18a6155-c376-4a95-befb-8edeaa548112-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm\" (UID: \"f18a6155-c376-4a95-befb-8edeaa548112\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"
Jul 15 12:46:09.155607 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:09.155587    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18a6155-c376-4a95-befb-8edeaa548112-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm\" (UID: \"f18a6155-c376-4a95-befb-8edeaa548112\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"
Jul 15 12:46:09.280488 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:09.280400    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"
Jul 15 12:46:09.422922 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:09.422882    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"]
Jul 15 12:46:09.423827 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:46:09.423806    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18a6155_c376_4a95_befb_8edeaa548112.slice/crio-d64bac79823344ff04bfcdc6eabe83a847c90ae8ba557bf6ba4d7a0a2bfa18cf WatchSource:0}: Error finding container d64bac79823344ff04bfcdc6eabe83a847c90ae8ba557bf6ba4d7a0a2bfa18cf: Status 404 returned error can't find the container with id d64bac79823344ff04bfcdc6eabe83a847c90ae8ba557bf6ba4d7a0a2bfa18cf
Jul 15 12:46:09.850380 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:09.850256    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm" event={"ID":"f18a6155-c376-4a95-befb-8edeaa548112","Type":"ContainerStarted","Data":"183f760de237337f04d680b6586b9caa6dcf17a43da82cb572c6018caa030464"}
Jul 15 12:46:09.850380 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:09.850330    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm" event={"ID":"f18a6155-c376-4a95-befb-8edeaa548112","Type":"ContainerStarted","Data":"d64bac79823344ff04bfcdc6eabe83a847c90ae8ba557bf6ba4d7a0a2bfa18cf"}
Jul 15 12:46:09.869030 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:09.868978    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm" podStartSLOduration=1.86896163 podStartE2EDuration="1.86896163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:46:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:46:09.866657785 +0000 UTC m=+2096.814686442" watchObservedRunningTime="2026-07-15 12:46:09.86896163 +0000 UTC m=+2096.816990280"
Jul 15 12:46:10.857624 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:10.857584    2571 generic.go:356] "Generic (PLEG): container finished" podID="f18a6155-c376-4a95-befb-8edeaa548112" containerID="183f760de237337f04d680b6586b9caa6dcf17a43da82cb572c6018caa030464" exitCode=0
Jul 15 12:46:10.858053 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:10.857670    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm" event={"ID":"f18a6155-c376-4a95-befb-8edeaa548112","Type":"ContainerDied","Data":"183f760de237337f04d680b6586b9caa6dcf17a43da82cb572c6018caa030464"}
Jul 15 12:46:12.003778 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:12.003754    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"
Jul 15 12:46:12.086270 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:12.086230    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18a6155-c376-4a95-befb-8edeaa548112-maas-api-service-ca\") pod \"f18a6155-c376-4a95-befb-8edeaa548112\" (UID: \"f18a6155-c376-4a95-befb-8edeaa548112\") "
Jul 15 12:46:12.086632 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:12.086610    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18a6155-c376-4a95-befb-8edeaa548112-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f18a6155-c376-4a95-befb-8edeaa548112" (UID: "f18a6155-c376-4a95-befb-8edeaa548112"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:46:12.187447 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:12.187354    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18a6155-c376-4a95-befb-8edeaa548112-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:46:12.870472 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:12.870438    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm"
Jul 15 12:46:12.870659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:12.870475    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm" event={"ID":"f18a6155-c376-4a95-befb-8edeaa548112","Type":"ContainerDied","Data":"d64bac79823344ff04bfcdc6eabe83a847c90ae8ba557bf6ba4d7a0a2bfa18cf"}
Jul 15 12:46:12.870659 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:12.870522    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d64bac79823344ff04bfcdc6eabe83a847c90ae8ba557bf6ba4d7a0a2bfa18cf"
Jul 15 12:46:16.067179 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:16.067148    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:46:16.074366 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:16.074344    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:46:22.055028 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:22.054989    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:46:57.692100 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.692060    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"]
Jul 15 12:46:57.692572 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.692512    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f18a6155-c376-4a95-befb-8edeaa548112" containerName="revoke-keys"
Jul 15 12:46:57.692572 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.692527    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f18a6155-c376-4a95-befb-8edeaa548112" containerName="revoke-keys"
Jul 15 12:46:57.692664 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.692628    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f18a6155-c376-4a95-befb-8edeaa548112" containerName="revoke-keys"
Jul 15 12:46:57.695972 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.695949    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:57.698810 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.698785    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e1773daa-serving-cert\""
Jul 15 12:46:57.699161 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.698793    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bnnf9\""
Jul 15 12:46:57.707703 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.707674    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"]
Jul 15 12:46:57.816390 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.816353    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwr5t\" (UniqueName: \"kubernetes.io/projected/79a28443-edd3-4c90-aeb9-a36d2111682d-kube-api-access-kwr5t\") pod \"maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:57.816615 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.816583    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a28443-edd3-4c90-aeb9-a36d2111682d-maas-api-tls\") pod \"maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:57.816690 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.816619    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a28443-edd3-4c90-aeb9-a36d2111682d-openshift-service-ca\") pod \"maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:57.917967 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.917932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a28443-edd3-4c90-aeb9-a36d2111682d-maas-api-tls\") pod \"maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:57.917967 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.917970    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a28443-edd3-4c90-aeb9-a36d2111682d-openshift-service-ca\") pod \"maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:57.918225 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.917996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwr5t\" (UniqueName: \"kubernetes.io/projected/79a28443-edd3-4c90-aeb9-a36d2111682d-kube-api-access-kwr5t\") pod \"maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:57.918711 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.918686    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a28443-edd3-4c90-aeb9-a36d2111682d-openshift-service-ca\") pod \"maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:57.920339 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.920311    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a28443-edd3-4c90-aeb9-a36d2111682d-maas-api-tls\") pod \"maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:57.933247 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:57.933215    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwr5t\" (UniqueName: \"kubernetes.io/projected/79a28443-edd3-4c90-aeb9-a36d2111682d-kube-api-access-kwr5t\") pod \"maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:58.009927 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:58.009830    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:58.152719 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:58.152685    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"]
Jul 15 12:46:58.153681 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:46:58.153655    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a28443_edd3_4c90_aeb9_a36d2111682d.slice/crio-a9fef8b839ecabecb62e342d8c86bbd8b493ce84a8edf41cae1f754bff5cb60e WatchSource:0}: Error finding container a9fef8b839ecabecb62e342d8c86bbd8b493ce84a8edf41cae1f754bff5cb60e: Status 404 returned error can't find the container with id a9fef8b839ecabecb62e342d8c86bbd8b493ce84a8edf41cae1f754bff5cb60e
Jul 15 12:46:58.155739 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:58.155720    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:46:59.151757 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:59.151722    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7" event={"ID":"79a28443-edd3-4c90-aeb9-a36d2111682d","Type":"ContainerStarted","Data":"0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f"}
Jul 15 12:46:59.152168 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:59.151814    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:46:59.152168 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:59.151833    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7" event={"ID":"79a28443-edd3-4c90-aeb9-a36d2111682d","Type":"ContainerStarted","Data":"a9fef8b839ecabecb62e342d8c86bbd8b493ce84a8edf41cae1f754bff5cb60e"}
Jul 15 12:46:59.170925 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:46:59.170865    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7" podStartSLOduration=1.691623536 podStartE2EDuration="2.170845271s" totalImagesPullingTime="479.221735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:46:59.170041334 +0000 UTC m=+2146.118069986" watchObservedRunningTime="2026-07-15 12:46:59.170845271 +0000 UTC m=+2146.118873922"
Jul 15 12:47:04.053084 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:04.053052    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:47:05.164395 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:05.164366    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:47:18.751513 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:18.751453    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:47:33.749866 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:33.749833    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:47:40.258736 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:40.258690    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"]
Jul 15 12:47:40.262748 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:40.262723    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"
Jul 15 12:47:40.266681 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:40.266655    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:47:40.270519 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:40.270488    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"]
Jul 15 12:47:40.333285 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:40.333238    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e049c-14c6-4d2e-bcc7-2a98aef4b745-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b\" (UID: \"a29e049c-14c6-4d2e-bcc7-2a98aef4b745\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"
Jul 15 12:47:40.434912 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:40.434874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e049c-14c6-4d2e-bcc7-2a98aef4b745-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b\" (UID: \"a29e049c-14c6-4d2e-bcc7-2a98aef4b745\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"
Jul 15 12:47:40.435534 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:40.435512    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e049c-14c6-4d2e-bcc7-2a98aef4b745-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b\" (UID: \"a29e049c-14c6-4d2e-bcc7-2a98aef4b745\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"
Jul 15 12:47:40.576755 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:40.576722    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"
Jul 15 12:47:40.719737 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:40.719705    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"]
Jul 15 12:47:40.721841 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:47:40.721810    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29e049c_14c6_4d2e_bcc7_2a98aef4b745.slice/crio-5244bfb6d6b7371f3da483602b5d57f0bafb3bce6a1e5a111846bc17866edd94 WatchSource:0}: Error finding container 5244bfb6d6b7371f3da483602b5d57f0bafb3bce6a1e5a111846bc17866edd94: Status 404 returned error can't find the container with id 5244bfb6d6b7371f3da483602b5d57f0bafb3bce6a1e5a111846bc17866edd94
Jul 15 12:47:41.400525 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:41.400490    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b" event={"ID":"a29e049c-14c6-4d2e-bcc7-2a98aef4b745","Type":"ContainerStarted","Data":"3217c2024c8fc483e6d46fee5e8a9b29f3431fcc94d01063a395a8d5a79caaa9"}
Jul 15 12:47:41.400918 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:41.400547    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b" event={"ID":"a29e049c-14c6-4d2e-bcc7-2a98aef4b745","Type":"ContainerStarted","Data":"5244bfb6d6b7371f3da483602b5d57f0bafb3bce6a1e5a111846bc17866edd94"}
Jul 15 12:47:41.416988 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:41.416937    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b" podStartSLOduration=1.4169198060000001 podStartE2EDuration="1.416919806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:47:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:47:41.414814473 +0000 UTC m=+2188.362843124" watchObservedRunningTime="2026-07-15 12:47:41.416919806 +0000 UTC m=+2188.364948456"
Jul 15 12:47:42.407825 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:42.407787    2571 generic.go:356] "Generic (PLEG): container finished" podID="a29e049c-14c6-4d2e-bcc7-2a98aef4b745" containerID="3217c2024c8fc483e6d46fee5e8a9b29f3431fcc94d01063a395a8d5a79caaa9" exitCode=0
Jul 15 12:47:42.408210 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:42.407883    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b" event={"ID":"a29e049c-14c6-4d2e-bcc7-2a98aef4b745","Type":"ContainerDied","Data":"3217c2024c8fc483e6d46fee5e8a9b29f3431fcc94d01063a395a8d5a79caaa9"}
Jul 15 12:47:43.552686 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:43.552662    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"
Jul 15 12:47:43.666660 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:43.666568    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e049c-14c6-4d2e-bcc7-2a98aef4b745-maas-api-service-ca\") pod \"a29e049c-14c6-4d2e-bcc7-2a98aef4b745\" (UID: \"a29e049c-14c6-4d2e-bcc7-2a98aef4b745\") "
Jul 15 12:47:43.666921 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:43.666896    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a29e049c-14c6-4d2e-bcc7-2a98aef4b745-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a29e049c-14c6-4d2e-bcc7-2a98aef4b745" (UID: "a29e049c-14c6-4d2e-bcc7-2a98aef4b745"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:47:43.767760 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:43.767725    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e049c-14c6-4d2e-bcc7-2a98aef4b745-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:47:44.421711 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:44.421683    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b"
Jul 15 12:47:44.421711 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:44.421702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b" event={"ID":"a29e049c-14c6-4d2e-bcc7-2a98aef4b745","Type":"ContainerDied","Data":"5244bfb6d6b7371f3da483602b5d57f0bafb3bce6a1e5a111846bc17866edd94"}
Jul 15 12:47:44.421975 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:44.421744    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5244bfb6d6b7371f3da483602b5d57f0bafb3bce6a1e5a111846bc17866edd94"
Jul 15 12:47:50.661196 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:50.661161    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"]
Jul 15 12:47:50.661597 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:50.661415    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7" podUID="79a28443-edd3-4c90-aeb9-a36d2111682d" containerName="maas-api" containerID="cri-o://0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f" gracePeriod=30
Jul 15 12:47:50.918190 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:50.918127    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:47:51.042770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.042737    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a28443-edd3-4c90-aeb9-a36d2111682d-openshift-service-ca\") pod \"79a28443-edd3-4c90-aeb9-a36d2111682d\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") "
Jul 15 12:47:51.042950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.042791    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a28443-edd3-4c90-aeb9-a36d2111682d-maas-api-tls\") pod \"79a28443-edd3-4c90-aeb9-a36d2111682d\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") "
Jul 15 12:47:51.042950 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.042862    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwr5t\" (UniqueName: \"kubernetes.io/projected/79a28443-edd3-4c90-aeb9-a36d2111682d-kube-api-access-kwr5t\") pod \"79a28443-edd3-4c90-aeb9-a36d2111682d\" (UID: \"79a28443-edd3-4c90-aeb9-a36d2111682d\") "
Jul 15 12:47:51.043105 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.043081    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a28443-edd3-4c90-aeb9-a36d2111682d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79a28443-edd3-4c90-aeb9-a36d2111682d" (UID: "79a28443-edd3-4c90-aeb9-a36d2111682d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:47:51.045009 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.044986    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a28443-edd3-4c90-aeb9-a36d2111682d-kube-api-access-kwr5t" (OuterVolumeSpecName: "kube-api-access-kwr5t") pod "79a28443-edd3-4c90-aeb9-a36d2111682d" (UID: "79a28443-edd3-4c90-aeb9-a36d2111682d"). InnerVolumeSpecName "kube-api-access-kwr5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:47:51.045112 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.045087    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79a28443-edd3-4c90-aeb9-a36d2111682d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79a28443-edd3-4c90-aeb9-a36d2111682d" (UID: "79a28443-edd3-4c90-aeb9-a36d2111682d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:47:51.144560 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.144520    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwr5t\" (UniqueName: \"kubernetes.io/projected/79a28443-edd3-4c90-aeb9-a36d2111682d-kube-api-access-kwr5t\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:47:51.144560 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.144551    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a28443-edd3-4c90-aeb9-a36d2111682d-openshift-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:47:51.144560 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.144561    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a28443-edd3-4c90-aeb9-a36d2111682d-maas-api-tls\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:47:51.463046 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.463012    2571 generic.go:356] "Generic (PLEG): container finished" podID="79a28443-edd3-4c90-aeb9-a36d2111682d" containerID="0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f" exitCode=0
Jul 15 12:47:51.463226 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.463055    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"
Jul 15 12:47:51.463226 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.463100    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7" event={"ID":"79a28443-edd3-4c90-aeb9-a36d2111682d","Type":"ContainerDied","Data":"0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f"}
Jul 15 12:47:51.463226 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.463151    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7" event={"ID":"79a28443-edd3-4c90-aeb9-a36d2111682d","Type":"ContainerDied","Data":"a9fef8b839ecabecb62e342d8c86bbd8b493ce84a8edf41cae1f754bff5cb60e"}
Jul 15 12:47:51.463226 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.463176    2571 scope.go:117] "RemoveContainer" containerID="0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f"
Jul 15 12:47:51.473132 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.473113    2571 scope.go:117] "RemoveContainer" containerID="0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f"
Jul 15 12:47:51.473447 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:47:51.473427    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f\": container with ID starting with 0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f not found: ID does not exist" containerID="0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f"
Jul 15 12:47:51.473541 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.473456    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f"} err="failed to get container status \"0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f\": rpc error: code = NotFound desc = could not find container \"0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f\": container with ID starting with 0c03f21e2680622f9c4da2cacfbfd2869d82f33051eb79dedc1a41f5ea346c3f not found: ID does not exist"
Jul 15 12:47:51.484925 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.484897    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"]
Jul 15 12:47:51.488661 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.488640    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1773daa-7545cd5b4b-kdtz7"]
Jul 15 12:47:51.627611 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:51.627579    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79a28443-edd3-4c90-aeb9-a36d2111682d" path="/var/lib/kubelet/pods/79a28443-edd3-4c90-aeb9-a36d2111682d/volumes"
Jul 15 12:47:54.152891 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:47:54.152849    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:49:01.861028 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:49:01.860986    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:49:15.163830 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:49:15.163780    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:50:00.407921 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.407887    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"]
Jul 15 12:50:00.408614 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.408591    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29e049c-14c6-4d2e-bcc7-2a98aef4b745" containerName="revoke-keys"
Jul 15 12:50:00.408729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.408617    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29e049c-14c6-4d2e-bcc7-2a98aef4b745" containerName="revoke-keys"
Jul 15 12:50:00.408729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.408646    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79a28443-edd3-4c90-aeb9-a36d2111682d" containerName="maas-api"
Jul 15 12:50:00.408729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.408654    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="79a28443-edd3-4c90-aeb9-a36d2111682d" containerName="maas-api"
Jul 15 12:50:00.408887 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.408784    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="79a28443-edd3-4c90-aeb9-a36d2111682d" containerName="maas-api"
Jul 15 12:50:00.408887 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.408796    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a29e049c-14c6-4d2e-bcc7-2a98aef4b745" containerName="revoke-keys"
Jul 15 12:50:00.412116 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.412094    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.416995 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.416970    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0eb9b9-openshift-default-dockercfg-c6mh4\""
Jul 15 12:50:00.426114 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.426085    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"]
Jul 15 12:50:00.471921 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.471877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-podinfo\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.472145 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.471933    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-certs\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.472145 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.471987    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-credential-socket\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.472145 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.472013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istiod-ca-cert\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.472145 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.472034    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-envoy\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.472145 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.472060    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-token\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.472464 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.472139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qztf\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-kube-api-access-2qztf\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.472464 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.472186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-socket\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.472464 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.472214    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-data\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.572787 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.572745    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-certs\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.572982 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.572810    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-credential-socket\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.572982 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.572841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istiod-ca-cert\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.572982 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.572863    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-envoy\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.572995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-token\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.573052    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qztf\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-kube-api-access-2qztf\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.573109    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-socket\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573174 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.573148    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-data\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573426 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.573211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-certs\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573426 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.573331    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-credential-socket\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573426 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.573372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-podinfo\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573648 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.573631    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istiod-ca-cert\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573711 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.573667    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-socket\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.573780 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.573761    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-data\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.575244 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.575227    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-envoy\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.575762 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.575744    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-podinfo\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.581275 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.581254    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-token\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.581485 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.581468    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qztf\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-kube-api-access-2qztf\") pod \"e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") " pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.723911 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.723818    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:00.870353 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:50:00.870318    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f22b6c5_d0b6_4286_9b45_db4f42ad8f46.slice/crio-c5d2bb10b0bd89eb433290e3757ab30f70dd7e112971cf3da4734b0f50d05cb4 WatchSource:0}: Error finding container c5d2bb10b0bd89eb433290e3757ab30f70dd7e112971cf3da4734b0f50d05cb4: Status 404 returned error can't find the container with id c5d2bb10b0bd89eb433290e3757ab30f70dd7e112971cf3da4734b0f50d05cb4
Jul 15 12:50:00.870479 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.870454    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"]
Jul 15 12:50:00.872649 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.872617    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:50:00.872724 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.872683    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:50:00.872724 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:00.872711    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:50:01.249431 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:01.249388    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" event={"ID":"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46","Type":"ContainerStarted","Data":"c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132"}
Jul 15 12:50:01.249627 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:01.249451    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" event={"ID":"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46","Type":"ContainerStarted","Data":"c5d2bb10b0bd89eb433290e3757ab30f70dd7e112971cf3da4734b0f50d05cb4"}
Jul 15 12:50:01.268404 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:01.268357    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" podStartSLOduration=1.268338266 podStartE2EDuration="1.268338266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:50:01.266579256 +0000 UTC m=+2328.214607908" watchObservedRunningTime="2026-07-15 12:50:01.268338266 +0000 UTC m=+2328.216366917"
Jul 15 12:50:01.724370 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:01.724328    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:01.729835 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:01.729805    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:02.255765 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:02.255734    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:02.256741 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:02.256722    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:02.951702 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:02.951665    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:50:13.808530 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:13.808451    2571 scope.go:117] "RemoveContainer" containerID="53db80d82d9ec47605cabdfcb0a36fac166adf5009513809dc44940ea868ac31"
Jul 15 12:50:16.768331 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:16.768284    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:50:18.297476 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:18.297431    2571 patch_prober.go:28] interesting pod/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 12:50:18.297873 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:18.297556    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 12:50:20.391357 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:20.391314    2571 generic.go:356] "Generic (PLEG): container finished" podID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerID="c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132" exitCode=0
Jul 15 12:50:20.391903 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:20.391397    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" event={"ID":"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46","Type":"ContainerDied","Data":"c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132"}
Jul 15 12:50:20.391980 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:20.391932    2571 scope.go:117] "RemoveContainer" containerID="c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132"
Jul 15 12:50:20.393044 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:20.393015    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:50:20.393136 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:20.393090    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:50:20.393136 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:20.393122    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:50:21.399132 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:21.399099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" event={"ID":"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46","Type":"ContainerStarted","Data":"396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590"}
Jul 15 12:50:21.724433 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:21.724331    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:21.724615 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:21.724590    2571 patch_prober.go:28] interesting pod/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 15 12:50:21.724668 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:21.724644    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 15 12:50:22.725276 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:22.725234    2571 patch_prober.go:28] interesting pod/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 15 12:50:22.725716 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:22.725323    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 15 12:50:23.725168 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:23.725131    2571 patch_prober.go:28] interesting pod/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 15 12:50:23.725371 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:23.725202    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 15 12:50:24.724806 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:24.724771    2571 patch_prober.go:28] interesting pod/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 15 12:50:24.725002 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:24.724827    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 15 12:50:25.728509 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:25.728472    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:25.728925 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:25.728839    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:25.729694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:25.729673    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:50:26.254602 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:50:26.254566    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:51:09.457059 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:09.457018    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:51:16.113279 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:16.113248    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:51:16.117733 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:16.117709    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:51:22.859673 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:22.859632    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"]
Jul 15 12:51:22.863475 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:22.863458    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"
Jul 15 12:51:22.866365 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:22.866338    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:51:22.868632 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:22.868600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a5fc72-7471-4365-8ac1-ea353f97ae4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8\" (UID: \"c0a5fc72-7471-4365-8ac1-ea353f97ae4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"
Jul 15 12:51:22.870072 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:22.870050    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"]
Jul 15 12:51:22.969374 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:22.969336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a5fc72-7471-4365-8ac1-ea353f97ae4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8\" (UID: \"c0a5fc72-7471-4365-8ac1-ea353f97ae4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"
Jul 15 12:51:22.970024 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:22.970003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a5fc72-7471-4365-8ac1-ea353f97ae4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8\" (UID: \"c0a5fc72-7471-4365-8ac1-ea353f97ae4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"
Jul 15 12:51:23.176253 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:23.176158    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"
Jul 15 12:51:23.321349 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:23.321322    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"]
Jul 15 12:51:23.323133 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:51:23.323106    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a5fc72_7471_4365_8ac1_ea353f97ae4b.slice/crio-034cd5ac288b13b8ce1cf2b1055c75391a48a02d0216aff9cd3806e8a5b41c2e WatchSource:0}: Error finding container 034cd5ac288b13b8ce1cf2b1055c75391a48a02d0216aff9cd3806e8a5b41c2e: Status 404 returned error can't find the container with id 034cd5ac288b13b8ce1cf2b1055c75391a48a02d0216aff9cd3806e8a5b41c2e
Jul 15 12:51:23.775412 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:23.775299    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8" event={"ID":"c0a5fc72-7471-4365-8ac1-ea353f97ae4b","Type":"ContainerStarted","Data":"41774957b7637a5cbf426e79198dd5bd184f042c3c027a09f18b900abf5d8401"}
Jul 15 12:51:23.775412 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:23.775368    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8" event={"ID":"c0a5fc72-7471-4365-8ac1-ea353f97ae4b","Type":"ContainerStarted","Data":"034cd5ac288b13b8ce1cf2b1055c75391a48a02d0216aff9cd3806e8a5b41c2e"}
Jul 15 12:51:23.791862 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:23.791804    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8" podStartSLOduration=1.7917866820000001 podStartE2EDuration="1.791786682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:51:23.789565078 +0000 UTC m=+2410.737593722" watchObservedRunningTime="2026-07-15 12:51:23.791786682 +0000 UTC m=+2410.739815336"
Jul 15 12:51:24.782913 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:24.782878    2571 generic.go:356] "Generic (PLEG): container finished" podID="c0a5fc72-7471-4365-8ac1-ea353f97ae4b" containerID="41774957b7637a5cbf426e79198dd5bd184f042c3c027a09f18b900abf5d8401" exitCode=0
Jul 15 12:51:24.783340 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:24.782963    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8" event={"ID":"c0a5fc72-7471-4365-8ac1-ea353f97ae4b","Type":"ContainerDied","Data":"41774957b7637a5cbf426e79198dd5bd184f042c3c027a09f18b900abf5d8401"}
Jul 15 12:51:25.929170 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:25.929139    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"
Jul 15 12:51:25.996595 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:25.996560    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a5fc72-7471-4365-8ac1-ea353f97ae4b-maas-api-service-ca\") pod \"c0a5fc72-7471-4365-8ac1-ea353f97ae4b\" (UID: \"c0a5fc72-7471-4365-8ac1-ea353f97ae4b\") "
Jul 15 12:51:25.996929 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:25.996906    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a5fc72-7471-4365-8ac1-ea353f97ae4b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c0a5fc72-7471-4365-8ac1-ea353f97ae4b" (UID: "c0a5fc72-7471-4365-8ac1-ea353f97ae4b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:51:26.097841 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:26.097805    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a5fc72-7471-4365-8ac1-ea353f97ae4b-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:51:26.796886 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:26.796860    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8"
Jul 15 12:51:26.797144 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:26.796900    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8" event={"ID":"c0a5fc72-7471-4365-8ac1-ea353f97ae4b","Type":"ContainerDied","Data":"034cd5ac288b13b8ce1cf2b1055c75391a48a02d0216aff9cd3806e8a5b41c2e"}
Jul 15 12:51:26.797144 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:26.796950    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="034cd5ac288b13b8ce1cf2b1055c75391a48a02d0216aff9cd3806e8a5b41c2e"
Jul 15 12:51:28.250149 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:28.250113    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:51:39.790917 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:39.790837    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:51:48.986119 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:48.986066    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"]
Jul 15 12:51:48.986538 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:48.986527    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a5fc72-7471-4365-8ac1-ea353f97ae4b" containerName="revoke-keys"
Jul 15 12:51:48.986582 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:48.986540    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a5fc72-7471-4365-8ac1-ea353f97ae4b" containerName="revoke-keys"
Jul 15 12:51:48.986629 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:48.986619    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0a5fc72-7471-4365-8ac1-ea353f97ae4b" containerName="revoke-keys"
Jul 15 12:51:48.990035 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:48.990018    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"
Jul 15 12:51:48.993059 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:48.993033    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:51:48.997472 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:48.997444    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"]
Jul 15 12:51:49.128552 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:49.128516    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53d10874-fd14-4480-9ab7-de855fb97afb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs\" (UID: \"53d10874-fd14-4480-9ab7-de855fb97afb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"
Jul 15 12:51:49.229518 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:49.229480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53d10874-fd14-4480-9ab7-de855fb97afb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs\" (UID: \"53d10874-fd14-4480-9ab7-de855fb97afb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"
Jul 15 12:51:49.230168 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:49.230134    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53d10874-fd14-4480-9ab7-de855fb97afb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs\" (UID: \"53d10874-fd14-4480-9ab7-de855fb97afb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"
Jul 15 12:51:49.303297 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:49.303266    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"
Jul 15 12:51:49.450048 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:49.450016    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"]
Jul 15 12:51:49.450754 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:51:49.450728    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53d10874_fd14_4480_9ab7_de855fb97afb.slice/crio-438cebb8f864ae4daf648fe3a2e39e459a1d0dd8ce7dfdb7176732730ab9d940 WatchSource:0}: Error finding container 438cebb8f864ae4daf648fe3a2e39e459a1d0dd8ce7dfdb7176732730ab9d940: Status 404 returned error can't find the container with id 438cebb8f864ae4daf648fe3a2e39e459a1d0dd8ce7dfdb7176732730ab9d940
Jul 15 12:51:49.938620 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:49.938520    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs" event={"ID":"53d10874-fd14-4480-9ab7-de855fb97afb","Type":"ContainerStarted","Data":"d32611abccb35ee735be1489f2d6c3d88c1c178adc04194a1366396a73ab92a2"}
Jul 15 12:51:49.938620 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:49.938577    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs" event={"ID":"53d10874-fd14-4480-9ab7-de855fb97afb","Type":"ContainerStarted","Data":"438cebb8f864ae4daf648fe3a2e39e459a1d0dd8ce7dfdb7176732730ab9d940"}
Jul 15 12:51:49.954884 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:49.954835    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs" podStartSLOduration=1.954818615 podStartE2EDuration="1.954818615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:51:49.953661008 +0000 UTC m=+2436.901689660" watchObservedRunningTime="2026-07-15 12:51:49.954818615 +0000 UTC m=+2436.902847265"
Jul 15 12:51:50.953679 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:50.953641    2571 generic.go:356] "Generic (PLEG): container finished" podID="53d10874-fd14-4480-9ab7-de855fb97afb" containerID="d32611abccb35ee735be1489f2d6c3d88c1c178adc04194a1366396a73ab92a2" exitCode=0
Jul 15 12:51:50.954073 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:50.953727    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs" event={"ID":"53d10874-fd14-4480-9ab7-de855fb97afb","Type":"ContainerDied","Data":"d32611abccb35ee735be1489f2d6c3d88c1c178adc04194a1366396a73ab92a2"}
Jul 15 12:51:52.103142 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:52.103113    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"
Jul 15 12:51:52.260671 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:52.260578    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53d10874-fd14-4480-9ab7-de855fb97afb-maas-api-service-ca\") pod \"53d10874-fd14-4480-9ab7-de855fb97afb\" (UID: \"53d10874-fd14-4480-9ab7-de855fb97afb\") "
Jul 15 12:51:52.260957 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:52.260932    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d10874-fd14-4480-9ab7-de855fb97afb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "53d10874-fd14-4480-9ab7-de855fb97afb" (UID: "53d10874-fd14-4480-9ab7-de855fb97afb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:51:52.362212 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:52.362171    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53d10874-fd14-4480-9ab7-de855fb97afb-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:51:52.967771 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:52.967739    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs"
Jul 15 12:51:52.967947 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:52.967775    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs" event={"ID":"53d10874-fd14-4480-9ab7-de855fb97afb","Type":"ContainerDied","Data":"438cebb8f864ae4daf648fe3a2e39e459a1d0dd8ce7dfdb7176732730ab9d940"}
Jul 15 12:51:52.967947 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:51:52.967817    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="438cebb8f864ae4daf648fe3a2e39e459a1d0dd8ce7dfdb7176732730ab9d940"
Jul 15 12:52:02.350675 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:02.350640    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:52:14.755843 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:14.755810    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"]
Jul 15 12:52:14.756365 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:14.756031    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy" containerID="cri-o://396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590" gracePeriod=30
Jul 15 12:52:20.023535 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.023453    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:52:20.137081 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137048    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-certs\") pod \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") "
Jul 15 12:52:20.137273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137102    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-socket\") pod \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") "
Jul 15 12:52:20.137273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137133    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-token\") pod \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") "
Jul 15 12:52:20.137273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137165    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-data\") pod \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") "
Jul 15 12:52:20.137273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137198    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-credential-socket\") pod \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") "
Jul 15 12:52:20.137273 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137259    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-podinfo\") pod \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") "
Jul 15 12:52:20.137590 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137322    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" (UID: "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:52:20.137590 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137337    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istiod-ca-cert\") pod \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") "
Jul 15 12:52:20.137590 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137387    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qztf\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-kube-api-access-2qztf\") pod \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") "
Jul 15 12:52:20.137590 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137447    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-envoy\") pod \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\" (UID: \"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46\") "
Jul 15 12:52:20.137590 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137499    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" (UID: "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:52:20.138008 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" (UID: "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:52:20.138008 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137842    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-certs\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:20.138008 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137863    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-workload-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:20.138008 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137877    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istiod-ca-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:20.138008 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.137904    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" (UID: "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:52:20.138405 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.138235    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" (UID: "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:52:20.139733 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.139707    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" (UID: "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:52:20.140012 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.139988    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" (UID: "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 12:52:20.140107 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.140042    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" (UID: "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:52:20.140107 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.140053    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-kube-api-access-2qztf" (OuterVolumeSpecName: "kube-api-access-2qztf") pod "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" (UID: "5f22b6c5-d0b6-4286-9b45-db4f42ad8f46"). InnerVolumeSpecName "kube-api-access-2qztf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:52:20.144885 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.144858    2571 generic.go:356] "Generic (PLEG): container finished" podID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerID="396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590" exitCode=0
Jul 15 12:52:20.144978 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.144905    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"
Jul 15 12:52:20.144978 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.144938    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" event={"ID":"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46","Type":"ContainerDied","Data":"396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590"}
Jul 15 12:52:20.145050 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.144994    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9" event={"ID":"5f22b6c5-d0b6-4286-9b45-db4f42ad8f46","Type":"ContainerDied","Data":"c5d2bb10b0bd89eb433290e3757ab30f70dd7e112971cf3da4734b0f50d05cb4"}
Jul 15 12:52:20.145050 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.145017    2571 scope.go:117] "RemoveContainer" containerID="396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590"
Jul 15 12:52:20.163284 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.163263    2571 scope.go:117] "RemoveContainer" containerID="c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132"
Jul 15 12:52:20.172951 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.172932    2571 scope.go:117] "RemoveContainer" containerID="396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590"
Jul 15 12:52:20.173222 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:52:20.173202    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590\": container with ID starting with 396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590 not found: ID does not exist" containerID="396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590"
Jul 15 12:52:20.173299 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.173231    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590"} err="failed to get container status \"396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590\": rpc error: code = NotFound desc = could not find container \"396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590\": container with ID starting with 396aef5ba35d9d3c9b16953a7d382bf84b20a9c46e099a9f7abee81239432590 not found: ID does not exist"
Jul 15 12:52:20.173299 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.173250    2571 scope.go:117] "RemoveContainer" containerID="c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132"
Jul 15 12:52:20.173482 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:52:20.173464    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132\": container with ID starting with c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132 not found: ID does not exist" containerID="c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132"
Jul 15 12:52:20.173521 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.173490    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132"} err="failed to get container status \"c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132\": rpc error: code = NotFound desc = could not find container \"c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132\": container with ID starting with c43c09c8b93fe9c5311d935716811a22c1c7417d804e4adf351adc7767a75132 not found: ID does not exist"
Jul 15 12:52:20.178021 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.177998    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"]
Jul 15 12:52:20.185267 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.185240    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0eb9b9-openshift-default-58d98d9869-97ft9"]
Jul 15 12:52:20.239058 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.239020    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-token\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:20.239058 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.239050    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-data\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:20.239058 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.239060    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-credential-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:20.239329 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.239069    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-podinfo\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:20.239329 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.239080    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qztf\" (UniqueName: \"kubernetes.io/projected/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-kube-api-access-2qztf\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:20.239329 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:20.239088    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46-istio-envoy\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:21.627357 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:21.627322    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" path="/var/lib/kubelet/pods/5f22b6c5-d0b6-4286-9b45-db4f42ad8f46/volumes"
Jul 15 12:52:24.152218 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.152183    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:52:24.213165 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213128    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"]
Jul 15 12:52:24.213631 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213615    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy"
Jul 15 12:52:24.213717 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213633    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy"
Jul 15 12:52:24.213717 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213660    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d10874-fd14-4480-9ab7-de855fb97afb" containerName="revoke-keys"
Jul 15 12:52:24.213717 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213666    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d10874-fd14-4480-9ab7-de855fb97afb" containerName="revoke-keys"
Jul 15 12:52:24.213717 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213675    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy"
Jul 15 12:52:24.213717 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213681    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy"
Jul 15 12:52:24.213985 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213751    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy"
Jul 15 12:52:24.213985 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213758    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f22b6c5-d0b6-4286-9b45-db4f42ad8f46" containerName="istio-proxy"
Jul 15 12:52:24.213985 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.213764    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d10874-fd14-4480-9ab7-de855fb97afb" containerName="revoke-keys"
Jul 15 12:52:24.217206 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.217177    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.219994 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.219971    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-44c6c5-openshift-default-dockercfg-q5vb2\""
Jul 15 12:52:24.230303 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.230258    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"]
Jul 15 12:52:24.378444 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.378409    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-credential-socket\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.378444 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.378443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-socket\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.378645 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.378462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbfd8\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-kube-api-access-wbfd8\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.378645 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.378563    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-token\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.378645 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.378605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-certs\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.378749 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.378678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeacf40-b0bc-4771-adbf-b1211e4de859-istiod-ca-cert\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.378749 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.378705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-data\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.378824 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.378755    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-envoy\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.378824 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.378802    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-podinfo\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.479963 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.479873    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-credential-socket\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.479963 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.479910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-socket\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.479963 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.479930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbfd8\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-kube-api-access-wbfd8\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.479963 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.479959    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-token\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480326 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.479988    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-certs\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480326 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.480052    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeacf40-b0bc-4771-adbf-b1211e4de859-istiod-ca-cert\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480326 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.480076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-data\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480326 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.480120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-envoy\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480326 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.480167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-podinfo\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480601 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.480430    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-credential-socket\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480601 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.480461    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-socket\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480601 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.480498    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-data\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480773 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.480708    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-certs\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.480886 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.480864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeacf40-b0bc-4771-adbf-b1211e4de859-istiod-ca-cert\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.482548 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.482525    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-envoy\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.482649 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.482576    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-podinfo\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.488240 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.488211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-token\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.488498 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.488479    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbfd8\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-kube-api-access-wbfd8\") pod \"e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") " pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.530517 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.530480    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:24.678438 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.678409    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"]
Jul 15 12:52:24.679043 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:52:24.679017    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddeacf40_b0bc_4771_adbf_b1211e4de859.slice/crio-3fa7e9d1664e074843a5fe27ca6827190242bcfadffec51d403acad3ac67e79d WatchSource:0}: Error finding container 3fa7e9d1664e074843a5fe27ca6827190242bcfadffec51d403acad3ac67e79d: Status 404 returned error can't find the container with id 3fa7e9d1664e074843a5fe27ca6827190242bcfadffec51d403acad3ac67e79d
Jul 15 12:52:24.681054 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.681022    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:52:24.681120 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.681088    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:52:24.681120 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:24.681114    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:52:25.178767 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:25.178733    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" event={"ID":"ddeacf40-b0bc-4771-adbf-b1211e4de859","Type":"ContainerStarted","Data":"03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d"}
Jul 15 12:52:25.179162 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:25.178787    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" event={"ID":"ddeacf40-b0bc-4771-adbf-b1211e4de859","Type":"ContainerStarted","Data":"3fa7e9d1664e074843a5fe27ca6827190242bcfadffec51d403acad3ac67e79d"}
Jul 15 12:52:25.201823 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:25.201772    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" podStartSLOduration=1.20175706 podStartE2EDuration="1.20175706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:52:25.19988032 +0000 UTC m=+2472.147908974" watchObservedRunningTime="2026-07-15 12:52:25.20175706 +0000 UTC m=+2472.149785710"
Jul 15 12:52:25.530753 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:25.530663    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:25.535694 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:25.535669    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:26.184843 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:26.184812    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:26.185887 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:26.185867    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:39.703730 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:39.703679    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"]
Jul 15 12:52:39.717318 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:39.717264    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"
Jul 15 12:52:39.720360 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:39.720282    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"]
Jul 15 12:52:39.720758 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:39.720734    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:52:39.727759 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:39.727396    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dcc8a33-a197-4965-bdaa-438c63cea778-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz\" (UID: \"3dcc8a33-a197-4965-bdaa-438c63cea778\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"
Jul 15 12:52:39.828861 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:39.828820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dcc8a33-a197-4965-bdaa-438c63cea778-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz\" (UID: \"3dcc8a33-a197-4965-bdaa-438c63cea778\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"
Jul 15 12:52:39.829739 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:39.829713    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dcc8a33-a197-4965-bdaa-438c63cea778-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz\" (UID: \"3dcc8a33-a197-4965-bdaa-438c63cea778\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"
Jul 15 12:52:40.031265 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:40.031149    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"
Jul 15 12:52:40.181454 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:40.181414    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"]
Jul 15 12:52:40.182426 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:52:40.182358    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dcc8a33_a197_4965_bdaa_438c63cea778.slice/crio-1434c341780225c225247f09380e80f2af71d7c2d42d4d4470c597ed53a51e54 WatchSource:0}: Error finding container 1434c341780225c225247f09380e80f2af71d7c2d42d4d4470c597ed53a51e54: Status 404 returned error can't find the container with id 1434c341780225c225247f09380e80f2af71d7c2d42d4d4470c597ed53a51e54
Jul 15 12:52:40.283183 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:40.283098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz" event={"ID":"3dcc8a33-a197-4965-bdaa-438c63cea778","Type":"ContainerStarted","Data":"1434c341780225c225247f09380e80f2af71d7c2d42d4d4470c597ed53a51e54"}
Jul 15 12:52:40.746262 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:40.746220    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:52:41.186013 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.185933    2571 patch_prober.go:28] interesting pod/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 15 12:52:41.186013 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.185991    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 15 12:52:41.291128 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.291033    2571 generic.go:356] "Generic (PLEG): container finished" podID="3dcc8a33-a197-4965-bdaa-438c63cea778" containerID="d01e5c48c83e60a9dffa894c0025101c6e0dcb87305dac1fe067cc1c26020d76" exitCode=0
Jul 15 12:52:41.291319 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.291118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz" event={"ID":"3dcc8a33-a197-4965-bdaa-438c63cea778","Type":"ContainerDied","Data":"d01e5c48c83e60a9dffa894c0025101c6e0dcb87305dac1fe067cc1c26020d76"}
Jul 15 12:52:41.292829 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.292809    2571 generic.go:356] "Generic (PLEG): container finished" podID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerID="03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d" exitCode=0
Jul 15 12:52:41.292889 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.292863    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" event={"ID":"ddeacf40-b0bc-4771-adbf-b1211e4de859","Type":"ContainerDied","Data":"03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d"}
Jul 15 12:52:41.293220 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.293208    2571 scope.go:117] "RemoveContainer" containerID="03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d"
Jul 15 12:52:41.294237 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.294212    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:52:41.294327 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.294278    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:52:41.294370 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:41.294355    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:52:42.300770 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:42.300729    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" event={"ID":"ddeacf40-b0bc-4771-adbf-b1211e4de859","Type":"ContainerStarted","Data":"6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d"}
Jul 15 12:52:42.443383 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:42.443359    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"
Jul 15 12:52:42.531719 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:42.531682    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:42.531997 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:42.531960    2571 patch_prober.go:28] interesting pod/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 15 12:52:42.532148 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:42.532044    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 15 12:52:42.558914 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:42.558808    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dcc8a33-a197-4965-bdaa-438c63cea778-maas-api-service-ca\") pod \"3dcc8a33-a197-4965-bdaa-438c63cea778\" (UID: \"3dcc8a33-a197-4965-bdaa-438c63cea778\") "
Jul 15 12:52:42.559161 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:42.559137    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dcc8a33-a197-4965-bdaa-438c63cea778-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3dcc8a33-a197-4965-bdaa-438c63cea778" (UID: "3dcc8a33-a197-4965-bdaa-438c63cea778"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:52:42.559251 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:42.559239    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dcc8a33-a197-4965-bdaa-438c63cea778-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:52:43.307885 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:43.307845    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz" event={"ID":"3dcc8a33-a197-4965-bdaa-438c63cea778","Type":"ContainerDied","Data":"1434c341780225c225247f09380e80f2af71d7c2d42d4d4470c597ed53a51e54"}
Jul 15 12:52:43.308257 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:43.307912    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1434c341780225c225247f09380e80f2af71d7c2d42d4d4470c597ed53a51e54"
Jul 15 12:52:43.308257 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:43.307859    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz"
Jul 15 12:52:43.531030 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:43.530985    2571 patch_prober.go:28] interesting pod/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 15 12:52:43.531241 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:43.531068    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 15 12:52:44.531771 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:44.531727    2571 patch_prober.go:28] interesting pod/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 15 12:52:44.532407 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:44.532371    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 15 12:52:45.531612 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:45.531574    2571 patch_prober.go:28] interesting pod/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 15 12:52:45.531957 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:45.531925    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 15 12:52:46.531195 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:46.531153    2571 patch_prober.go:28] interesting pod/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 15 12:52:46.531524 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:46.531494    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 15 12:52:47.534890 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:47.534859    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:47.535277 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:47.535205    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:47.536035 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:47.536017    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:52:55.754785 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:52:55.754752    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:53:05.816654 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:05.816568    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"]
Jul 15 12:53:05.817072 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:05.817055    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dcc8a33-a197-4965-bdaa-438c63cea778" containerName="revoke-keys"
Jul 15 12:53:05.817130 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:05.817074    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dcc8a33-a197-4965-bdaa-438c63cea778" containerName="revoke-keys"
Jul 15 12:53:05.817176 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:05.817166    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dcc8a33-a197-4965-bdaa-438c63cea778" containerName="revoke-keys"
Jul 15 12:53:05.820464 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:05.820445    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"
Jul 15 12:53:05.823620 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:05.823598    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 12:53:05.826933 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:05.826904    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"]
Jul 15 12:53:05.989821 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:05.989781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e23f8b-408c-47f3-8865-44fed33d18ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf\" (UID: \"71e23f8b-408c-47f3-8865-44fed33d18ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"
Jul 15 12:53:06.090932 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:06.090833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e23f8b-408c-47f3-8865-44fed33d18ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf\" (UID: \"71e23f8b-408c-47f3-8865-44fed33d18ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"
Jul 15 12:53:06.091515 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:06.091496    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e23f8b-408c-47f3-8865-44fed33d18ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf\" (UID: \"71e23f8b-408c-47f3-8865-44fed33d18ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"
Jul 15 12:53:06.133982 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:06.133949    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"
Jul 15 12:53:06.278927 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:06.278891    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"]
Jul 15 12:53:06.283582 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:53:06.283543    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e23f8b_408c_47f3_8865_44fed33d18ed.slice/crio-88c221b97855bf56b3b9a09a7839afa4bc5bfa30cd44c7f08537c37871a64a9f WatchSource:0}: Error finding container 88c221b97855bf56b3b9a09a7839afa4bc5bfa30cd44c7f08537c37871a64a9f: Status 404 returned error can't find the container with id 88c221b97855bf56b3b9a09a7839afa4bc5bfa30cd44c7f08537c37871a64a9f
Jul 15 12:53:06.464933 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:06.464895    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf" event={"ID":"71e23f8b-408c-47f3-8865-44fed33d18ed","Type":"ContainerStarted","Data":"88c221b97855bf56b3b9a09a7839afa4bc5bfa30cd44c7f08537c37871a64a9f"}
Jul 15 12:53:07.473337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:07.473228    2571 generic.go:356] "Generic (PLEG): container finished" podID="71e23f8b-408c-47f3-8865-44fed33d18ed" containerID="326dc8a261276d493b5f31cc23af5ec05ebb549553bd0b3cf2dd784ee29c203c" exitCode=0
Jul 15 12:53:07.473337 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:07.473318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf" event={"ID":"71e23f8b-408c-47f3-8865-44fed33d18ed","Type":"ContainerDied","Data":"326dc8a261276d493b5f31cc23af5ec05ebb549553bd0b3cf2dd784ee29c203c"}
Jul 15 12:53:08.620005 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:08.619980    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"
Jul 15 12:53:08.716127 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:08.716090    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e23f8b-408c-47f3-8865-44fed33d18ed-maas-api-service-ca\") pod \"71e23f8b-408c-47f3-8865-44fed33d18ed\" (UID: \"71e23f8b-408c-47f3-8865-44fed33d18ed\") "
Jul 15 12:53:08.716468 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:08.716447    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e23f8b-408c-47f3-8865-44fed33d18ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "71e23f8b-408c-47f3-8865-44fed33d18ed" (UID: "71e23f8b-408c-47f3-8865-44fed33d18ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:53:08.817559 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:08.817519    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e23f8b-408c-47f3-8865-44fed33d18ed-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:09.487551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:09.487515    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf" event={"ID":"71e23f8b-408c-47f3-8865-44fed33d18ed","Type":"ContainerDied","Data":"88c221b97855bf56b3b9a09a7839afa4bc5bfa30cd44c7f08537c37871a64a9f"}
Jul 15 12:53:09.487551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:09.487539    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf"
Jul 15 12:53:09.487764 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:09.487564    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88c221b97855bf56b3b9a09a7839afa4bc5bfa30cd44c7f08537c37871a64a9f"
Jul 15 12:53:19.255369 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:19.255337    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:53:31.604828 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:31.604793    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"]
Jul 15 12:53:31.605220 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:31.605036    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy" containerID="cri-o://6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d" gracePeriod=30
Jul 15 12:53:32.537543 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:32.537499    2571 patch_prober.go:28] interesting pod/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 12:53:32.537714 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:32.537579    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 12:53:36.859236 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.859208    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:53:36.986241 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986164    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeacf40-b0bc-4771-adbf-b1211e4de859-istiod-ca-cert\") pod \"ddeacf40-b0bc-4771-adbf-b1211e4de859\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") "
Jul 15 12:53:36.986241 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986211    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-credential-socket\") pod \"ddeacf40-b0bc-4771-adbf-b1211e4de859\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") "
Jul 15 12:53:36.986459 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986250    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-data\") pod \"ddeacf40-b0bc-4771-adbf-b1211e4de859\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") "
Jul 15 12:53:36.986459 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986299    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-certs\") pod \"ddeacf40-b0bc-4771-adbf-b1211e4de859\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") "
Jul 15 12:53:36.986459 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986402    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-token\") pod \"ddeacf40-b0bc-4771-adbf-b1211e4de859\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") "
Jul 15 12:53:36.986459 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986444    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbfd8\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-kube-api-access-wbfd8\") pod \"ddeacf40-b0bc-4771-adbf-b1211e4de859\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") "
Jul 15 12:53:36.986670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986485    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-envoy\") pod \"ddeacf40-b0bc-4771-adbf-b1211e4de859\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") "
Jul 15 12:53:36.986670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986532    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-podinfo\") pod \"ddeacf40-b0bc-4771-adbf-b1211e4de859\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") "
Jul 15 12:53:36.986670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986549    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddeacf40-b0bc-4771-adbf-b1211e4de859" (UID: "ddeacf40-b0bc-4771-adbf-b1211e4de859"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:53:36.986670 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986570    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-socket\") pod \"ddeacf40-b0bc-4771-adbf-b1211e4de859\" (UID: \"ddeacf40-b0bc-4771-adbf-b1211e4de859\") "
Jul 15 12:53:36.986885 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986667    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddeacf40-b0bc-4771-adbf-b1211e4de859-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddeacf40-b0bc-4771-adbf-b1211e4de859" (UID: "ddeacf40-b0bc-4771-adbf-b1211e4de859"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:53:36.986885 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986875    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddeacf40-b0bc-4771-adbf-b1211e4de859" (UID: "ddeacf40-b0bc-4771-adbf-b1211e4de859"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:53:36.986994 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986954    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:36.986994 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986979    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddeacf40-b0bc-4771-adbf-b1211e4de859-istiod-ca-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:36.987091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986984    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddeacf40-b0bc-4771-adbf-b1211e4de859" (UID: "ddeacf40-b0bc-4771-adbf-b1211e4de859"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:53:36.987091 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.986998    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-credential-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:36.987177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.987144    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddeacf40-b0bc-4771-adbf-b1211e4de859" (UID: "ddeacf40-b0bc-4771-adbf-b1211e4de859"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:53:36.988729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.988703    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddeacf40-b0bc-4771-adbf-b1211e4de859" (UID: "ddeacf40-b0bc-4771-adbf-b1211e4de859"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:53:36.988729 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.988717    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddeacf40-b0bc-4771-adbf-b1211e4de859" (UID: "ddeacf40-b0bc-4771-adbf-b1211e4de859"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 12:53:36.989022 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.988997    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddeacf40-b0bc-4771-adbf-b1211e4de859" (UID: "ddeacf40-b0bc-4771-adbf-b1211e4de859"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:53:36.989022 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:36.989011    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-kube-api-access-wbfd8" (OuterVolumeSpecName: "kube-api-access-wbfd8") pod "ddeacf40-b0bc-4771-adbf-b1211e4de859" (UID: "ddeacf40-b0bc-4771-adbf-b1211e4de859"). InnerVolumeSpecName "kube-api-access-wbfd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:53:37.087839 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.087807    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-podinfo\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:37.087839 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.087836    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-data\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:37.087839 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.087846    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-workload-certs\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:37.088082 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.087855    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-token\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:37.088082 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.087863    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbfd8\" (UniqueName: \"kubernetes.io/projected/ddeacf40-b0bc-4771-adbf-b1211e4de859-kube-api-access-wbfd8\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:37.088082 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.087872    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddeacf40-b0bc-4771-adbf-b1211e4de859-istio-envoy\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 12:53:37.660992 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.660956    2571 generic.go:356] "Generic (PLEG): container finished" podID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerID="6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d" exitCode=0
Jul 15 12:53:37.661177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.661014    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"
Jul 15 12:53:37.661177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.661048    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" event={"ID":"ddeacf40-b0bc-4771-adbf-b1211e4de859","Type":"ContainerDied","Data":"6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d"}
Jul 15 12:53:37.661177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.661115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq" event={"ID":"ddeacf40-b0bc-4771-adbf-b1211e4de859","Type":"ContainerDied","Data":"3fa7e9d1664e074843a5fe27ca6827190242bcfadffec51d403acad3ac67e79d"}
Jul 15 12:53:37.661177 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.661144    2571 scope.go:117] "RemoveContainer" containerID="6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d"
Jul 15 12:53:37.670738 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.670721    2571 scope.go:117] "RemoveContainer" containerID="03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d"
Jul 15 12:53:37.679421 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.679400    2571 scope.go:117] "RemoveContainer" containerID="6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d"
Jul 15 12:53:37.679720 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:53:37.679700    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d\": container with ID starting with 6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d not found: ID does not exist" containerID="6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d"
Jul 15 12:53:37.679788 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.679727    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d"} err="failed to get container status \"6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d\": rpc error: code = NotFound desc = could not find container \"6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d\": container with ID starting with 6049ee672ad12d9cef23d242d7242a27e7798f509699e124c631185e1074ad8d not found: ID does not exist"
Jul 15 12:53:37.679788 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.679745    2571 scope.go:117] "RemoveContainer" containerID="03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d"
Jul 15 12:53:37.680020 ip-10-0-142-29 kubenswrapper[2571]: E0715 12:53:37.679984    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d\": container with ID starting with 03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d not found: ID does not exist" containerID="03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d"
Jul 15 12:53:37.680061 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.680027    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d"} err="failed to get container status \"03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d\": rpc error: code = NotFound desc = could not find container \"03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d\": container with ID starting with 03fddf79954dfbacfa6d132ec1370bf9eca94593c4c640341289f7d7c81c2c4d not found: ID does not exist"
Jul 15 12:53:37.682866 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.682846    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"]
Jul 15 12:53:37.685681 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:37.685660    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-44c6c5-openshift-default-84575ff84c-frwpq"]
Jul 15 12:53:39.627111 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:39.627078    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" path="/var/lib/kubelet/pods/ddeacf40-b0bc-4771-adbf-b1211e4de859/volumes"
Jul 15 12:53:40.535340 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.535281    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"]
Jul 15 12:53:40.535990 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.535972    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy"
Jul 15 12:53:40.536063 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.535993    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy"
Jul 15 12:53:40.536063 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.536005    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy"
Jul 15 12:53:40.536063 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.536013    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy"
Jul 15 12:53:40.536063 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.536039    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e23f8b-408c-47f3-8865-44fed33d18ed" containerName="revoke-keys"
Jul 15 12:53:40.536063 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.536048    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e23f8b-408c-47f3-8865-44fed33d18ed" containerName="revoke-keys"
Jul 15 12:53:40.536348 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.536153    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy"
Jul 15 12:53:40.536348 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.536165    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddeacf40-b0bc-4771-adbf-b1211e4de859" containerName="istio-proxy"
Jul 15 12:53:40.536348 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.536175    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e23f8b-408c-47f3-8865-44fed33d18ed" containerName="revoke-keys"
Jul 15 12:53:40.541784 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.541764    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.545360 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.545330    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-dc94b0-openshift-default-dockercfg-d97x4\""
Jul 15 12:53:40.552039 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.552013    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"]
Jul 15 12:53:40.621908 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.621862    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49102547-4012-4160-a246-b2daab54160d-istiod-ca-cert\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.621908 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.621913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w6j6\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-kube-api-access-4w6j6\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.622176 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.622006    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49102547-4012-4160-a246-b2daab54160d-istio-podinfo\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.622176 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.622059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-credential-socket\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.622399 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.622371    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-socket\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.622464 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.622414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-certs\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.622508 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.622468    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-data\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.622545 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.622510    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-envoy\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.622623 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.622606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-istio-token\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.724126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-istio-token\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.724126 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49102547-4012-4160-a246-b2daab54160d-istiod-ca-cert\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.724730 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724150    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w6j6\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-kube-api-access-4w6j6\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.724730 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724268    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49102547-4012-4160-a246-b2daab54160d-istio-podinfo\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.724730 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-credential-socket\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.724730 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-socket\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.724730 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724451    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-certs\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.724730 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-data\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.724730 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724515    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-envoy\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.725105 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724839    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-socket\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.725105 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724902    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-credential-socket\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.725105 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724941    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-certs\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.725105 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.724976    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-data\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.725458 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.725436    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49102547-4012-4160-a246-b2daab54160d-istiod-ca-cert\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.726899 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.726881    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49102547-4012-4160-a246-b2daab54160d-istio-podinfo\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.727068 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.727052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-envoy\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.732648 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.732618    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w6j6\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-kube-api-access-4w6j6\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.732648 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.732643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-istio-token\") pod \"e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") " pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:40.854551 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:40.854498    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:41.014094 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:41.014051    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"]
Jul 15 12:53:41.014424 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:53:41.014394    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49102547_4012_4160_a246_b2daab54160d.slice/crio-5791f1fc9c00f3236905f52d4b17209004e34edd6a66f6ce07ee89593cad3434 WatchSource:0}: Error finding container 5791f1fc9c00f3236905f52d4b17209004e34edd6a66f6ce07ee89593cad3434: Status 404 returned error can't find the container with id 5791f1fc9c00f3236905f52d4b17209004e34edd6a66f6ce07ee89593cad3434
Jul 15 12:53:41.016613 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:41.016564    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:53:41.016710 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:41.016687    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:53:41.016753 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:41.016736    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:53:41.055006 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:41.054976    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:53:41.687449 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:41.687410    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" event={"ID":"49102547-4012-4160-a246-b2daab54160d","Type":"ContainerStarted","Data":"403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16"}
Jul 15 12:53:41.687643 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:41.687470    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" event={"ID":"49102547-4012-4160-a246-b2daab54160d","Type":"ContainerStarted","Data":"5791f1fc9c00f3236905f52d4b17209004e34edd6a66f6ce07ee89593cad3434"}
Jul 15 12:53:41.710928 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:41.710875    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" podStartSLOduration=1.710856695 podStartE2EDuration="1.710856695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:53:41.707602654 +0000 UTC m=+2548.655631304" watchObservedRunningTime="2026-07-15 12:53:41.710856695 +0000 UTC m=+2548.658885345"
Jul 15 12:53:41.855009 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:41.854973    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:42.860405 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:42.860376    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:43.700525 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:43.700492    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:43.701359 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:43.701341    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:55.793094 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:55.793059    2571 generic.go:356] "Generic (PLEG): container finished" podID="49102547-4012-4160-a246-b2daab54160d" containerID="403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16" exitCode=0
Jul 15 12:53:55.793541 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:55.793133    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" event={"ID":"49102547-4012-4160-a246-b2daab54160d","Type":"ContainerDied","Data":"403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16"}
Jul 15 12:53:55.793588 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:55.793566    2571 scope.go:117] "RemoveContainer" containerID="403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16"
Jul 15 12:53:55.794610 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:55.794573    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:53:55.794732 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:55.794660    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:53:55.794732 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:55.794705    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 12:53:56.759760 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:56.759724    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:53:56.801152 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:56.801120    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" event={"ID":"49102547-4012-4160-a246-b2daab54160d","Type":"ContainerStarted","Data":"d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db"}
Jul 15 12:53:56.855455 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:56.855423    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:56.856424 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:56.856388    2571 patch_prober.go:28] interesting pod/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 15 12:53:56.856572 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:56.856460    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 15 12:53:57.855791 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:57.855748    2571 patch_prober.go:28] interesting pod/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 15 12:53:57.856350 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:57.855802    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 15 12:53:58.701185 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:58.701150    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:53:58.854909 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:58.854865    2571 patch_prober.go:28] interesting pod/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 15 12:53:58.855107 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:58.854928    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 15 12:53:59.855633 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:59.855592    2571 patch_prober.go:28] interesting pod/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 15 12:53:59.856041 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:53:59.855658    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 15 12:54:00.859070 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:54:00.859040    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:54:00.860392 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:54:00.860371    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 12:54:19.345495 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:54:19.345458    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:54:38.956424 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:54:38.956337    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:55:07.949677 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:55:07.949644    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:55:25.757826 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:55:25.757789    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:55:43.446386 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:55:43.446350    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:55:57.543738 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:55:57.543701    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:56:14.650352 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:56:14.650266    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:56:16.157548 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:56:16.157521    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:56:16.165322 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:56:16.165283    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 12:56:32.547253 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:56:32.547220    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:56:51.145413 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:56:51.145373    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:57:08.047051 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:57:08.047014    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:57:43.854562 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:57:43.854475    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:58:09.659844 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:58:09.659807    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:58:27.353681 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:58:27.353642    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:58:44.753330 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:58:44.753277    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:58:56.748137 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:58:56.748100    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:59:16.657257 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:16.657172    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:59:30.854465 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:30.854424    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:59:52.748178 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:52.748142    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 12:59:58.500346 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.500308    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140687796612912"]
Jul 15 12:59:58.503944 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.503923    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796612912"
Jul 15 12:59:58.507466 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.507441    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dpng6\""
Jul 15 12:59:58.510058 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.510035    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687796612912"]
Jul 15 12:59:58.590842 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.590800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rng8\" (UniqueName: \"kubernetes.io/projected/72a51785-7e07-4971-8b69-1569c86e0709-kube-api-access-7rng8\") pod \"test-curl-7576-140687796612912\" (UID: \"72a51785-7e07-4971-8b69-1569c86e0709\") " pod="opendatahub/test-curl-7576-140687796612912"
Jul 15 12:59:58.691475 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.691430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rng8\" (UniqueName: \"kubernetes.io/projected/72a51785-7e07-4971-8b69-1569c86e0709-kube-api-access-7rng8\") pod \"test-curl-7576-140687796612912\" (UID: \"72a51785-7e07-4971-8b69-1569c86e0709\") " pod="opendatahub/test-curl-7576-140687796612912"
Jul 15 12:59:58.699786 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.699753    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rng8\" (UniqueName: \"kubernetes.io/projected/72a51785-7e07-4971-8b69-1569c86e0709-kube-api-access-7rng8\") pod \"test-curl-7576-140687796612912\" (UID: \"72a51785-7e07-4971-8b69-1569c86e0709\") " pod="opendatahub/test-curl-7576-140687796612912"
Jul 15 12:59:58.814942 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.814910    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796612912"
Jul 15 12:59:58.946695 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.946663    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687796612912"]
Jul 15 12:59:58.952569 ip-10-0-142-29 kubenswrapper[2571]: W0715 12:59:58.952491    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72a51785_7e07_4971_8b69_1569c86e0709.slice/crio-8a9dd22a334403a9e22ac02ee04981bba1730d4be1770a5af7a9f0913d8eee49 WatchSource:0}: Error finding container 8a9dd22a334403a9e22ac02ee04981bba1730d4be1770a5af7a9f0913d8eee49: Status 404 returned error can't find the container with id 8a9dd22a334403a9e22ac02ee04981bba1730d4be1770a5af7a9f0913d8eee49
Jul 15 12:59:58.953596 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:58.953578    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:59:59.031043 ip-10-0-142-29 kubenswrapper[2571]: I0715 12:59:59.031007    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687796612912" event={"ID":"72a51785-7e07-4971-8b69-1569c86e0709","Type":"ContainerStarted","Data":"8a9dd22a334403a9e22ac02ee04981bba1730d4be1770a5af7a9f0913d8eee49"}
Jul 15 13:00:00.038970 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:00.038875    2571 generic.go:356] "Generic (PLEG): container finished" podID="72a51785-7e07-4971-8b69-1569c86e0709" containerID="328f948a17d7844d7ac14f7dd10d98941a42e140684092c1a22e9b01ca70a3b6" exitCode=0
Jul 15 13:00:00.038970 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:00.038959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687796612912" event={"ID":"72a51785-7e07-4971-8b69-1569c86e0709","Type":"ContainerDied","Data":"328f948a17d7844d7ac14f7dd10d98941a42e140684092c1a22e9b01ca70a3b6"}
Jul 15 13:00:00.130335 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:00.130298    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8"]
Jul 15 13:00:00.133963 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:00.133945    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8"
Jul 15 13:00:00.136648 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:00.136627    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 13:00:00.142796 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:00.142765    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8"]
Jul 15 13:00:00.145599 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:00.145571    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8"
Jul 15 13:00:00.497322 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:00.497257    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8"]
Jul 15 13:00:00.502617 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:00:00.502585    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ebb31f4_7047_4825_9b31_42b746418e44.slice/crio-59b74b6f3215dc74fad9c1218c74e6af240398c201d688c71314f449453dbe82 WatchSource:0}: Error finding container 59b74b6f3215dc74fad9c1218c74e6af240398c201d688c71314f449453dbe82: Status 404 returned error can't find the container with id 59b74b6f3215dc74fad9c1218c74e6af240398c201d688c71314f449453dbe82
Jul 15 13:00:01.047043 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.047001    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8" event={"ID":"6ebb31f4-7047-4825-9b31-42b746418e44","Type":"ContainerStarted","Data":"c8cd32c79e8280c22d3c154b89dbfa8803c48936b5d96aaebc41f344784261a0"}
Jul 15 13:00:01.047561 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.047071    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8" event={"ID":"6ebb31f4-7047-4825-9b31-42b746418e44","Type":"ContainerStarted","Data":"59b74b6f3215dc74fad9c1218c74e6af240398c201d688c71314f449453dbe82"}
Jul 15 13:00:01.065306 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.065238    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8" podStartSLOduration=1.065221025 podStartE2EDuration="1.065221025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:00:01.062067129 +0000 UTC m=+2928.010095783" watchObservedRunningTime="2026-07-15 13:00:01.065221025 +0000 UTC m=+2928.013249711"
Jul 15 13:00:01.188463 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.188433    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796612912"
Jul 15 13:00:01.226977 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.226935    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140687796612912_72a51785-7e07-4971-8b69-1569c86e0709/test-curl-7576-140687796612912/0.log"
Jul 15 13:00:01.250912 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.250864    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140687796612912"]
Jul 15 13:00:01.253978 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.253952    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140687796612912"]
Jul 15 13:00:01.316650 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.316616    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rng8\" (UniqueName: \"kubernetes.io/projected/72a51785-7e07-4971-8b69-1569c86e0709-kube-api-access-7rng8\") pod \"72a51785-7e07-4971-8b69-1569c86e0709\" (UID: \"72a51785-7e07-4971-8b69-1569c86e0709\") "
Jul 15 13:00:01.318717 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.318684    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a51785-7e07-4971-8b69-1569c86e0709-kube-api-access-7rng8" (OuterVolumeSpecName: "kube-api-access-7rng8") pod "72a51785-7e07-4971-8b69-1569c86e0709" (UID: "72a51785-7e07-4971-8b69-1569c86e0709"). InnerVolumeSpecName "kube-api-access-7rng8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:00:01.383129 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.383040    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140687796610352"]
Jul 15 13:00:01.383504 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.383491    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a51785-7e07-4971-8b69-1569c86e0709" containerName="test-curl-7576-140687796612912"
Jul 15 13:00:01.383553 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.383506    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a51785-7e07-4971-8b69-1569c86e0709" containerName="test-curl-7576-140687796612912"
Jul 15 13:00:01.383589 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.383577    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a51785-7e07-4971-8b69-1569c86e0709" containerName="test-curl-7576-140687796612912"
Jul 15 13:00:01.386882 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.386863    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796610352"
Jul 15 13:00:01.393808 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.393779    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687796610352"]
Jul 15 13:00:01.418487 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.418447    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rng8\" (UniqueName: \"kubernetes.io/projected/72a51785-7e07-4971-8b69-1569c86e0709-kube-api-access-7rng8\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:00:01.519747 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.519715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgbp9\" (UniqueName: \"kubernetes.io/projected/2cbe259b-095c-4837-95cf-41404ab32ffd-kube-api-access-wgbp9\") pod \"test-curl-7576-140687796610352\" (UID: \"2cbe259b-095c-4837-95cf-41404ab32ffd\") " pod="opendatahub/test-curl-7576-140687796610352"
Jul 15 13:00:01.621327 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.621253    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgbp9\" (UniqueName: \"kubernetes.io/projected/2cbe259b-095c-4837-95cf-41404ab32ffd-kube-api-access-wgbp9\") pod \"test-curl-7576-140687796610352\" (UID: \"2cbe259b-095c-4837-95cf-41404ab32ffd\") " pod="opendatahub/test-curl-7576-140687796610352"
Jul 15 13:00:01.628704 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.628675    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a51785-7e07-4971-8b69-1569c86e0709" path="/var/lib/kubelet/pods/72a51785-7e07-4971-8b69-1569c86e0709/volumes"
Jul 15 13:00:01.630482 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.630454    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgbp9\" (UniqueName: \"kubernetes.io/projected/2cbe259b-095c-4837-95cf-41404ab32ffd-kube-api-access-wgbp9\") pod \"test-curl-7576-140687796610352\" (UID: \"2cbe259b-095c-4837-95cf-41404ab32ffd\") " pod="opendatahub/test-curl-7576-140687796610352"
Jul 15 13:00:01.698392 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.698356    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796610352"
Jul 15 13:00:01.842539 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:01.842511    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687796610352"]
Jul 15 13:00:01.843369 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:00:01.843346    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cbe259b_095c_4837_95cf_41404ab32ffd.slice/crio-6869b5dc3b64199eba45cff96c9925b4467c8c920e5274f696835c928d04c71e WatchSource:0}: Error finding container 6869b5dc3b64199eba45cff96c9925b4467c8c920e5274f696835c928d04c71e: Status 404 returned error can't find the container with id 6869b5dc3b64199eba45cff96c9925b4467c8c920e5274f696835c928d04c71e
Jul 15 13:00:02.054721 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:02.054677    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687796610352" event={"ID":"2cbe259b-095c-4837-95cf-41404ab32ffd","Type":"ContainerStarted","Data":"6869b5dc3b64199eba45cff96c9925b4467c8c920e5274f696835c928d04c71e"}
Jul 15 13:00:02.056016 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:02.055995    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796612912"
Jul 15 13:00:02.056133 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:02.056037    2571 scope.go:117] "RemoveContainer" containerID="328f948a17d7844d7ac14f7dd10d98941a42e140684092c1a22e9b01ca70a3b6"
Jul 15 13:00:02.057812 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:02.057784    2571 generic.go:356] "Generic (PLEG): container finished" podID="6ebb31f4-7047-4825-9b31-42b746418e44" containerID="c8cd32c79e8280c22d3c154b89dbfa8803c48936b5d96aaebc41f344784261a0" exitCode=0
Jul 15 13:00:02.057973 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:02.057840    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8" event={"ID":"6ebb31f4-7047-4825-9b31-42b746418e44","Type":"ContainerDied","Data":"c8cd32c79e8280c22d3c154b89dbfa8803c48936b5d96aaebc41f344784261a0"}
Jul 15 13:00:03.210728 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:03.210699    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8"
Jul 15 13:00:04.080416 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:04.080376    2571 generic.go:356] "Generic (PLEG): container finished" podID="2cbe259b-095c-4837-95cf-41404ab32ffd" containerID="916b1f11eba3a604dc14dfdc767414ac87d28ab406d35d8407d9d8e8d54ae47c" exitCode=0
Jul 15 13:00:04.080627 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:04.080455    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687796610352" event={"ID":"2cbe259b-095c-4837-95cf-41404ab32ffd","Type":"ContainerDied","Data":"916b1f11eba3a604dc14dfdc767414ac87d28ab406d35d8407d9d8e8d54ae47c"}
Jul 15 13:00:04.081785 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:04.081761    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8" event={"ID":"6ebb31f4-7047-4825-9b31-42b746418e44","Type":"ContainerDied","Data":"59b74b6f3215dc74fad9c1218c74e6af240398c201d688c71314f449453dbe82"}
Jul 15 13:00:04.081785 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:04.081784    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8"
Jul 15 13:00:04.081944 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:04.081822    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59b74b6f3215dc74fad9c1218c74e6af240398c201d688c71314f449453dbe82"
Jul 15 13:00:05.230677 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.230650    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796610352"
Jul 15 13:00:05.251486 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.251459    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140687796610352_2cbe259b-095c-4837-95cf-41404ab32ffd/test-curl-7576-140687796610352/0.log"
Jul 15 13:00:05.253651 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.253633    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgbp9\" (UniqueName: \"kubernetes.io/projected/2cbe259b-095c-4837-95cf-41404ab32ffd-kube-api-access-wgbp9\") pod \"2cbe259b-095c-4837-95cf-41404ab32ffd\" (UID: \"2cbe259b-095c-4837-95cf-41404ab32ffd\") "
Jul 15 13:00:05.255728 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.255701    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cbe259b-095c-4837-95cf-41404ab32ffd-kube-api-access-wgbp9" (OuterVolumeSpecName: "kube-api-access-wgbp9") pod "2cbe259b-095c-4837-95cf-41404ab32ffd" (UID: "2cbe259b-095c-4837-95cf-41404ab32ffd"). InnerVolumeSpecName "kube-api-access-wgbp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:00:05.276939 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.276905    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140687796610352"]
Jul 15 13:00:05.281745 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.281721    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140687796610352"]
Jul 15 13:00:05.354768 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.354683    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgbp9\" (UniqueName: \"kubernetes.io/projected/2cbe259b-095c-4837-95cf-41404ab32ffd-kube-api-access-wgbp9\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:00:05.455237 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.455200    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:05.455670 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.455654    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cbe259b-095c-4837-95cf-41404ab32ffd" containerName="test-curl-7576-140687796610352"
Jul 15 13:00:05.455721 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.455672    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cbe259b-095c-4837-95cf-41404ab32ffd" containerName="test-curl-7576-140687796610352"
Jul 15 13:00:05.455721 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.455685    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ebb31f4-7047-4825-9b31-42b746418e44" containerName="cleanup"
Jul 15 13:00:05.455721 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.455691    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ebb31f4-7047-4825-9b31-42b746418e44" containerName="cleanup"
Jul 15 13:00:05.455823 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.455764    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ebb31f4-7047-4825-9b31-42b746418e44" containerName="cleanup"
Jul 15 13:00:05.455823 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.455774    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cbe259b-095c-4837-95cf-41404ab32ffd" containerName="test-curl-7576-140687796610352"
Jul 15 13:00:05.459004 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.458988    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:05.464077 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.464052    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:05.556505 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.556466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf6gm\" (UniqueName: \"kubernetes.io/projected/b8ab2c32-f335-4de0-b924-ac1846f6f0c5-kube-api-access-qf6gm\") pod \"test-curl-7576-140687796553456\" (UID: \"b8ab2c32-f335-4de0-b924-ac1846f6f0c5\") " pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:05.628202 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.628119    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cbe259b-095c-4837-95cf-41404ab32ffd" path="/var/lib/kubelet/pods/2cbe259b-095c-4837-95cf-41404ab32ffd/volumes"
Jul 15 13:00:05.657851 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.657814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf6gm\" (UniqueName: \"kubernetes.io/projected/b8ab2c32-f335-4de0-b924-ac1846f6f0c5-kube-api-access-qf6gm\") pod \"test-curl-7576-140687796553456\" (UID: \"b8ab2c32-f335-4de0-b924-ac1846f6f0c5\") " pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:05.666609 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.666585    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf6gm\" (UniqueName: \"kubernetes.io/projected/b8ab2c32-f335-4de0-b924-ac1846f6f0c5-kube-api-access-qf6gm\") pod \"test-curl-7576-140687796553456\" (UID: \"b8ab2c32-f335-4de0-b924-ac1846f6f0c5\") " pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:05.770818 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.770779    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:05.905710 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:05.905684    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:05.906305 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:00:05.906272    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8ab2c32_f335_4de0_b924_ac1846f6f0c5.slice/crio-89743f8fd9c08b0b63dcd1f54ab4886af1c837173e086f47a6f4e9f5ee56e382 WatchSource:0}: Error finding container 89743f8fd9c08b0b63dcd1f54ab4886af1c837173e086f47a6f4e9f5ee56e382: Status 404 returned error can't find the container with id 89743f8fd9c08b0b63dcd1f54ab4886af1c837173e086f47a6f4e9f5ee56e382
Jul 15 13:00:06.095865 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:06.095831    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796610352"
Jul 15 13:00:06.096062 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:06.095901    2571 scope.go:117] "RemoveContainer" containerID="916b1f11eba3a604dc14dfdc767414ac87d28ab406d35d8407d9d8e8d54ae47c"
Jul 15 13:00:06.097270 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:06.097112    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687796553456" event={"ID":"b8ab2c32-f335-4de0-b924-ac1846f6f0c5","Type":"ContainerStarted","Data":"89743f8fd9c08b0b63dcd1f54ab4886af1c837173e086f47a6f4e9f5ee56e382"}
Jul 15 13:00:07.105804 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:07.105770    2571 generic.go:356] "Generic (PLEG): container finished" podID="b8ab2c32-f335-4de0-b924-ac1846f6f0c5" containerID="d99502fef01d2f69b80d4e164699f53bdfdaaff48963c6393c6cfaf81d87472d" exitCode=0
Jul 15 13:00:07.105804 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:07.105804    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687796553456" event={"ID":"b8ab2c32-f335-4de0-b924-ac1846f6f0c5","Type":"ContainerDied","Data":"d99502fef01d2f69b80d4e164699f53bdfdaaff48963c6393c6cfaf81d87472d"}
Jul 15 13:00:07.952052 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:07.952012    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 13:00:08.256864 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.256837    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:08.278511 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.278486    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140687796553456_b8ab2c32-f335-4de0-b924-ac1846f6f0c5/test-curl-7576-140687796553456/0.log"
Jul 15 13:00:08.302648 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.302614    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:08.306915 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.306887    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:08.381988 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.381954    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf6gm\" (UniqueName: \"kubernetes.io/projected/b8ab2c32-f335-4de0-b924-ac1846f6f0c5-kube-api-access-qf6gm\") pod \"b8ab2c32-f335-4de0-b924-ac1846f6f0c5\" (UID: \"b8ab2c32-f335-4de0-b924-ac1846f6f0c5\") "
Jul 15 13:00:08.384027 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.384002    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ab2c32-f335-4de0-b924-ac1846f6f0c5-kube-api-access-qf6gm" (OuterVolumeSpecName: "kube-api-access-qf6gm") pod "b8ab2c32-f335-4de0-b924-ac1846f6f0c5" (UID: "b8ab2c32-f335-4de0-b924-ac1846f6f0c5"). InnerVolumeSpecName "kube-api-access-qf6gm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:00:08.431757 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.431716    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:08.432224 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.432204    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ab2c32-f335-4de0-b924-ac1846f6f0c5" containerName="test-curl-7576-140687796553456"
Jul 15 13:00:08.432373 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.432225    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ab2c32-f335-4de0-b924-ac1846f6f0c5" containerName="test-curl-7576-140687796553456"
Jul 15 13:00:08.432373 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.432361    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ab2c32-f335-4de0-b924-ac1846f6f0c5" containerName="test-curl-7576-140687796553456"
Jul 15 13:00:08.435623 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.435601    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:08.441588 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.441561    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:08.483444 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.483403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxcb\" (UniqueName: \"kubernetes.io/projected/3dc03072-e35f-4176-9dea-e2c4d1f7e6bf-kube-api-access-2nxcb\") pod \"test-curl-7576-140687796553456\" (UID: \"3dc03072-e35f-4176-9dea-e2c4d1f7e6bf\") " pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:08.483617 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.483519    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf6gm\" (UniqueName: \"kubernetes.io/projected/b8ab2c32-f335-4de0-b924-ac1846f6f0c5-kube-api-access-qf6gm\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:00:08.584502 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.584460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxcb\" (UniqueName: \"kubernetes.io/projected/3dc03072-e35f-4176-9dea-e2c4d1f7e6bf-kube-api-access-2nxcb\") pod \"test-curl-7576-140687796553456\" (UID: \"3dc03072-e35f-4176-9dea-e2c4d1f7e6bf\") " pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:08.593668 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.593639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxcb\" (UniqueName: \"kubernetes.io/projected/3dc03072-e35f-4176-9dea-e2c4d1f7e6bf-kube-api-access-2nxcb\") pod \"test-curl-7576-140687796553456\" (UID: \"3dc03072-e35f-4176-9dea-e2c4d1f7e6bf\") " pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:08.745867 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.745830    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:08.881732 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:08.881701    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:08.883075 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:00:08.883043    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dc03072_e35f_4176_9dea_e2c4d1f7e6bf.slice/crio-f1f49e12c5e7da1fd64737a4468ce8dbb1308a35546694063f6edac6a9d368c7 WatchSource:0}: Error finding container f1f49e12c5e7da1fd64737a4468ce8dbb1308a35546694063f6edac6a9d368c7: Status 404 returned error can't find the container with id f1f49e12c5e7da1fd64737a4468ce8dbb1308a35546694063f6edac6a9d368c7
Jul 15 13:00:09.119436 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:09.119396    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687796553456" event={"ID":"3dc03072-e35f-4176-9dea-e2c4d1f7e6bf","Type":"ContainerStarted","Data":"f1f49e12c5e7da1fd64737a4468ce8dbb1308a35546694063f6edac6a9d368c7"}
Jul 15 13:00:09.120614 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:09.120594    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89743f8fd9c08b0b63dcd1f54ab4886af1c837173e086f47a6f4e9f5ee56e382"
Jul 15 13:00:09.120614 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:09.120607    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:09.132510 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:09.132438    2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7576-140687796553456" oldPodUID="b8ab2c32-f335-4de0-b924-ac1846f6f0c5" podUID="3dc03072-e35f-4176-9dea-e2c4d1f7e6bf"
Jul 15 13:00:09.627690 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:09.627657    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ab2c32-f335-4de0-b924-ac1846f6f0c5" path="/var/lib/kubelet/pods/b8ab2c32-f335-4de0-b924-ac1846f6f0c5/volumes"
Jul 15 13:00:10.128786 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:10.128750    2571 generic.go:356] "Generic (PLEG): container finished" podID="3dc03072-e35f-4176-9dea-e2c4d1f7e6bf" containerID="19f39176a0fca0d3c59e5a743cb4a68ca1011bb93d9ea53c10329f3553dfa6cb" exitCode=0
Jul 15 13:00:10.128970 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:10.128871    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687796553456" event={"ID":"3dc03072-e35f-4176-9dea-e2c4d1f7e6bf","Type":"ContainerDied","Data":"19f39176a0fca0d3c59e5a743cb4a68ca1011bb93d9ea53c10329f3553dfa6cb"}
Jul 15 13:00:11.286709 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.286687    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:11.307575 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.307543    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140687796553456_3dc03072-e35f-4176-9dea-e2c4d1f7e6bf/test-curl-7576-140687796553456/0.log"
Jul 15 13:00:11.309730 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.309701    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nxcb\" (UniqueName: \"kubernetes.io/projected/3dc03072-e35f-4176-9dea-e2c4d1f7e6bf-kube-api-access-2nxcb\") pod \"3dc03072-e35f-4176-9dea-e2c4d1f7e6bf\" (UID: \"3dc03072-e35f-4176-9dea-e2c4d1f7e6bf\") "
Jul 15 13:00:11.311796 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.311773    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc03072-e35f-4176-9dea-e2c4d1f7e6bf-kube-api-access-2nxcb" (OuterVolumeSpecName: "kube-api-access-2nxcb") pod "3dc03072-e35f-4176-9dea-e2c4d1f7e6bf" (UID: "3dc03072-e35f-4176-9dea-e2c4d1f7e6bf"). InnerVolumeSpecName "kube-api-access-2nxcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:00:11.336526 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.336487    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:11.341891 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.341862    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140687796553456"]
Jul 15 13:00:11.411250 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.411161    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nxcb\" (UniqueName: \"kubernetes.io/projected/3dc03072-e35f-4176-9dea-e2c4d1f7e6bf-kube-api-access-2nxcb\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:00:11.465702 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.465662    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:11.466102 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.466089    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc03072-e35f-4176-9dea-e2c4d1f7e6bf" containerName="test-curl-7576-140687796553456"
Jul 15 13:00:11.466143 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.466104    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc03072-e35f-4176-9dea-e2c4d1f7e6bf" containerName="test-curl-7576-140687796553456"
Jul 15 13:00:11.466204 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.466195    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc03072-e35f-4176-9dea-e2c4d1f7e6bf" containerName="test-curl-7576-140687796553456"
Jul 15 13:00:11.469465 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.469450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:11.474696 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.474669    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:11.512101 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.512065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79w7z\" (UniqueName: \"kubernetes.io/projected/746dcfd2-28f2-4ce8-ab6e-146d3d1bd949-kube-api-access-79w7z\") pod \"test-curl-7576-140687799174464\" (UID: \"746dcfd2-28f2-4ce8-ab6e-146d3d1bd949\") " pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:11.613738 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.613689    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79w7z\" (UniqueName: \"kubernetes.io/projected/746dcfd2-28f2-4ce8-ab6e-146d3d1bd949-kube-api-access-79w7z\") pod \"test-curl-7576-140687799174464\" (UID: \"746dcfd2-28f2-4ce8-ab6e-146d3d1bd949\") " pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:11.622066 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.622034    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79w7z\" (UniqueName: \"kubernetes.io/projected/746dcfd2-28f2-4ce8-ab6e-146d3d1bd949-kube-api-access-79w7z\") pod \"test-curl-7576-140687799174464\" (UID: \"746dcfd2-28f2-4ce8-ab6e-146d3d1bd949\") " pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:11.628349 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.628321    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dc03072-e35f-4176-9dea-e2c4d1f7e6bf" path="/var/lib/kubelet/pods/3dc03072-e35f-4176-9dea-e2c4d1f7e6bf/volumes"
Jul 15 13:00:11.780689 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.780611    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:11.913863 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:11.913839    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:11.914378 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:00:11.914348    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod746dcfd2_28f2_4ce8_ab6e_146d3d1bd949.slice/crio-1af291665919f181b76fef94ef034642a7e77cdf332a619edd40c6b7aef15fb0 WatchSource:0}: Error finding container 1af291665919f181b76fef94ef034642a7e77cdf332a619edd40c6b7aef15fb0: Status 404 returned error can't find the container with id 1af291665919f181b76fef94ef034642a7e77cdf332a619edd40c6b7aef15fb0
Jul 15 13:00:12.143387 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:12.143354    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687799174464" event={"ID":"746dcfd2-28f2-4ce8-ab6e-146d3d1bd949","Type":"ContainerStarted","Data":"1af291665919f181b76fef94ef034642a7e77cdf332a619edd40c6b7aef15fb0"}
Jul 15 13:00:12.144721 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:12.144702    2571 scope.go:117] "RemoveContainer" containerID="19f39176a0fca0d3c59e5a743cb4a68ca1011bb93d9ea53c10329f3553dfa6cb"
Jul 15 13:00:12.144835 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:12.144703    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687796553456"
Jul 15 13:00:13.152611 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:13.152572    2571 generic.go:356] "Generic (PLEG): container finished" podID="746dcfd2-28f2-4ce8-ab6e-146d3d1bd949" containerID="65f1d87f05ec8333222d44b3dc171a2a35235a40f2437eb95eae33c9177659dd" exitCode=0
Jul 15 13:00:13.153033 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:13.152653    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687799174464" event={"ID":"746dcfd2-28f2-4ce8-ab6e-146d3d1bd949","Type":"ContainerDied","Data":"65f1d87f05ec8333222d44b3dc171a2a35235a40f2437eb95eae33c9177659dd"}
Jul 15 13:00:14.305964 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.305934    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:14.325787 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.325760    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140687799174464_746dcfd2-28f2-4ce8-ab6e-146d3d1bd949/test-curl-7576-140687799174464/0.log"
Jul 15 13:00:14.342917 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.342879    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79w7z\" (UniqueName: \"kubernetes.io/projected/746dcfd2-28f2-4ce8-ab6e-146d3d1bd949-kube-api-access-79w7z\") pod \"746dcfd2-28f2-4ce8-ab6e-146d3d1bd949\" (UID: \"746dcfd2-28f2-4ce8-ab6e-146d3d1bd949\") "
Jul 15 13:00:14.344922 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.344896    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/746dcfd2-28f2-4ce8-ab6e-146d3d1bd949-kube-api-access-79w7z" (OuterVolumeSpecName: "kube-api-access-79w7z") pod "746dcfd2-28f2-4ce8-ab6e-146d3d1bd949" (UID: "746dcfd2-28f2-4ce8-ab6e-146d3d1bd949"). InnerVolumeSpecName "kube-api-access-79w7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:00:14.350545 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.350508    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:14.353781 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.353756    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:14.443753 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.443710    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79w7z\" (UniqueName: \"kubernetes.io/projected/746dcfd2-28f2-4ce8-ab6e-146d3d1bd949-kube-api-access-79w7z\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:00:14.481463 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.481375    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:14.481818 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.481803    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746dcfd2-28f2-4ce8-ab6e-146d3d1bd949" containerName="test-curl-7576-140687799174464"
Jul 15 13:00:14.481859 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.481819    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="746dcfd2-28f2-4ce8-ab6e-146d3d1bd949" containerName="test-curl-7576-140687799174464"
Jul 15 13:00:14.481910 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.481901    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="746dcfd2-28f2-4ce8-ab6e-146d3d1bd949" containerName="test-curl-7576-140687799174464"
Jul 15 13:00:14.485151 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.485128    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:14.488781 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.488754    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:14.544469 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.544433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdsc4\" (UniqueName: \"kubernetes.io/projected/46c7e672-e0ce-47ce-af0f-719494b84a8a-kube-api-access-vdsc4\") pod \"test-curl-7576-140687799174464\" (UID: \"46c7e672-e0ce-47ce-af0f-719494b84a8a\") " pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:14.645934 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.645899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdsc4\" (UniqueName: \"kubernetes.io/projected/46c7e672-e0ce-47ce-af0f-719494b84a8a-kube-api-access-vdsc4\") pod \"test-curl-7576-140687799174464\" (UID: \"46c7e672-e0ce-47ce-af0f-719494b84a8a\") " pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:14.654239 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.654207    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdsc4\" (UniqueName: \"kubernetes.io/projected/46c7e672-e0ce-47ce-af0f-719494b84a8a-kube-api-access-vdsc4\") pod \"test-curl-7576-140687799174464\" (UID: \"46c7e672-e0ce-47ce-af0f-719494b84a8a\") " pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:14.796625 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.796536    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:14.935046 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:14.935018    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:14.935728 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:00:14.935705    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46c7e672_e0ce_47ce_af0f_719494b84a8a.slice/crio-8972d22b40136553710671ada8e72bb710f94c76147113bfdcf10caec01c7e78 WatchSource:0}: Error finding container 8972d22b40136553710671ada8e72bb710f94c76147113bfdcf10caec01c7e78: Status 404 returned error can't find the container with id 8972d22b40136553710671ada8e72bb710f94c76147113bfdcf10caec01c7e78
Jul 15 13:00:15.167396 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:15.167362    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1af291665919f181b76fef94ef034642a7e77cdf332a619edd40c6b7aef15fb0"
Jul 15 13:00:15.167396 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:15.167361    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:15.168765 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:15.168736    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687799174464" event={"ID":"46c7e672-e0ce-47ce-af0f-719494b84a8a","Type":"ContainerStarted","Data":"8972d22b40136553710671ada8e72bb710f94c76147113bfdcf10caec01c7e78"}
Jul 15 13:00:15.180243 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:15.180216    2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7576-140687799174464" oldPodUID="746dcfd2-28f2-4ce8-ab6e-146d3d1bd949" podUID="46c7e672-e0ce-47ce-af0f-719494b84a8a"
Jul 15 13:00:15.627333 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:15.627276    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="746dcfd2-28f2-4ce8-ab6e-146d3d1bd949" path="/var/lib/kubelet/pods/746dcfd2-28f2-4ce8-ab6e-146d3d1bd949/volumes"
Jul 15 13:00:16.177134 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:16.177098    2571 generic.go:356] "Generic (PLEG): container finished" podID="46c7e672-e0ce-47ce-af0f-719494b84a8a" containerID="556ba762e08c7bf7f65b3e1ac23d5ff91fcfe07b0f3bc9e774f5222201752784" exitCode=0
Jul 15 13:00:16.177314 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:16.177155    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140687799174464" event={"ID":"46c7e672-e0ce-47ce-af0f-719494b84a8a","Type":"ContainerDied","Data":"556ba762e08c7bf7f65b3e1ac23d5ff91fcfe07b0f3bc9e774f5222201752784"}
Jul 15 13:00:17.333177 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.333148    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:17.353846 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.353819    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140687799174464_46c7e672-e0ce-47ce-af0f-719494b84a8a/test-curl-7576-140687799174464/0.log"
Jul 15 13:00:17.373982 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.373953    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdsc4\" (UniqueName: \"kubernetes.io/projected/46c7e672-e0ce-47ce-af0f-719494b84a8a-kube-api-access-vdsc4\") pod \"46c7e672-e0ce-47ce-af0f-719494b84a8a\" (UID: \"46c7e672-e0ce-47ce-af0f-719494b84a8a\") "
Jul 15 13:00:17.376208 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.376177    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c7e672-e0ce-47ce-af0f-719494b84a8a-kube-api-access-vdsc4" (OuterVolumeSpecName: "kube-api-access-vdsc4") pod "46c7e672-e0ce-47ce-af0f-719494b84a8a" (UID: "46c7e672-e0ce-47ce-af0f-719494b84a8a"). InnerVolumeSpecName "kube-api-access-vdsc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:00:17.377581 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.377558    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:17.382675 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.382650    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140687799174464"]
Jul 15 13:00:17.475331 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.475228    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdsc4\" (UniqueName: \"kubernetes.io/projected/46c7e672-e0ce-47ce-af0f-719494b84a8a-kube-api-access-vdsc4\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:00:17.566475 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.566432    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"]
Jul 15 13:00:17.566905 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.566890    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46c7e672-e0ce-47ce-af0f-719494b84a8a" containerName="test-curl-7576-140687799174464"
Jul 15 13:00:17.566905 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.566905    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c7e672-e0ce-47ce-af0f-719494b84a8a" containerName="test-curl-7576-140687799174464"
Jul 15 13:00:17.567032 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.566973    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="46c7e672-e0ce-47ce-af0f-719494b84a8a" containerName="test-curl-7576-140687799174464"
Jul 15 13:00:17.570126 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.570105    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"
Jul 15 13:00:17.573784 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.573763    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 13:00:17.578146 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.578117    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"]
Jul 15 13:00:17.627855 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.627823    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46c7e672-e0ce-47ce-af0f-719494b84a8a" path="/var/lib/kubelet/pods/46c7e672-e0ce-47ce-af0f-719494b84a8a/volumes"
Jul 15 13:00:17.677548 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.677510    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32bc53aa-cc61-41c7-af11-80b3a7c48c31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv\" (UID: \"32bc53aa-cc61-41c7-af11-80b3a7c48c31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"
Jul 15 13:00:17.778406 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.778275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32bc53aa-cc61-41c7-af11-80b3a7c48c31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv\" (UID: \"32bc53aa-cc61-41c7-af11-80b3a7c48c31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"
Jul 15 13:00:17.778920 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.778900    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32bc53aa-cc61-41c7-af11-80b3a7c48c31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv\" (UID: \"32bc53aa-cc61-41c7-af11-80b3a7c48c31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"
Jul 15 13:00:17.883674 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:17.883641    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"
Jul 15 13:00:18.191160 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:18.191134    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140687799174464"
Jul 15 13:00:18.191160 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:18.191162    2571 scope.go:117] "RemoveContainer" containerID="556ba762e08c7bf7f65b3e1ac23d5ff91fcfe07b0f3bc9e774f5222201752784"
Jul 15 13:00:18.232087 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:18.232052    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"]
Jul 15 13:00:18.232948 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:00:18.232917    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bc53aa_cc61_41c7_af11_80b3a7c48c31.slice/crio-90ce319a4aa19666e9341e31db69b68aa8db859f2c1941eb19cd1c213c039e07 WatchSource:0}: Error finding container 90ce319a4aa19666e9341e31db69b68aa8db859f2c1941eb19cd1c213c039e07: Status 404 returned error can't find the container with id 90ce319a4aa19666e9341e31db69b68aa8db859f2c1941eb19cd1c213c039e07
Jul 15 13:00:19.200797 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:19.200700    2571 generic.go:356] "Generic (PLEG): container finished" podID="32bc53aa-cc61-41c7-af11-80b3a7c48c31" containerID="0da6de483ce1b8f257a6326b9f6c0e805326f27b60d705af68da98f8c5e947ea" exitCode=0
Jul 15 13:00:19.200797 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:19.200780    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv" event={"ID":"32bc53aa-cc61-41c7-af11-80b3a7c48c31","Type":"ContainerDied","Data":"0da6de483ce1b8f257a6326b9f6c0e805326f27b60d705af68da98f8c5e947ea"}
Jul 15 13:00:19.201205 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:19.200831    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv" event={"ID":"32bc53aa-cc61-41c7-af11-80b3a7c48c31","Type":"ContainerStarted","Data":"90ce319a4aa19666e9341e31db69b68aa8db859f2c1941eb19cd1c213c039e07"}
Jul 15 13:00:20.349184 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:20.349157    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"
Jul 15 13:00:20.406403 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:20.406370    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32bc53aa-cc61-41c7-af11-80b3a7c48c31-maas-api-service-ca\") pod \"32bc53aa-cc61-41c7-af11-80b3a7c48c31\" (UID: \"32bc53aa-cc61-41c7-af11-80b3a7c48c31\") "
Jul 15 13:00:20.406724 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:20.406704    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32bc53aa-cc61-41c7-af11-80b3a7c48c31-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "32bc53aa-cc61-41c7-af11-80b3a7c48c31" (UID: "32bc53aa-cc61-41c7-af11-80b3a7c48c31"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:00:20.508020 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:20.507931    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32bc53aa-cc61-41c7-af11-80b3a7c48c31-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:00:21.215972 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:21.215944    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv"
Jul 15 13:00:21.216131 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:21.215987    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv" event={"ID":"32bc53aa-cc61-41c7-af11-80b3a7c48c31","Type":"ContainerDied","Data":"90ce319a4aa19666e9341e31db69b68aa8db859f2c1941eb19cd1c213c039e07"}
Jul 15 13:00:21.216131 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:21.216035    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90ce319a4aa19666e9341e31db69b68aa8db859f2c1941eb19cd1c213c039e07"
Jul 15 13:00:31.544957 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:31.544920    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 13:00:43.762897 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.762810    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"]
Jul 15 13:00:43.763270 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.763252    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32bc53aa-cc61-41c7-af11-80b3a7c48c31" containerName="revoke-keys"
Jul 15 13:00:43.763270 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.763262    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="32bc53aa-cc61-41c7-af11-80b3a7c48c31" containerName="revoke-keys"
Jul 15 13:00:43.763364 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.763347    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="32bc53aa-cc61-41c7-af11-80b3a7c48c31" containerName="revoke-keys"
Jul 15 13:00:43.768518 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.768487    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"
Jul 15 13:00:43.771320 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.771282    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv8zr\""
Jul 15 13:00:43.774018 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.773990    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"]
Jul 15 13:00:43.835746 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.835703    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3b963a-a82f-485b-98c3-b22e49e6ba1e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7\" (UID: \"ae3b963a-a82f-485b-98c3-b22e49e6ba1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"
Jul 15 13:00:43.936574 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.936540    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3b963a-a82f-485b-98c3-b22e49e6ba1e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7\" (UID: \"ae3b963a-a82f-485b-98c3-b22e49e6ba1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"
Jul 15 13:00:43.937163 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:43.937142    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3b963a-a82f-485b-98c3-b22e49e6ba1e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7\" (UID: \"ae3b963a-a82f-485b-98c3-b22e49e6ba1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"
Jul 15 13:00:44.083116 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:44.083079    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"
Jul 15 13:00:44.224898 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:44.224859    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"]
Jul 15 13:00:44.226014 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:00:44.225983    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3b963a_a82f_485b_98c3_b22e49e6ba1e.slice/crio-ec55908430fc8167c598677d2235ffb952bbae428f11be4ca0c93216218ce59e WatchSource:0}: Error finding container ec55908430fc8167c598677d2235ffb952bbae428f11be4ca0c93216218ce59e: Status 404 returned error can't find the container with id ec55908430fc8167c598677d2235ffb952bbae428f11be4ca0c93216218ce59e
Jul 15 13:00:44.367522 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:44.367434    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7" event={"ID":"ae3b963a-a82f-485b-98c3-b22e49e6ba1e","Type":"ContainerStarted","Data":"ec55908430fc8167c598677d2235ffb952bbae428f11be4ca0c93216218ce59e"}
Jul 15 13:00:45.375626 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:45.375595    2571 generic.go:356] "Generic (PLEG): container finished" podID="ae3b963a-a82f-485b-98c3-b22e49e6ba1e" containerID="af68d9728eff4a160395e4ad821c656424b789d6fe5959ff7014085c8af32298" exitCode=0
Jul 15 13:00:45.376040 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:45.375691    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7" event={"ID":"ae3b963a-a82f-485b-98c3-b22e49e6ba1e","Type":"ContainerDied","Data":"af68d9728eff4a160395e4ad821c656424b789d6fe5959ff7014085c8af32298"}
Jul 15 13:00:46.517620 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:46.517577    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"
Jul 15 13:00:46.559992 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:46.559961    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3b963a-a82f-485b-98c3-b22e49e6ba1e-maas-api-service-ca\") pod \"ae3b963a-a82f-485b-98c3-b22e49e6ba1e\" (UID: \"ae3b963a-a82f-485b-98c3-b22e49e6ba1e\") "
Jul 15 13:00:46.560377 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:46.560354    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae3b963a-a82f-485b-98c3-b22e49e6ba1e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ae3b963a-a82f-485b-98c3-b22e49e6ba1e" (UID: "ae3b963a-a82f-485b-98c3-b22e49e6ba1e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:00:46.661758 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:46.661658    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae3b963a-a82f-485b-98c3-b22e49e6ba1e-maas-api-service-ca\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:00:47.390415 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:47.390384    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7"
Jul 15 13:00:47.390605 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:47.390412    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7" event={"ID":"ae3b963a-a82f-485b-98c3-b22e49e6ba1e","Type":"ContainerDied","Data":"ec55908430fc8167c598677d2235ffb952bbae428f11be4ca0c93216218ce59e"}
Jul 15 13:00:47.390605 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:47.390456    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec55908430fc8167c598677d2235ffb952bbae428f11be4ca0c93216218ce59e"
Jul 15 13:00:54.156997 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:54.156963    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8"]
Jul 15 13:00:54.161673 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:54.161647    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-dc94b0-29735340-krbs8"]
Jul 15 13:00:55.627155 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:55.627117    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ebb31f4-7047-4825-9b31-42b746418e44" path="/var/lib/kubelet/pods/6ebb31f4-7047-4825-9b31-42b746418e44/volumes"
Jul 15 13:00:57.251230 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:00:57.251191    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpz49"]
Jul 15 13:01:09.492125 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:09.492089    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"]
Jul 15 13:01:09.492701 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:09.492374    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy" containerID="cri-o://d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db" gracePeriod=30
Jul 15 13:01:14.756312 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.756232    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 13:01:14.827308 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827264    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-data\") pod \"49102547-4012-4160-a246-b2daab54160d\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") "
Jul 15 13:01:14.827460 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827344    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49102547-4012-4160-a246-b2daab54160d-istio-podinfo\") pod \"49102547-4012-4160-a246-b2daab54160d\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") "
Jul 15 13:01:14.827460 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827379    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-certs\") pod \"49102547-4012-4160-a246-b2daab54160d\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") "
Jul 15 13:01:14.827568 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827458    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-credential-socket\") pod \"49102547-4012-4160-a246-b2daab54160d\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") "
Jul 15 13:01:14.827568 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827482    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-istio-token\") pod \"49102547-4012-4160-a246-b2daab54160d\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") "
Jul 15 13:01:14.827568 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827524    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49102547-4012-4160-a246-b2daab54160d-istiod-ca-cert\") pod \"49102547-4012-4160-a246-b2daab54160d\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") "
Jul 15 13:01:14.827721 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827564    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-socket\") pod \"49102547-4012-4160-a246-b2daab54160d\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") "
Jul 15 13:01:14.827721 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827598    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-envoy\") pod \"49102547-4012-4160-a246-b2daab54160d\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") "
Jul 15 13:01:14.827721 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827651    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w6j6\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-kube-api-access-4w6j6\") pod \"49102547-4012-4160-a246-b2daab54160d\" (UID: \"49102547-4012-4160-a246-b2daab54160d\") "
Jul 15 13:01:14.827888 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827716    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49102547-4012-4160-a246-b2daab54160d" (UID: "49102547-4012-4160-a246-b2daab54160d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:01:14.827888 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827734    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49102547-4012-4160-a246-b2daab54160d" (UID: "49102547-4012-4160-a246-b2daab54160d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:01:14.828005 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827944    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49102547-4012-4160-a246-b2daab54160d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49102547-4012-4160-a246-b2daab54160d" (UID: "49102547-4012-4160-a246-b2daab54160d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:01:14.828005 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827969    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-certs\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:01:14.828005 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.827984    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-credential-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:01:14.828171 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.828143    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-data" (OuterVolumeSpecName: "istio-data") pod "49102547-4012-4160-a246-b2daab54160d" (UID: "49102547-4012-4160-a246-b2daab54160d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:01:14.828249 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.828219    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49102547-4012-4160-a246-b2daab54160d" (UID: "49102547-4012-4160-a246-b2daab54160d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:01:14.830111 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.830083    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49102547-4012-4160-a246-b2daab54160d" (UID: "49102547-4012-4160-a246-b2daab54160d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:01:14.830223 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.830104    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49102547-4012-4160-a246-b2daab54160d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49102547-4012-4160-a246-b2daab54160d" (UID: "49102547-4012-4160-a246-b2daab54160d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 13:01:14.830223 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.830164    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-istio-token" (OuterVolumeSpecName: "istio-token") pod "49102547-4012-4160-a246-b2daab54160d" (UID: "49102547-4012-4160-a246-b2daab54160d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:01:14.830223 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.830182    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-kube-api-access-4w6j6" (OuterVolumeSpecName: "kube-api-access-4w6j6") pod "49102547-4012-4160-a246-b2daab54160d" (UID: "49102547-4012-4160-a246-b2daab54160d"). InnerVolumeSpecName "kube-api-access-4w6j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:01:14.929474 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.929440    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49102547-4012-4160-a246-b2daab54160d-istio-podinfo\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:01:14.929474 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.929467    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-istio-token\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:01:14.929474 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.929476    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49102547-4012-4160-a246-b2daab54160d-istiod-ca-cert\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:01:14.929474 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.929484    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-workload-socket\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:01:14.929753 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.929491    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-envoy\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:01:14.929753 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.929500    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w6j6\" (UniqueName: \"kubernetes.io/projected/49102547-4012-4160-a246-b2daab54160d-kube-api-access-4w6j6\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:01:14.929753 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:14.929534    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49102547-4012-4160-a246-b2daab54160d-istio-data\") on node \"ip-10-0-142-29.ec2.internal\" DevicePath \"\""
Jul 15 13:01:15.349879 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.349840    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69bf4cdfcb-n6xvq_a4bdee59-0a0f-4bd3-be7f-19327a553db4/manager/0.log"
Jul 15 13:01:15.464255 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.464226    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5qhb5_67a12d95-032a-4ae6-a8a0-0c5c98047c2c/server/0.log"
Jul 15 13:01:15.575438 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.575406    2571 generic.go:356] "Generic (PLEG): container finished" podID="49102547-4012-4160-a246-b2daab54160d" containerID="d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db" exitCode=0
Jul 15 13:01:15.575634 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.575470    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"
Jul 15 13:01:15.575634 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.575491    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" event={"ID":"49102547-4012-4160-a246-b2daab54160d","Type":"ContainerDied","Data":"d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db"}
Jul 15 13:01:15.575634 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.575580    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp" event={"ID":"49102547-4012-4160-a246-b2daab54160d","Type":"ContainerDied","Data":"5791f1fc9c00f3236905f52d4b17209004e34edd6a66f6ce07ee89593cad3434"}
Jul 15 13:01:15.575634 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.575610    2571 scope.go:117] "RemoveContainer" containerID="d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db"
Jul 15 13:01:15.588683 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.588661    2571 scope.go:117] "RemoveContainer" containerID="403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16"
Jul 15 13:01:15.591882 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.591860    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tlmkb_e9977c25-0acd-4edc-b8e8-3b1f9fac789e/manager/0.log"
Jul 15 13:01:15.598712 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.598689    2571 scope.go:117] "RemoveContainer" containerID="d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db"
Jul 15 13:01:15.599036 ip-10-0-142-29 kubenswrapper[2571]: E0715 13:01:15.599014    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db\": container with ID starting with d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db not found: ID does not exist" containerID="d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db"
Jul 15 13:01:15.599136 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.599046    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db"} err="failed to get container status \"d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db\": rpc error: code = NotFound desc = could not find container \"d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db\": container with ID starting with d6b763cfce240d11255bbda68541af236a783134b7768bf1e419fc94a10723db not found: ID does not exist"
Jul 15 13:01:15.599136 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.599064    2571 scope.go:117] "RemoveContainer" containerID="403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16"
Jul 15 13:01:15.599403 ip-10-0-142-29 kubenswrapper[2571]: E0715 13:01:15.599380    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16\": container with ID starting with 403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16 not found: ID does not exist" containerID="403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16"
Jul 15 13:01:15.599477 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.599410    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16"} err="failed to get container status \"403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16\": rpc error: code = NotFound desc = could not find container \"403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16\": container with ID starting with 403e9b2ad578f0a49d738c5d2a65fe7f45ac9a1992d56ab63d4eeb5bb9ad8a16 not found: ID does not exist"
Jul 15 13:01:15.602408 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.602340    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"]
Jul 15 13:01:15.606354 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.606334    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-dc94b0-openshift-default-587c759c79-2gkgp"]
Jul 15 13:01:15.628145 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.628103    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49102547-4012-4160-a246-b2daab54160d" path="/var/lib/kubelet/pods/49102547-4012-4160-a246-b2daab54160d/volumes"
Jul 15 13:01:15.713835 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.713805    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d97db8bc-bz7z6_71a101ef-6051-408e-8357-0e85bb124e55/copy-manifests/0.log"
Jul 15 13:01:15.721960 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:15.721937    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d97db8bc-bz7z6_71a101ef-6051-408e-8357-0e85bb124e55/manager/0.log"
Jul 15 13:01:16.199599 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:16.199574    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 13:01:16.208471 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:16.208451    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 13:01:16.342937 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:16.342907    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-b5c6f84b7-z9gbz_c106af1a-ef6f-4663-8ee5-2dcef5a0fe65/maas-api/0.log"
Jul 15 13:01:16.450076 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:16.450000    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735310-rrhl7_17f17948-26df-493d-ac27-5aa77015fea2/cleanup/0.log"
Jul 15 13:01:16.575652 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:16.575617    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735325-fg7nc_0ef95bbb-59f2-450f-9a84-1b1056057e7c/cleanup/0.log"
Jul 15 13:01:17.020970 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:17.020943    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-20d2f8-4zlmz_3dcc8a33-a197-4965-bdaa-438c63cea778/revoke-keys/0.log"
Jul 15 13:01:17.132133 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:17.132102    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-44c6c5-rl6tf_71e23f8b-408c-47f3-8865-44fed33d18ed/revoke-keys/0.log"
Jul 15 13:01:17.244721 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:17.244692    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-34aa8850-pndm7_4c406175-4fd8-4deb-91be-bfce791aac2f/revoke-keys/0.log"
Jul 15 13:01:17.354192 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:17.354159    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-99c883-2vwl8_c0a5fc72-7471-4365-8ac1-ea353f97ae4b/revoke-keys/0.log"
Jul 15 13:01:17.466449 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:17.466419    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-0eb9b9-72xhs_53d10874-fd14-4480-9ab7-de855fb97afb/revoke-keys/0.log"
Jul 15 13:01:17.585120 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:17.585088    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-af71886a-fq4v2_1e639dd2-9d68-491e-85f0-f90562be3e6b/revoke-keys/0.log"
Jul 15 13:01:17.693201 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:17.693119    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-c7c0f6bf-hwdpm_f18a6155-c376-4a95-befb-8edeaa548112/revoke-keys/0.log"
Jul 15 13:01:17.805933 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:17.805900    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-e1773daa-fnz5b_a29e049c-14c6-4d2e-bcc7-2a98aef4b745/revoke-keys/0.log"
Jul 15 13:01:17.915917 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:17.915886    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-e6c75d-6kjbv_32bc53aa-cc61-41c7-af11-80b3a7c48c31/revoke-keys/0.log"
Jul 15 13:01:18.032388 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:18.032273    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-dc94b0-57pv7_ae3b963a-a82f-485b-98c3-b22e49e6ba1e/revoke-keys/0.log"
Jul 15 13:01:18.929111 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:18.929079    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk_334a4515-0dd7-4a16-81ef-c286536a5a5d/util/0.log"
Jul 15 13:01:18.936150 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:18.936126    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk_334a4515-0dd7-4a16-81ef-c286536a5a5d/pull/0.log"
Jul 15 13:01:18.943180 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:18.943157    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk_334a4515-0dd7-4a16-81ef-c286536a5a5d/extract/0.log"
Jul 15 13:01:19.062213 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.062176    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn_2fc9c788-7342-4cb5-9e4e-99e03dc98918/pull/0.log"
Jul 15 13:01:19.069355 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.069332    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn_2fc9c788-7342-4cb5-9e4e-99e03dc98918/extract/0.log"
Jul 15 13:01:19.076282 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.076257    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn_2fc9c788-7342-4cb5-9e4e-99e03dc98918/util/0.log"
Jul 15 13:01:19.192539 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.192442    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7_310ca2e8-d740-47f6-a304-6ee2954a7e0f/util/0.log"
Jul 15 13:01:19.200739 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.200714    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7_310ca2e8-d740-47f6-a304-6ee2954a7e0f/pull/0.log"
Jul 15 13:01:19.207775 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.207752    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7_310ca2e8-d740-47f6-a304-6ee2954a7e0f/extract/0.log"
Jul 15 13:01:19.322555 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.322524    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5_be7cb190-74f2-4239-a3fc-591086fbe664/util/0.log"
Jul 15 13:01:19.329845 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.329818    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5_be7cb190-74f2-4239-a3fc-591086fbe664/pull/0.log"
Jul 15 13:01:19.337095 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.337070    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5_be7cb190-74f2-4239-a3fc-591086fbe664/extract/0.log"
Jul 15 13:01:19.695844 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.695813    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kbb8w_841fcb0b-ba47-44ef-aa77-0f569220a375/manager/0.log"
Jul 15 13:01:19.809115 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.809089    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x55x2_ed462f5d-c528-449b-b38c-eef5d438a0cb/kuadrant-console-plugin/0.log"
Jul 15 13:01:19.933576 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:19.933550    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zdtxv_8427db78-842c-4b64-8c03-e497654987d5/registry-server/0.log"
Jul 15 13:01:20.192236 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:20.192205    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gpz49_be2b26f3-d63a-4732-8740-17236a8b470a/limitador/0.log"
Jul 15 13:01:20.679492 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:20.679458    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf428fjz_d9d83a82-44ba-400e-a878-1ee710a699a7/istio-proxy/0.log"
Jul 15 13:01:21.151631 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:21.151596    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82jbx_66504273-8aab-423e-a6f8-4c6fa32729b1/istio-proxy/1.log"
Jul 15 13:01:21.278390 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:21.278361    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-2wfwq_a6cf7468-50a6-4164-aeae-e5bcb393adf6/payload-pre-processing/0.log"
Jul 15 13:01:21.514915 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:21.514836    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dcc798bb6-d4rll_5cb27ae7-f500-4917-92ac-b461e19ac839/router/0.log"
Jul 15 13:01:21.857871 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:21.857829    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pt9lc_48d920f3-f58f-4b63-b396-b2e786eea1a4/main/0.log"
Jul 15 13:01:26.070606 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.070567    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vl8nl/must-gather-52xj7"]
Jul 15 13:01:26.070985 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.070971    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy"
Jul 15 13:01:26.070985 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.070982    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy"
Jul 15 13:01:26.071061 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.071011    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3b963a-a82f-485b-98c3-b22e49e6ba1e" containerName="revoke-keys"
Jul 15 13:01:26.071061 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.071016    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3b963a-a82f-485b-98c3-b22e49e6ba1e" containerName="revoke-keys"
Jul 15 13:01:26.071125 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.071092    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy"
Jul 15 13:01:26.071125 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.071104    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3b963a-a82f-485b-98c3-b22e49e6ba1e" containerName="revoke-keys"
Jul 15 13:01:26.071189 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.071163    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy"
Jul 15 13:01:26.071189 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.071169    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy"
Jul 15 13:01:26.071251 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.071237    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="49102547-4012-4160-a246-b2daab54160d" containerName="istio-proxy"
Jul 15 13:01:26.074348 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.074332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vl8nl/must-gather-52xj7"
Jul 15 13:01:26.077479 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.077454    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vl8nl\"/\"openshift-service-ca.crt\""
Jul 15 13:01:26.079235 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.079215    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vl8nl\"/\"kube-root-ca.crt\""
Jul 15 13:01:26.079580 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.079461    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vl8nl\"/\"default-dockercfg-fdrbd\""
Jul 15 13:01:26.083401 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.083377    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vl8nl/must-gather-52xj7"]
Jul 15 13:01:26.239876 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.239842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6baa0c1-6b28-4761-91e9-f0fc775c90ca-must-gather-output\") pod \"must-gather-52xj7\" (UID: \"a6baa0c1-6b28-4761-91e9-f0fc775c90ca\") " pod="openshift-must-gather-vl8nl/must-gather-52xj7"
Jul 15 13:01:26.240065 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.239914    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rj68\" (UniqueName: \"kubernetes.io/projected/a6baa0c1-6b28-4761-91e9-f0fc775c90ca-kube-api-access-2rj68\") pod \"must-gather-52xj7\" (UID: \"a6baa0c1-6b28-4761-91e9-f0fc775c90ca\") " pod="openshift-must-gather-vl8nl/must-gather-52xj7"
Jul 15 13:01:26.341110 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.341011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6baa0c1-6b28-4761-91e9-f0fc775c90ca-must-gather-output\") pod \"must-gather-52xj7\" (UID: \"a6baa0c1-6b28-4761-91e9-f0fc775c90ca\") " pod="openshift-must-gather-vl8nl/must-gather-52xj7"
Jul 15 13:01:26.341110 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.341096    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rj68\" (UniqueName: \"kubernetes.io/projected/a6baa0c1-6b28-4761-91e9-f0fc775c90ca-kube-api-access-2rj68\") pod \"must-gather-52xj7\" (UID: \"a6baa0c1-6b28-4761-91e9-f0fc775c90ca\") " pod="openshift-must-gather-vl8nl/must-gather-52xj7"
Jul 15 13:01:26.341390 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.341369    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6baa0c1-6b28-4761-91e9-f0fc775c90ca-must-gather-output\") pod \"must-gather-52xj7\" (UID: \"a6baa0c1-6b28-4761-91e9-f0fc775c90ca\") " pod="openshift-must-gather-vl8nl/must-gather-52xj7"
Jul 15 13:01:26.349765 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.349741    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rj68\" (UniqueName: \"kubernetes.io/projected/a6baa0c1-6b28-4761-91e9-f0fc775c90ca-kube-api-access-2rj68\") pod \"must-gather-52xj7\" (UID: \"a6baa0c1-6b28-4761-91e9-f0fc775c90ca\") " pod="openshift-must-gather-vl8nl/must-gather-52xj7"
Jul 15 13:01:26.384961 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.384926    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vl8nl/must-gather-52xj7"
Jul 15 13:01:26.526209 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.526175    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vl8nl/must-gather-52xj7"]
Jul 15 13:01:26.527841 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:01:26.527815    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6baa0c1_6b28_4761_91e9_f0fc775c90ca.slice/crio-bbaa94ef312e0f33c4c9b7e319ba5e63e28f7308fe22194ecd0623fa20f005c2 WatchSource:0}: Error finding container bbaa94ef312e0f33c4c9b7e319ba5e63e28f7308fe22194ecd0623fa20f005c2: Status 404 returned error can't find the container with id bbaa94ef312e0f33c4c9b7e319ba5e63e28f7308fe22194ecd0623fa20f005c2
Jul 15 13:01:26.650089 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:26.650003    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vl8nl/must-gather-52xj7" event={"ID":"a6baa0c1-6b28-4761-91e9-f0fc775c90ca","Type":"ContainerStarted","Data":"bbaa94ef312e0f33c4c9b7e319ba5e63e28f7308fe22194ecd0623fa20f005c2"}
Jul 15 13:01:27.663418 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:27.663306    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vl8nl/must-gather-52xj7" event={"ID":"a6baa0c1-6b28-4761-91e9-f0fc775c90ca","Type":"ContainerStarted","Data":"9c99da2f066b21749f03397a3ac107a7e7eb843b2dcc22ca7f5645570a93bc84"}
Jul 15 13:01:27.663418 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:27.663365    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vl8nl/must-gather-52xj7" event={"ID":"a6baa0c1-6b28-4761-91e9-f0fc775c90ca","Type":"ContainerStarted","Data":"120cef55a6f32ee4952bc1bdcc0022247e8e0b9c8a84ec64fe9bee9c1d5252b3"}
Jul 15 13:01:27.682134 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:27.682066    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vl8nl/must-gather-52xj7" podStartSLOduration=0.880951119 podStartE2EDuration="1.682041632s" totalImagesPullingTime="801.090513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:01:27.680504668 +0000 UTC m=+3014.628533346" watchObservedRunningTime="2026-07-15 13:01:27.682041632 +0000 UTC m=+3014.630070285"
Jul 15 13:01:28.903787 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:28.903752    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vhf9x_d3a41138-421d-46e7-af35-7e0f94d4cadd/global-pull-secret-syncer/0.log"
Jul 15 13:01:29.024160 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:29.024125    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zbj2w_95a1c495-dbd0-4635-a0c7-1288e8404efa/konnectivity-agent/0.log"
Jul 15 13:01:29.092577 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:29.092537    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-29.ec2.internal_c7803b45d5dbe62303a41ccd8fb6f0b0/haproxy/0.log"
Jul 15 13:01:33.342211 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.342143    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk_334a4515-0dd7-4a16-81ef-c286536a5a5d/extract/0.log"
Jul 15 13:01:33.364055 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.364025    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk_334a4515-0dd7-4a16-81ef-c286536a5a5d/util/0.log"
Jul 15 13:01:33.384078 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.384036    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599gtpk_334a4515-0dd7-4a16-81ef-c286536a5a5d/pull/0.log"
Jul 15 13:01:33.414865 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.414834    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn_2fc9c788-7342-4cb5-9e4e-99e03dc98918/extract/0.log"
Jul 15 13:01:33.437350 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.437321    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn_2fc9c788-7342-4cb5-9e4e-99e03dc98918/util/0.log"
Jul 15 13:01:33.462765 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.462720    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08v9gn_2fc9c788-7342-4cb5-9e4e-99e03dc98918/pull/0.log"
Jul 15 13:01:33.492940 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.492888    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7_310ca2e8-d740-47f6-a304-6ee2954a7e0f/extract/0.log"
Jul 15 13:01:33.518928 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.518646    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7_310ca2e8-d740-47f6-a304-6ee2954a7e0f/util/0.log"
Jul 15 13:01:33.545860 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.545829    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfkg7_310ca2e8-d740-47f6-a304-6ee2954a7e0f/pull/0.log"
Jul 15 13:01:33.573629 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.573594    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5_be7cb190-74f2-4239-a3fc-591086fbe664/extract/0.log"
Jul 15 13:01:33.595564 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.595474    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5_be7cb190-74f2-4239-a3fc-591086fbe664/util/0.log"
Jul 15 13:01:33.619000 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.618973    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxwr5_be7cb190-74f2-4239-a3fc-591086fbe664/pull/0.log"
Jul 15 13:01:33.967479 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:33.967391    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kbb8w_841fcb0b-ba47-44ef-aa77-0f569220a375/manager/0.log"
Jul 15 13:01:34.007196 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:34.007089    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x55x2_ed462f5d-c528-449b-b38c-eef5d438a0cb/kuadrant-console-plugin/0.log"
Jul 15 13:01:34.046114 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:34.046067    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zdtxv_8427db78-842c-4b64-8c03-e497654987d5/registry-server/0.log"
Jul 15 13:01:34.183803 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:34.183776    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gpz49_be2b26f3-d63a-4732-8740-17236a8b470a/limitador/0.log"
Jul 15 13:01:36.084928 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.084903    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7351d82-6c0f-4687-b7ae-4a417757759e/alertmanager/0.log"
Jul 15 13:01:36.110154 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.110124    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7351d82-6c0f-4687-b7ae-4a417757759e/config-reloader/0.log"
Jul 15 13:01:36.137158 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.137117    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7351d82-6c0f-4687-b7ae-4a417757759e/kube-rbac-proxy-web/0.log"
Jul 15 13:01:36.159468 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.159439    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7351d82-6c0f-4687-b7ae-4a417757759e/kube-rbac-proxy/0.log"
Jul 15 13:01:36.186893 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.186862    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7351d82-6c0f-4687-b7ae-4a417757759e/kube-rbac-proxy-metric/0.log"
Jul 15 13:01:36.208897 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.208872    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7351d82-6c0f-4687-b7ae-4a417757759e/prom-label-proxy/0.log"
Jul 15 13:01:36.235106 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.235081    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7351d82-6c0f-4687-b7ae-4a417757759e/init-config-reloader/0.log"
Jul 15 13:01:36.298369 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.297873    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-kcm8z_1d6de926-a79c-49b2-a2d3-eb8cb1a33aee/cluster-monitoring-operator/0.log"
Jul 15 13:01:36.422085 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.421999    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-vqnqz_46696abf-324b-45be-b5fb-339fc3d6a155/monitoring-plugin/0.log"
Jul 15 13:01:36.614731 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.614633    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtw5s_01891276-45c8-42e0-a0fb-6d775da7b9c5/node-exporter/0.log"
Jul 15 13:01:36.636941 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.636909    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtw5s_01891276-45c8-42e0-a0fb-6d775da7b9c5/kube-rbac-proxy/0.log"
Jul 15 13:01:36.657330 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.657260    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtw5s_01891276-45c8-42e0-a0fb-6d775da7b9c5/init-textfile/0.log"
Jul 15 13:01:36.682687 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.682638    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-n8d6b_c0cda0b2-d65b-4616-9854-8a0500703b02/kube-rbac-proxy-main/0.log"
Jul 15 13:01:36.702778 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.702746    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-n8d6b_c0cda0b2-d65b-4616-9854-8a0500703b02/kube-rbac-proxy-self/0.log"
Jul 15 13:01:36.725278 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.725244    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-n8d6b_c0cda0b2-d65b-4616-9854-8a0500703b02/openshift-state-metrics/0.log"
Jul 15 13:01:36.958252 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:36.958170    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-gz4xc_431fbd53-e43c-41c7-8844-4e72f6dc0e43/prometheus-operator-admission-webhook/0.log"
Jul 15 13:01:37.072628 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:37.072552    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85f55bc854-khq54_91cfe13c-659c-4826-8fc3-4c4555266737/thanos-query/0.log"
Jul 15 13:01:37.092825 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:37.092795    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85f55bc854-khq54_91cfe13c-659c-4826-8fc3-4c4555266737/kube-rbac-proxy-web/0.log"
Jul 15 13:01:37.126641 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:37.126544    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85f55bc854-khq54_91cfe13c-659c-4826-8fc3-4c4555266737/kube-rbac-proxy/0.log"
Jul 15 13:01:37.146839 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:37.146813    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85f55bc854-khq54_91cfe13c-659c-4826-8fc3-4c4555266737/prom-label-proxy/0.log"
Jul 15 13:01:37.167815 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:37.167776    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85f55bc854-khq54_91cfe13c-659c-4826-8fc3-4c4555266737/kube-rbac-proxy-rules/0.log"
Jul 15 13:01:37.188863 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:37.188835    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85f55bc854-khq54_91cfe13c-659c-4826-8fc3-4c4555266737/kube-rbac-proxy-metrics/0.log"
Jul 15 13:01:39.335855 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.335805    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"]
Jul 15 13:01:39.343394 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.343362    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.349472 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.349431    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"]
Jul 15 13:01:39.392133 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.392073    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-lib-modules\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.392482 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.392434    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-podres\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.392722 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.392707    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-sys\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.392875 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.392862    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-proc\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.393044 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.393015    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d672f\" (UniqueName: \"kubernetes.io/projected/940e7d21-6d26-4c6b-a51e-99d42c8b5577-kube-api-access-d672f\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.493736 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.493703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-sys\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.493736 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.493751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-proc\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.494049 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.493794    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d672f\" (UniqueName: \"kubernetes.io/projected/940e7d21-6d26-4c6b-a51e-99d42c8b5577-kube-api-access-d672f\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.494049 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.493857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-lib-modules\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.494049 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.493869    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-sys\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.494049 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.493884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-podres\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.494049 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.493994    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-podres\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.494049 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.494002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-lib-modules\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.494409 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.494082    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/940e7d21-6d26-4c6b-a51e-99d42c8b5577-proc\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.502398 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.502371    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c98558dfd-mvrnw_d22d3775-edfe-46f0-aa57-547e4035ab1e/console/0.log"
Jul 15 13:01:39.502744 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.502715    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d672f\" (UniqueName: \"kubernetes.io/projected/940e7d21-6d26-4c6b-a51e-99d42c8b5577-kube-api-access-d672f\") pod \"perf-node-gather-daemonset-4h5qd\" (UID: \"940e7d21-6d26-4c6b-a51e-99d42c8b5577\") " pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.545269 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.545005    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-kxbc6_9e3a005b-f1ae-493f-b6f6-0bd4527f3049/download-server/0.log"
Jul 15 13:01:39.663413 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.663314    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:39.892736 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:39.892691    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"]
Jul 15 13:01:39.894459 ip-10-0-142-29 kubenswrapper[2571]: W0715 13:01:39.894423    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod940e7d21_6d26_4c6b_a51e_99d42c8b5577.slice/crio-cefb30334cfb324b9d5fade2578dc6670f973de6dfb9fcd32728eaf42cf661fc WatchSource:0}: Error finding container cefb30334cfb324b9d5fade2578dc6670f973de6dfb9fcd32728eaf42cf661fc: Status 404 returned error can't find the container with id cefb30334cfb324b9d5fade2578dc6670f973de6dfb9fcd32728eaf42cf661fc
Jul 15 13:01:40.214395 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:40.214310    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-p77zh_e46cdc29-7b58-49af-bb22-ef055801f13b/volume-data-source-validator/0.log"
Jul 15 13:01:40.797869 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:40.797821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd" event={"ID":"940e7d21-6d26-4c6b-a51e-99d42c8b5577","Type":"ContainerStarted","Data":"e5cb4ad7fd0871e7c5af320c09846ac348d84ed5d49209f8c6e0e5d820926642"}
Jul 15 13:01:40.798412 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:40.797895    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd" event={"ID":"940e7d21-6d26-4c6b-a51e-99d42c8b5577","Type":"ContainerStarted","Data":"cefb30334cfb324b9d5fade2578dc6670f973de6dfb9fcd32728eaf42cf661fc"}
Jul 15 13:01:40.798412 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:40.798108    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:40.818630 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:40.818566    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd" podStartSLOduration=1.818528189 podStartE2EDuration="1.818528189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:01:40.815476816 +0000 UTC m=+3027.763505467" watchObservedRunningTime="2026-07-15 13:01:40.818528189 +0000 UTC m=+3027.766556840"
Jul 15 13:01:41.265517 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:41.265426    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-drjhz_5ce3db41-5447-47d0-8e0f-d7099217a05d/dns/0.log"
Jul 15 13:01:41.298992 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:41.298965    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-drjhz_5ce3db41-5447-47d0-8e0f-d7099217a05d/kube-rbac-proxy/0.log"
Jul 15 13:01:41.439632 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:41.439603    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wjqkf_89fd816f-1fa1-4220-8e5e-903050d92a3a/dns-node-resolver/0.log"
Jul 15 13:01:42.003106 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:42.003072    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c5557588b-2bpln_aaa51f88-e736-4b9b-94b5-8a0fefac89f2/registry/0.log"
Jul 15 13:01:42.046901 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:42.046873    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dtgm7_f633254c-28aa-4625-ac26-df610d480c2d/node-ca/0.log"
Jul 15 13:01:42.954741 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:42.954693    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf428fjz_d9d83a82-44ba-400e-a878-1ee710a699a7/istio-proxy/0.log"
Jul 15 13:01:43.139974 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:43.139940    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82jbx_66504273-8aab-423e-a6f8-4c6fa32729b1/istio-proxy/0.log"
Jul 15 13:01:43.194167 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:43.194135    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82jbx_66504273-8aab-423e-a6f8-4c6fa32729b1/istio-proxy/1.log"
Jul 15 13:01:43.230138 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:43.230053    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-2wfwq_a6cf7468-50a6-4164-aeae-e5bcb393adf6/payload-pre-processing/0.log"
Jul 15 13:01:43.278118 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:43.278090    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dcc798bb6-d4rll_5cb27ae7-f500-4917-92ac-b461e19ac839/router/0.log"
Jul 15 13:01:43.965198 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:43.965122    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rcnn5_96860b42-9d6f-4fd9-bd9d-b4bbc700b972/serve-healthcheck-canary/0.log"
Jul 15 13:01:44.556732 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:44.556700    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwmg5_6583841b-e7ea-4114-be05-b93ac21160e5/kube-rbac-proxy/0.log"
Jul 15 13:01:44.578852 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:44.578816    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwmg5_6583841b-e7ea-4114-be05-b93ac21160e5/exporter/0.log"
Jul 15 13:01:44.600984 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:44.600955    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwmg5_6583841b-e7ea-4114-be05-b93ac21160e5/extractor/0.log"
Jul 15 13:01:46.829864 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:46.829837    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vl8nl/perf-node-gather-daemonset-4h5qd"
Jul 15 13:01:46.948228 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:46.948191    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69bf4cdfcb-n6xvq_a4bdee59-0a0f-4bd3-be7f-19327a553db4/manager/0.log"
Jul 15 13:01:46.966692 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:46.966650    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5qhb5_67a12d95-032a-4ae6-a8a0-0c5c98047c2c/server/0.log"
Jul 15 13:01:47.073575 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:47.073534    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tlmkb_e9977c25-0acd-4edc-b8e8-3b1f9fac789e/manager/0.log"
Jul 15 13:01:47.098459 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:47.098381    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d97db8bc-bz7z6_71a101ef-6051-408e-8357-0e85bb124e55/manager/0.log"
Jul 15 13:01:47.117123 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:47.117093    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d97db8bc-bz7z6_71a101ef-6051-408e-8357-0e85bb124e55/copy-manifests/0.log"
Jul 15 13:01:48.569593 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:48.569566    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-786df675f-rbtxx_775f3bd1-7205-4193-be5c-5922ae8ff6c8/manager/0.log"
Jul 15 13:01:48.595075 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:48.595041    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tqjxg_30b38ee4-e21b-4c49-b1a2-f3ac2357ab61/openshift-lws-operator/0.log"
Jul 15 13:01:49.744259 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:49.744176    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf428fjz_d9d83a82-44ba-400e-a878-1ee710a699a7/istio-proxy/0.log"
Jul 15 13:01:49.906227 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:49.906201    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82jbx_66504273-8aab-423e-a6f8-4c6fa32729b1/istio-proxy/0.log"
Jul 15 13:01:49.970447 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:49.970416    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82jbx_66504273-8aab-423e-a6f8-4c6fa32729b1/istio-proxy/1.log"
Jul 15 13:01:49.998760 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:49.998644    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-2wfwq_a6cf7468-50a6-4164-aeae-e5bcb393adf6/payload-pre-processing/0.log"
Jul 15 13:01:50.033655 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:50.033622    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dcc798bb6-d4rll_5cb27ae7-f500-4917-92ac-b461e19ac839/router/0.log"
Jul 15 13:01:51.260800 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:51.260769    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf428fjz_d9d83a82-44ba-400e-a878-1ee710a699a7/istio-proxy/0.log"
Jul 15 13:01:51.413032 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:51.412994    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82jbx_66504273-8aab-423e-a6f8-4c6fa32729b1/istio-proxy/0.log"
Jul 15 13:01:51.472791 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:51.472702    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-82jbx_66504273-8aab-423e-a6f8-4c6fa32729b1/istio-proxy/1.log"
Jul 15 13:01:51.500069 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:51.500022    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-2wfwq_a6cf7468-50a6-4164-aeae-e5bcb393adf6/payload-pre-processing/0.log"
Jul 15 13:01:51.535342 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:51.535308    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dcc798bb6-d4rll_5cb27ae7-f500-4917-92ac-b461e19ac839/router/0.log"
Jul 15 13:01:55.113233 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.113172    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6754g_9592893f-442b-47fa-862f-d9c2bfa30ead/kube-multus/0.log"
Jul 15 13:01:55.457888 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.457811    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swsmv_c6acb4c6-9cd8-4239-a879-1a12f83f1c9e/kube-multus-additional-cni-plugins/0.log"
Jul 15 13:01:55.476217 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.476185    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swsmv_c6acb4c6-9cd8-4239-a879-1a12f83f1c9e/egress-router-binary-copy/0.log"
Jul 15 13:01:55.494227 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.494201    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swsmv_c6acb4c6-9cd8-4239-a879-1a12f83f1c9e/cni-plugins/0.log"
Jul 15 13:01:55.513591 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.513565    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swsmv_c6acb4c6-9cd8-4239-a879-1a12f83f1c9e/bond-cni-plugin/0.log"
Jul 15 13:01:55.532481 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.532448    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swsmv_c6acb4c6-9cd8-4239-a879-1a12f83f1c9e/routeoverride-cni/0.log"
Jul 15 13:01:55.551920 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.551874    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swsmv_c6acb4c6-9cd8-4239-a879-1a12f83f1c9e/whereabouts-cni-bincopy/0.log"
Jul 15 13:01:55.570916 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.570892    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swsmv_c6acb4c6-9cd8-4239-a879-1a12f83f1c9e/whereabouts-cni/0.log"
Jul 15 13:01:55.622909 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.622876    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-54zrq_8d48e773-ec60-489a-84f1-8f816afd365e/network-metrics-daemon/0.log"
Jul 15 13:01:55.638641 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:55.638606    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-54zrq_8d48e773-ec60-489a-84f1-8f816afd365e/kube-rbac-proxy/0.log"
Jul 15 13:01:56.702662 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:56.702619    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-controller/0.log"
Jul 15 13:01:56.719062 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:56.719020    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/0.log"
Jul 15 13:01:56.719062 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:56.719057    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovn-acl-logging/1.log"
Jul 15 13:01:56.742800 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:56.742774    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/kube-rbac-proxy-node/0.log"
Jul 15 13:01:56.766338 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:56.766244    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/kube-rbac-proxy-ovn-metrics/0.log"
Jul 15 13:01:56.782873 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:56.782843    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/northd/0.log"
Jul 15 13:01:56.802982 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:56.802949    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/nbdb/0.log"
Jul 15 13:01:56.822170 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:56.822142    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/sbdb/0.log"
Jul 15 13:01:56.917970 ip-10-0-142-29 kubenswrapper[2571]: I0715 13:01:56.917920    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lpdrc_99f66112-4275-47b6-9e54-d1b2b0f0a575/ovnkube-controller/0.log"