Jul 15 19:13:22.145594 ip-10-0-134-72 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 19:13:22.145606 ip-10-0-134-72 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 19:13:22.145613 ip-10-0-134-72 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 19:13:22.145880 ip-10-0-134-72 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 19:13:32.336131 ip-10-0-134-72 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 19:13:32.336148 ip-10-0-134-72 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a9bb9e52a3e24fad8466521800492533 --
Jul 15 19:15:06.759212 ip-10-0-134-72 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.216867    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223170    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223180    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223183    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223186    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223192    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223196    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:15:07.254401 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223199    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223203    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223207    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223210    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223213    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223215    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223218    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223220    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223223    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223226    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223234    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223237    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223239    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223242    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223245    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223247    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223250    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223252    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223254    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:15:07.517575 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223257    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223260    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223263    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223266    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223268    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223271    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223275    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223277    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223279    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223282    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223285    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223288    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223291    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223294    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223296    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223299    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223302    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223304    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223306    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223308    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:15:07.535400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223311    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:15:07.293444 ip-10-0-134-72 systemd[1]: Started Kubernetes Kubelet.
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223313    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223316    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223318    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223321    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223323    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223326    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223328    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223331    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223333    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223336    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223339    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223342    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223351    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223354    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223356    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223359    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223362    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223364    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:15:07.539511 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223367    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223371    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223374    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223377    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223379    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223382    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223384    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223387    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223390    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223392    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223395    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223398    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223401    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223404    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223406    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223409    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223411    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223414    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223416    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223419    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:15:07.542843 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223421    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223424    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223426    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223429    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223431    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223434    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223436    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223439    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223441    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223443    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223446    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223448    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223451    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223454    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.223457    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224138    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224145    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224148    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224151    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224153    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:15:07.545281 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224157    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224159    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224162    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224164    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224167    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224170    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224172    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224175    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224177    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224180    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224184    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224188    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224191    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224193    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224196    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224199    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224201    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224204    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224206    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224209    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:15:07.547426 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224212    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224214    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224218    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224223    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224227    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224230    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224233    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224235    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224238    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224241    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224244    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224247    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224250    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224253    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224256    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224259    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224261    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224264    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224266    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224269    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:15:07.548410 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224271    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224274    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224276    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224278    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224282    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224284    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224287    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224289    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224292    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224294    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224296    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224299    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224302    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224304    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224310    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224313    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224315    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224318    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224320    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224323    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:15:07.549486 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224325    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224328    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224330    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224333    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224336    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224340    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224343    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224346    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224349    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224351    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224354    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224357    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224360    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224362    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224365    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224367    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224369    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224372    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224374    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:15:07.550050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224377    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224379    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224382    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224384    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224387    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224390    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224392    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224396    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224398    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224401    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224403    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224405    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224408    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224411    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224413    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224782    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224787    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224790    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224794    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:15:07.550643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224797    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224799    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224802    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224804    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224807    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224811    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224814    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224816    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224819    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224822    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224824    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224827    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224829    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224832    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224834    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224837    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224839    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224842    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224844    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224846    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:15:07.551191 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224850    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224853    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224856    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224858    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224860    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224863    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224865    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224867    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224870    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224872    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224876    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224879    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224882    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224886    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224888    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224891    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224893    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224897    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224900    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:15:07.551790 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224902    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224906    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224909    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224912    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224916    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224919    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224921    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224924    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224927    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224929    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224932    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224934    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224936    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224940    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224943    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224945    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224947    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224950    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224952    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224955    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:15:07.552351 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224957    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224960    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224962    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224964    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224967    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224969    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224972    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224974    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224976    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224979    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224985    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224987    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224990    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224992    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224995    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224997    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.224999    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225002    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225004    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:15:07.553042 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225008    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225011    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225014    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225020    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225022    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225025    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225029    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225032    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225035    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225037    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225040    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225043    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225046    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225048    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225051    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225053    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225056    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225144    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225152    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225163    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225167    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 19:15:07.553604 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225179    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225183    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225188    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225192    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225195    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225198    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225202    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225205    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225208    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225211    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225214    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225217    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225220    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225222    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225228    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225231    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225234    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225238    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225241    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225245    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225248    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225251    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225254    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225256    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 19:15:07.554257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225259    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225262    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225265    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225268    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225272    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225275    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225277    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225280    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225283    2562 flags.go:64] FLAG: --enable-server="true"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225291    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225299    2562 flags.go:64] FLAG: --event-burst="100"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225302    2562 flags.go:64] FLAG: --event-qps="50"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225305    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225308    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225311    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225314    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225317    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225320    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225323    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225325    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225328    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225331    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225334    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225336    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225339    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 19:15:07.554857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225343    2562 flags.go:64] FLAG: --feature-gates=""
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225347    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225350    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225352    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225355    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225358    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225361    2562 flags.go:64] FLAG: --help="false"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225364    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-134-72.ec2.internal"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225366    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225369    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225372    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225375    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225378    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225381    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225384    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225387    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225390    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225395    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225398    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225401    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225404    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225406    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225409    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225412    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 19:15:07.555674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225415    2562 flags.go:64] FLAG: --lock-file=""
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225417    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225420    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225423    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225428    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225430    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225433    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225436    2562 flags.go:64] FLAG: --logging-format="text"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225440    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225443    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225446    2562 flags.go:64] FLAG: --manifest-url=""
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225448    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225452    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225455    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225459    2562 flags.go:64] FLAG: --max-pods="110"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225461    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225464    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225467    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225470    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225473    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225475    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225478    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225484    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225487    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225490    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 19:15:07.556308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225494    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225497    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225502    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225505    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225508    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225511    2562 flags.go:64] FLAG: --port="10250"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225514    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225517    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dcfc48f1c607f0df"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225520    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225522    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225525    2562 flags.go:64] FLAG: --register-node="true"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225528    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225531    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225534    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225536    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225539    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225544    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225547    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225550    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225552    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225555    2562 flags.go:64] FLAG: --runonce="false"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225558    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225561    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225564    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225566    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 19:15:07.557042 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225569    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225572    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225575    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225578    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225580    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225583    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225586    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225590    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225593    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225596    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225599    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225604    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225606    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225609    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225615    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225618    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225620    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225623    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225626    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225628    2562 flags.go:64] FLAG: --v="2"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225632    2562 flags.go:64] FLAG: --version="false"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225636    2562 flags.go:64] FLAG: --vmodule=""
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225639    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.225643    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225760    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:15:07.558049 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225764    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225767    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225770    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225773    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225776    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225778    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225781    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225783    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225786    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225788    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225791    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225793    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225795    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225798    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225803    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225806    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225808    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225814    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225817    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225819    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:15:07.558766 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225822    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225825    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225827    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225829    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225832    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225835    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225837    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225840    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225842    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225844    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225849    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225851    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225854    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225856    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225858    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225861    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225864    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225866    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225869    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225871    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:15:07.849002 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225874    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225876    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225879    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225881    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225884    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225887    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225890    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225892    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225895    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225897    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225906    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225909    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225911    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225914    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225916    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225918    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225922    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225925    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225928    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225930    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:15:07.849842 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225933    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225935    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225941    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225944    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225947    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225950    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225953    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225957    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225960    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225963    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225966    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225968    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225971    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225973    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225976    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225978    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225980    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225983    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225986    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:15:07.850438 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225989    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225991    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225994    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.225996    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226004    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226007    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226009    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226012    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226014    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226017    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226019    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226022    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226024    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226026    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226029    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226032    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226035    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226037    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:15:07.850950 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.226040    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.226767    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.233274    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.233291    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.234144    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.234152    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234213    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234218    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234221    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234224    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234226    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234229    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234232    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234234    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234237    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:15:07.851441 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234239    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234242    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234245    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234248    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234250    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234253    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234255    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234258    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234260    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234263    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234265    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234268    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234270    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234274    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234278    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234281    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234283    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234286    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234288    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:15:07.851875 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234291    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234299    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234303    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234307    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234310    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234312    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234315    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234318    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234322    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234325    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234328    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234330    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234333    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234335    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234338    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234340    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234343    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234346    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234348    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234350    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:15:07.852364 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234353    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234355    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234358    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234360    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234363    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234366    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234368    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234370    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234373    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234375    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234378    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234380    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234383    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234385    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234392    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234395    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234398    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234401    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234403    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234406    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:15:07.852908 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234410    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234412    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234415    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234417    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234419    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234422    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234425    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234427    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234430    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234432    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234435    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234439    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234442    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234445    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234447    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234450    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234453    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234455    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234458    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:15:07.853435 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234460    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234462    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234465    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234467    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234470    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234472    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234474    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234477    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234484    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234487    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234489    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234492    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.234497    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234638    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234642    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:15:07.853940 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234646    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234648    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234651    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234654    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234657    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234659    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234662    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234664    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234666    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234669    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234671    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234675    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234679    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234682    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234685    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234688    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234692    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234695    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234698    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:15:07.854359 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234700    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234703    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234705    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234711    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234713    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234715    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234718    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234725    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234728    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234731    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234733    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234737    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234739    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234742    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234744    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234747    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234749    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234752    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234754    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234757    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:15:07.854866 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234759    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234762    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234764    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234768    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234771    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234773    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234776    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234779    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234782    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234785    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234787    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234790    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234792    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234794    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234797    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234800    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234802    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234805    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234807    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:15:07.855396 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234810    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234817    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234820    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234822    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234826    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234828    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234831    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234833    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234836    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234838    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234841    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234843    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234846    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234848    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234851    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234853    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234855    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234858    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234860    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234863    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:15:07.855906 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234865    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234873    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234876    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234878    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234881    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234883    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234885    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234888    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234892    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234894    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234896    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234899    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234902    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234904    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234912    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234915    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234919    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234922    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:15:07.856454 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:07.234924    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.234929    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.235041    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.238324    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.239968    2562 server.go:1019] "Starting client certificate rotation"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.240077    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.240120    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.245679    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.246710    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.254817    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.257208    2562 log.go:25] "Validated CRI v1 image API"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.258016    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 19:15:07.856950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.265151    2562 fs.go:135] Filesystem UUIDs: map[469953a5-df34-4a69-81be-1e9dad77212e:/dev/nvme0n1p4 529927c0-1a71-4b4f-a8c5-0f3c66976101:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 15 19:15:07.857290 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.265166    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 19:15:07.857385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.270464    2562 manager.go:216] Machine: {Timestamp:2026-07-15 19:15:07.269989387 +0000 UTC m=+0.373365596 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200738 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fcb98cd4272220dce4e2e6471d7ce SystemUUID:ec2fcb98-cd42-7222-0dce-4e2e6471d7ce BootID:a9bb9e52-a3e2-4fad-8466-521800492533 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fa:f5:b5:40:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fa:f5:b5:40:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:9b:39:dd:88:b9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 19:15:07.857385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.270556    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 19:15:07.857385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.270613    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 19:15:07.857385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.271525    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:15:07.857385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.271771    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 19:15:07.857385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.271796    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-72.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 19:15:07.857385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.272620    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.272629    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.272637    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.272650    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.274697    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.279826    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.279938    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.279963    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.279978    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.279993    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.280002    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.280010    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.280349    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.280374    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.282798    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.287831    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.287866    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288000    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288011    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288017    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288028    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288036    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288042    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288724    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288736    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288748    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288757    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288769    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.288781    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.289730    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.289747    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.292829    2562 server.go:1268] "Started kubelet"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.292875    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.292960    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.293019    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.293504    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-72.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.293540    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.293537    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.294485    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 19:15:07.857627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.294489    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.299300    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.298964    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-72.ec2.internal.18c28c8579b6cff6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-72.ec2.internal,UID:ip-10-0-134-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-72.ec2.internal,},FirstTimestamp:2026-07-15 19:15:07.292700662 +0000 UTC m=+0.396076872,LastTimestamp:2026-07-15 19:15:07.292700662 +0000 UTC m=+0.396076872,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-72.ec2.internal,}"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.302442    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.302462    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.302516    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303250    2562 factory.go:55] Registering systemd factory
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303264    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303251    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303288    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303316    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303418    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303424    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303516    2562 factory.go:153] Registering CRI-O factory
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303528    2562 factory.go:223] Registration of the crio container factory successfully
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303578    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303599    2562 factory.go:103] Registering Raw factory
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.303614    2562 manager.go:1196] Started watching for new ooms in manager
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.303704    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.303813    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.304015    2562 manager.go:349] Starting recovery of all containers
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.311405    2562 manager.go:354] Recovery completed
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.316409    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.318064    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.318105    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.318118    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.318597    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.318604    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.318607    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.318667    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.319270    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.319292    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.319300    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:15:07.858681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.320747    2562 policy_none.go:49] "None policy: Start"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.320759    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.320769    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.322645    2562 policy_none.go:47] "Start"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.331747    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pj4jb"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.332135    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-72.ec2.internal.18c28c857b3a08ca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-72.ec2.internal,UID:ip-10-0-134-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-72.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-72.ec2.internal,},FirstTimestamp:2026-07-15 19:15:07.318077642 +0000 UTC m=+0.421453858,LastTimestamp:2026-07-15 19:15:07.318077642 +0000 UTC m=+0.421453858,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-72.ec2.internal,}"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.340691    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pj4jb"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.343240    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-72.ec2.internal.18c28c857b3a8d59  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-72.ec2.internal,UID:ip-10-0-134-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-72.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-72.ec2.internal,},FirstTimestamp:2026-07-15 19:15:07.318111577 +0000 UTC m=+0.421487787,LastTimestamp:2026-07-15 19:15:07.318111577 +0000 UTC m=+0.421487787,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-72.ec2.internal,}"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.388592    2562 manager.go:337] "Starting Device Plugin manager"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.388627    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.388639    2562 server.go:87] "Starting device plugin registration server"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.388845    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.388856    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.388954    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.389034    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.389052    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.389419    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.389463    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.450993    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.452076    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.452126    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.452146    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.452182    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.454881    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.489042    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.489773    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.489797    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:15:07.859828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.489812    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.489834    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-72.ec2.internal"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.505194    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-72.ec2.internal"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.505209    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-72.ec2.internal\": node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.525358    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.552443    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal"]
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.553196    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.553862    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.553891    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.553905    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.556147    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.556259    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.556285    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.556766    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.556787    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.556795    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.556767    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.556859    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.556868    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.558910    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.558929    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.559518    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.559538    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.559550    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.579651    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-72.ec2.internal\" not found" node="ip-10-0-134-72.ec2.internal"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.583388    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-72.ec2.internal\" not found" node="ip-10-0-134-72.ec2.internal"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.625514    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.705254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4810317c3b46cabd3c74cf3c88f41f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal\" (UID: \"e4810317c3b46cabd3c74cf3c88f41f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:07.860568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.705286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4810317c3b46cabd3c74cf3c88f41f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal\" (UID: \"e4810317c3b46cabd3c74cf3c88f41f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.705302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/223fad97d4fefa131d98c624d5275eb6-config\") pod \"kube-apiserver-proxy-ip-10-0-134-72.ec2.internal\" (UID: \"223fad97d4fefa131d98c624d5275eb6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.726349    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.805946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/223fad97d4fefa131d98c624d5275eb6-config\") pod \"kube-apiserver-proxy-ip-10-0-134-72.ec2.internal\" (UID: \"223fad97d4fefa131d98c624d5275eb6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.805971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4810317c3b46cabd3c74cf3c88f41f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal\" (UID: \"e4810317c3b46cabd3c74cf3c88f41f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.806032    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/223fad97d4fefa131d98c624d5275eb6-config\") pod \"kube-apiserver-proxy-ip-10-0-134-72.ec2.internal\" (UID: \"223fad97d4fefa131d98c624d5275eb6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.806042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4810317c3b46cabd3c74cf3c88f41f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal\" (UID: \"e4810317c3b46cabd3c74cf3c88f41f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.806015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4810317c3b46cabd3c74cf3c88f41f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal\" (UID: \"e4810317c3b46cabd3c74cf3c88f41f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.806066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4810317c3b46cabd3c74cf3c88f41f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal\" (UID: \"e4810317c3b46cabd3c74cf3c88f41f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.827048    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.881195    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:07.886791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:07.930015    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:08.030513    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:08.170314 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:08.131060    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:09.577925 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:08.231979    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:09.577925 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:08.238934    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 19:15:09.577925 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:08.239017    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 19:15:09.577925 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:08.332664    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:09.577925 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:08.344746    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 19:10:08 +0000 UTC" deadline="2028-04-23 13:27:43.592994072 +0000 UTC"
Jul 15 19:15:09.577925 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:08.344769    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15546h12m35.248227074s"
Jul 15 19:15:09.577925 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:08.350415    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:15:09.577925 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:09.538111    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-72.ec2.internal\" not found"
Jul 15 19:15:09.896811 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:09.594440    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:15:09.896811 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:09.608722    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:09.896811 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:09.620740    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:15:09.896811 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:09.621989    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal"
Jul 15 19:15:09.896811 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:09.627695    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4810317c3b46cabd3c74cf3c88f41f4.slice/crio-9b9f8f4a8099145ab101b958de83d9e03bc2947178989cce74ad966e30ba9b20 WatchSource:0}: Error finding container 9b9f8f4a8099145ab101b958de83d9e03bc2947178989cce74ad966e30ba9b20: Status 404 returned error can't find the container with id 9b9f8f4a8099145ab101b958de83d9e03bc2947178989cce74ad966e30ba9b20
Jul 15 19:15:09.896811 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:09.630705    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:15:09.896811 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:09.631935    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:15:10.204011 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:09.986691    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.386282    2562 apiserver.go:52] "Watching apiserver"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.395174    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.395576    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-tjhzf","kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal","openshift-image-registry/node-ca-jndfh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal","openshift-multus/multus-additional-cni-plugins-vz4lq","openshift-network-operator/iptables-alerter-xcwrh","kube-system/global-pull-secret-syncer-5k58n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m","openshift-cluster-node-tuning-operator/tuned-87kgw","openshift-dns/node-resolver-v7qfz","openshift-multus/multus-gqzxf","openshift-multus/network-metrics-daemon-4z6xs","openshift-network-diagnostics/network-check-target-ghnzc","openshift-ovn-kubernetes/ovnkube-node-dphc6"]
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.398012    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.400222    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.400320    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.400369    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.400704    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ptc52\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.400718    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.402353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.404638    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.404708    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.404789    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sb9tm\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.404911    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.405072    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.407088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.408795    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409011    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409018    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409088    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409173    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409011    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409515    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409589    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kj4zw\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409618    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409660    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 19:15:10.490103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409742    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.409871    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p5gk7\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.410260    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.410305    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.412069    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.412468    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.412481    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h57sb\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.412674    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.412693    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.414219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.414272    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.414401    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.414448    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jm2fs\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.414558    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.417272    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.417402    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qshw\" (UniqueName: \"kubernetes.io/projected/d16352e0-3e66-42a0-bdd1-0ae248e2a454-kube-api-access-9qshw\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52fd42a8-1494-43e0-8693-9c73114574c5-hosts-file\") pod \"node-resolver-v7qfz\" (UID: \"52fd42a8-1494-43e0-8693-9c73114574c5\") " pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxc2\" (UniqueName: \"kubernetes.io/projected/795aeb1d-df26-44c4-ad4c-412575e35202-kube-api-access-hpxc2\") pod \"node-ca-jndfh\" (UID: \"795aeb1d-df26-44c4-ad4c-412575e35202\") " pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-var-lib-openvswitch\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.491684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-env-overrides\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-cnibin\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-run-ovn-kubernetes\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-system-cni-dir\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-node-log\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-cni-netd\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-ovn-node-metrics-cert\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d16352e0-3e66-42a0-bdd1-0ae248e2a454-cni-binary-copy\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/795aeb1d-df26-44c4-ad4c-412575e35202-serviceca\") pod \"node-ca-jndfh\" (UID: \"795aeb1d-df26-44c4-ad4c-412575e35202\") " pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-os-release\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d16352e0-3e66-42a0-bdd1-0ae248e2a454-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:10.492575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-systemd-units\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-run-netns\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62n6w\" (UniqueName: \"kubernetes.io/projected/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-kube-api-access-62n6w\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.419990    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/25a24a13-6f85-4c50-ba51-2752c5f800f8-iptables-alerter-script\") pod \"iptables-alerter-xcwrh\" (UID: \"25a24a13-6f85-4c50-ba51-2752c5f800f8\") " pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-kubelet\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-slash\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-run-ovn\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-log-socket\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-ovnkube-script-lib\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420110    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4lhz\" (UniqueName: \"kubernetes.io/projected/52fd42a8-1494-43e0-8693-9c73114574c5-kube-api-access-t4lhz\") pod \"node-resolver-v7qfz\" (UID: \"52fd42a8-1494-43e0-8693-9c73114574c5\") " pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/795aeb1d-df26-44c4-ad4c-412575e35202-host\") pod \"node-ca-jndfh\" (UID: \"795aeb1d-df26-44c4-ad4c-412575e35202\") " pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-run-systemd\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-etc-openvswitch\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.688183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-ovnkube-config\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25a24a13-6f85-4c50-ba51-2752c5f800f8-host-slash\") pod \"iptables-alerter-xcwrh\" (UID: \"25a24a13-6f85-4c50-ba51-2752c5f800f8\") " pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pntq\" (UniqueName: \"kubernetes.io/projected/25a24a13-6f85-4c50-ba51-2752c5f800f8-kube-api-access-7pntq\") pod \"iptables-alerter-xcwrh\" (UID: \"25a24a13-6f85-4c50-ba51-2752c5f800f8\") " pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52fd42a8-1494-43e0-8693-9c73114574c5-tmp-dir\") pod \"node-resolver-v7qfz\" (UID: \"52fd42a8-1494-43e0-8693-9c73114574c5\") " pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-run-openvswitch\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-cni-bin\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.420257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d16352e0-3e66-42a0-bdd1-0ae248e2a454-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.421597    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.421729    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.421885    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wgck6\""
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.422724    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.425197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.427618    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.427618    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.427667    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.427812    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.427819    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.427878    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ncmhl\""
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.427927    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.428088    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j4zxk\""
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.445877    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tqbdz"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.454541    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tqbdz"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.509750    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 19:15:10.689425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-kubelet\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-slash\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-log-socket\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523734    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523749    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-sysconfig\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-lib-modules\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-socket-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-slash\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-registration-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523807    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-kubelet\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4lhz\" (UniqueName: \"kubernetes.io/projected/52fd42a8-1494-43e0-8693-9c73114574c5-kube-api-access-t4lhz\") pod \"node-resolver-v7qfz\" (UID: \"52fd42a8-1494-43e0-8693-9c73114574c5\") " pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523846    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-log-socket\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/795aeb1d-df26-44c4-ad4c-412575e35202-host\") pod \"node-ca-jndfh\" (UID: \"795aeb1d-df26-44c4-ad4c-412575e35202\") " pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.523975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-run-systemd\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.690484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/795aeb1d-df26-44c4-ad4c-412575e35202-host\") pod \"node-ca-jndfh\" (UID: \"795aeb1d-df26-44c4-ad4c-412575e35202\") " pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-etc-openvswitch\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25a24a13-6f85-4c50-ba51-2752c5f800f8-host-slash\") pod \"iptables-alerter-xcwrh\" (UID: \"25a24a13-6f85-4c50-ba51-2752c5f800f8\") " pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-run-systemd\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-sysctl-conf\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524083    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-etc-openvswitch\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-run-netns\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25a24a13-6f85-4c50-ba51-2752c5f800f8-host-slash\") pod \"iptables-alerter-xcwrh\" (UID: \"25a24a13-6f85-4c50-ba51-2752c5f800f8\") " pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-cni-bin\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d16352e0-3e66-42a0-bdd1-0ae248e2a454-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-cni-bin\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-sysctl-d\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5h7v\" (UniqueName: \"kubernetes.io/projected/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-kube-api-access-f5h7v\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-conf-dir\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.691172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-device-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wlzf\" (UniqueName: \"kubernetes.io/projected/f8214401-20cc-4d8c-ba6f-7319a81b249b-kube-api-access-7wlzf\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-var-lib-openvswitch\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524835    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-var-lib-openvswitch\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524896    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-env-overrides\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-run-ovn-kubernetes\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-system-cni-dir\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.524995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-sys\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525029    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-var-lib-kubelet\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-node-log\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-cni-netd\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-ovn-node-metrics-cert\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-var-lib-cni-multus\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.691830 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525168    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d16352e0-3e66-42a0-bdd1-0ae248e2a454-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-os-release\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-node-log\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-cni-netd\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525344    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-env-overrides\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525419    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-run-ovn-kubernetes\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525441    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-os-release\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525457    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-system-cni-dir\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62n6w\" (UniqueName: \"kubernetes.io/projected/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-kube-api-access-62n6w\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525584    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-tuned\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-run-k8s-cni-cncf-io\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-run-ovn\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-ovnkube-script-lib\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.692503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/938e07d9-46e2-43c5-b069-c0181a9e71a6-agent-certs\") pod \"konnectivity-agent-tjhzf\" (UID: \"938e07d9-46e2-43c5-b069-c0181a9e71a6\") " pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-var-lib-cni-bin\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-daemon-config\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-etc-kubernetes\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-ovnkube-config\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pntq\" (UniqueName: \"kubernetes.io/projected/25a24a13-6f85-4c50-ba51-2752c5f800f8-kube-api-access-7pntq\") pod \"iptables-alerter-xcwrh\" (UID: \"25a24a13-6f85-4c50-ba51-2752c5f800f8\") " pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.525974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-host\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526094    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-tmp\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-system-cni-dir\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-run\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52fd42a8-1494-43e0-8693-9c73114574c5-tmp-dir\") pod \"node-resolver-v7qfz\" (UID: \"52fd42a8-1494-43e0-8693-9c73114574c5\") " pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-run-openvswitch\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qshw\" (UniqueName: \"kubernetes.io/projected/d16352e0-3e66-42a0-bdd1-0ae248e2a454-kube-api-access-9qshw\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52fd42a8-1494-43e0-8693-9c73114574c5-hosts-file\") pod \"node-resolver-v7qfz\" (UID: \"52fd42a8-1494-43e0-8693-9c73114574c5\") " pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.693272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-ovnkube-script-lib\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxc2\" (UniqueName: \"kubernetes.io/projected/795aeb1d-df26-44c4-ad4c-412575e35202-kube-api-access-hpxc2\") pod \"node-ca-jndfh\" (UID: \"795aeb1d-df26-44c4-ad4c-412575e35202\") " pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-run-ovn\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-cnibin\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc231b65-f3b6-4d93-86f3-127b91e5003b-kubelet-config\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/938e07d9-46e2-43c5-b069-c0181a9e71a6-konnectivity-ca\") pod \"konnectivity-agent-tjhzf\" (UID: \"938e07d9-46e2-43c5-b069-c0181a9e71a6\") " pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-kubernetes\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526594    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-os-release\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-cni-binary-copy\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52fd42a8-1494-43e0-8693-9c73114574c5-tmp-dir\") pod \"node-resolver-v7qfz\" (UID: \"52fd42a8-1494-43e0-8693-9c73114574c5\") " pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-ovnkube-config\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526730    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-run-openvswitch\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-cnibin\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.693897 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-modprobe-d\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526826    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52fd42a8-1494-43e0-8693-9c73114574c5-hosts-file\") pod \"node-resolver-v7qfz\" (UID: \"52fd42a8-1494-43e0-8693-9c73114574c5\") " pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.526986    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-var-lib-kubelet\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527217    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-cnibin\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-socket-dir-parent\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-hostroot\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-run-multus-certs\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527336    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d16352e0-3e66-42a0-bdd1-0ae248e2a454-cni-binary-copy\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whfqb\" (UniqueName: \"kubernetes.io/projected/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-kube-api-access-whfqb\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/795aeb1d-df26-44c4-ad4c-412575e35202-serviceca\") pod \"node-ca-jndfh\" (UID: \"795aeb1d-df26-44c4-ad4c-412575e35202\") " pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d16352e0-3e66-42a0-bdd1-0ae248e2a454-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-cni-dir\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.694464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-sys-fs\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-systemd-units\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-run-netns\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/25a24a13-6f85-4c50-ba51-2752c5f800f8-iptables-alerter-script\") pod \"iptables-alerter-xcwrh\" (UID: \"25a24a13-6f85-4c50-ba51-2752c5f800f8\") " pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc231b65-f3b6-4d93-86f3-127b91e5003b-dbus\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527843    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d16352e0-3e66-42a0-bdd1-0ae248e2a454-cni-binary-copy\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r5j9\" (UniqueName: \"kubernetes.io/projected/5e447e5a-2320-465c-a36f-98877669e84f-kube-api-access-8r5j9\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.527905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-systemd\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.528225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-host-run-netns\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.528278    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-systemd-units\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.528326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d16352e0-3e66-42a0-bdd1-0ae248e2a454-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.528378    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/795aeb1d-df26-44c4-ad4c-412575e35202-serviceca\") pod \"node-ca-jndfh\" (UID: \"795aeb1d-df26-44c4-ad4c-412575e35202\") " pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.695059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.528813    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d16352e0-3e66-42a0-bdd1-0ae248e2a454-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.529586    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/25a24a13-6f85-4c50-ba51-2752c5f800f8-iptables-alerter-script\") pod \"iptables-alerter-xcwrh\" (UID: \"25a24a13-6f85-4c50-ba51-2752c5f800f8\") " pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.529725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-ovn-node-metrics-cert\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.533180    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.533190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4lhz\" (UniqueName: \"kubernetes.io/projected/52fd42a8-1494-43e0-8693-9c73114574c5-kube-api-access-t4lhz\") pod \"node-resolver-v7qfz\" (UID: \"52fd42a8-1494-43e0-8693-9c73114574c5\") " pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.533202    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.533216    2562 projected.go:196] Error preparing data for projected volume kube-api-access-w6222 for pod openshift-network-diagnostics/network-check-target-ghnzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.533293    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222 podName:b191c7e0-dd57-4466-a903-2da9967e06bb nodeName:}" failed. No retries permitted until 2026-07-15 19:15:11.033272241 +0000 UTC m=+3.031250606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w6222" (UniqueName: "kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222") pod "network-check-target-ghnzc" (UID: "b191c7e0-dd57-4466-a903-2da9967e06bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.534342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pntq\" (UniqueName: \"kubernetes.io/projected/25a24a13-6f85-4c50-ba51-2752c5f800f8-kube-api-access-7pntq\") pod \"iptables-alerter-xcwrh\" (UID: \"25a24a13-6f85-4c50-ba51-2752c5f800f8\") " pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.535317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62n6w\" (UniqueName: \"kubernetes.io/projected/8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57-kube-api-access-62n6w\") pod \"ovnkube-node-dphc6\" (UID: \"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57\") " pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.535575    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qshw\" (UniqueName: \"kubernetes.io/projected/d16352e0-3e66-42a0-bdd1-0ae248e2a454-kube-api-access-9qshw\") pod \"multus-additional-cni-plugins-vz4lq\" (UID: \"d16352e0-3e66-42a0-bdd1-0ae248e2a454\") " pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.535996    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpxc2\" (UniqueName: \"kubernetes.io/projected/795aeb1d-df26-44c4-ad4c-412575e35202-kube-api-access-hpxc2\") pod \"node-ca-jndfh\" (UID: \"795aeb1d-df26-44c4-ad4c-412575e35202\") " pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.561558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal" event={"ID":"e4810317c3b46cabd3c74cf3c88f41f4","Type":"ContainerStarted","Data":"9b9f8f4a8099145ab101b958de83d9e03bc2947178989cce74ad966e30ba9b20"}
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-sysctl-d\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.695582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5h7v\" (UniqueName: \"kubernetes.io/projected/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-kube-api-access-f5h7v\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-conf-dir\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-device-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628859    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-device-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wlzf\" (UniqueName: \"kubernetes.io/projected/f8214401-20cc-4d8c-ba6f-7319a81b249b-kube-api-access-7wlzf\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-conf-dir\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-sys\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-var-lib-kubelet\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-sysctl-d\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.628995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-var-lib-cni-multus\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-var-lib-cni-multus\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-var-lib-kubelet\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.696117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-sys\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-tuned\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629109    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-run-k8s-cni-cncf-io\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/938e07d9-46e2-43c5-b069-c0181a9e71a6-agent-certs\") pod \"konnectivity-agent-tjhzf\" (UID: \"938e07d9-46e2-43c5-b069-c0181a9e71a6\") " pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-var-lib-cni-bin\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629194    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-var-lib-cni-bin\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629192    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-run-k8s-cni-cncf-io\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-daemon-config\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-etc-kubernetes\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629344    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-host\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-tmp\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-etc-kubernetes\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-system-cni-dir\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-host\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.696653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-run\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc231b65-f3b6-4d93-86f3-127b91e5003b-kubelet-config\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/938e07d9-46e2-43c5-b069-c0181a9e71a6-konnectivity-ca\") pod \"konnectivity-agent-tjhzf\" (UID: \"938e07d9-46e2-43c5-b069-c0181a9e71a6\") " pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-kubernetes\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629553    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-run\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-os-release\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-cni-binary-copy\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-system-cni-dir\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-modprobe-d\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-var-lib-kubelet\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-kubernetes\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-cnibin\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-socket-dir-parent\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629688    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc231b65-f3b6-4d93-86f3-127b91e5003b-kubelet-config\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-hostroot\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-run-multus-certs\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whfqb\" (UniqueName: \"kubernetes.io/projected/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-kube-api-access-whfqb\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629785    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-modprobe-d\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-cni-dir\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629844    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-os-release\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-sys-fs\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-daemon-config\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc231b65-f3b6-4d93-86f3-127b91e5003b-dbus\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r5j9\" (UniqueName: \"kubernetes.io/projected/5e447e5a-2320-465c-a36f-98877669e84f-kube-api-access-8r5j9\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-systemd\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.629990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-sysconfig\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630025    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc231b65-f3b6-4d93-86f3-127b91e5003b-dbus\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-lib-modules\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.697869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-socket-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630079    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-var-lib-kubelet\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-registration-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-sysctl-conf\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-cnibin\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-run-netns\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630163    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/938e07d9-46e2-43c5-b069-c0181a9e71a6-konnectivity-ca\") pod \"konnectivity-agent-tjhzf\" (UID: \"938e07d9-46e2-43c5-b069-c0181a9e71a6\") " pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-socket-dir-parent\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630240    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-hostroot\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630246    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-cni-binary-copy\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.630264    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-socket-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.630321    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret podName:bc231b65-f3b6-4d93-86f3-127b91e5003b nodeName:}" failed. No retries permitted until 2026-07-15 19:15:11.130303783 +0000 UTC m=+3.128282136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret") pod "global-pull-secret-syncer-5k58n" (UID: "bc231b65-f3b6-4d93-86f3-127b91e5003b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-lib-modules\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630362    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-run-multus-certs\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.698459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-sys-fs\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.630385    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630408    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-sysconfig\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:10.630427    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs podName:5e447e5a-2320-465c-a36f-98877669e84f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:11.130412253 +0000 UTC m=+3.128390623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs") pod "network-metrics-daemon-4z6xs" (UID: "5e447e5a-2320-465c-a36f-98877669e84f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-systemd\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-multus-cni-dir\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-host-run-netns\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-sysctl-conf\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.630615    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8214401-20cc-4d8c-ba6f-7319a81b249b-registration-dir\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.631473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-etc-tuned\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.632335    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-tmp\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.632429    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/938e07d9-46e2-43c5-b069-c0181a9e71a6-agent-certs\") pod \"konnectivity-agent-tjhzf\" (UID: \"938e07d9-46e2-43c5-b069-c0181a9e71a6\") " pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.642715    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5h7v\" (UniqueName: \"kubernetes.io/projected/eec8209b-8f5c-4054-8ed6-a5a539e2fc48-kube-api-access-f5h7v\") pod \"tuned-87kgw\" (UID: \"eec8209b-8f5c-4054-8ed6-a5a539e2fc48\") " pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.643090    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r5j9\" (UniqueName: \"kubernetes.io/projected/5e447e5a-2320-465c-a36f-98877669e84f-kube-api-access-8r5j9\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:10.699049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.643225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wlzf\" (UniqueName: \"kubernetes.io/projected/f8214401-20cc-4d8c-ba6f-7319a81b249b-kube-api-access-7wlzf\") pod \"aws-ebs-csi-driver-node-m6r4m\" (UID: \"f8214401-20cc-4d8c-ba6f-7319a81b249b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.699606 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.643450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whfqb\" (UniqueName: \"kubernetes.io/projected/3b445ec8-3bfb-4e95-a9a1-e35e3500b489-kube-api-access-whfqb\") pod \"multus-gqzxf\" (UID: \"3b445ec8-3bfb-4e95-a9a1-e35e3500b489\") " pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.709024    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v7qfz"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.719561    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jndfh"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.726208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.734034    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vz4lq"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.739698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcwrh"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.747298    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87kgw"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.755006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.764323    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqzxf"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:10.772515    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m"
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:10.786446    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a24a13_6f85_4c50_ba51_2752c5f800f8.slice/crio-6446bea7295607001ce969ff16beb99a598ca51ddd3f4f0bd4a1780908ca54a3 WatchSource:0}: Error finding container 6446bea7295607001ce969ff16beb99a598ca51ddd3f4f0bd4a1780908ca54a3: Status 404 returned error can't find the container with id 6446bea7295607001ce969ff16beb99a598ca51ddd3f4f0bd4a1780908ca54a3
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:10.787680    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795aeb1d_df26_44c4_ad4c_412575e35202.slice/crio-87dbf9e6a74240fcdc0eb425450ad6c368f4e5c99b70fe8043d5acb33189f576 WatchSource:0}: Error finding container 87dbf9e6a74240fcdc0eb425450ad6c368f4e5c99b70fe8043d5acb33189f576: Status 404 returned error can't find the container with id 87dbf9e6a74240fcdc0eb425450ad6c368f4e5c99b70fe8043d5acb33189f576
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:10.791082    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be7a5a6_f751_4ccb_a4ca_8cf3f0d95d57.slice/crio-cf4f0e6efaeab393d9e78d8f281a937e8dbbe019834e98115bac0231a085de96 WatchSource:0}: Error finding container cf4f0e6efaeab393d9e78d8f281a937e8dbbe019834e98115bac0231a085de96: Status 404 returned error can't find the container with id cf4f0e6efaeab393d9e78d8f281a937e8dbbe019834e98115bac0231a085de96
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:10.792584    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fd42a8_1494_43e0_8693_9c73114574c5.slice/crio-d81501a4accae907fe8f1d060df2a09d6ccdab2d6efc52a96248ef49a85c15fa WatchSource:0}: Error finding container d81501a4accae907fe8f1d060df2a09d6ccdab2d6efc52a96248ef49a85c15fa: Status 404 returned error can't find the container with id d81501a4accae907fe8f1d060df2a09d6ccdab2d6efc52a96248ef49a85c15fa
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:10.815279    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod938e07d9_46e2_43c5_b069_c0181a9e71a6.slice/crio-ec53f6536d19ccb26335ea30ca935827eeaba1c868f33a3fbc16cf5a76221af1 WatchSource:0}: Error finding container ec53f6536d19ccb26335ea30ca935827eeaba1c868f33a3fbc16cf5a76221af1: Status 404 returned error can't find the container with id ec53f6536d19ccb26335ea30ca935827eeaba1c868f33a3fbc16cf5a76221af1
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:10.815898    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b445ec8_3bfb_4e95_a9a1_e35e3500b489.slice/crio-bb79de1815c045cbce51673dab036d546f9c426c9e34a64a3a839c3de0d57807 WatchSource:0}: Error finding container bb79de1815c045cbce51673dab036d546f9c426c9e34a64a3a839c3de0d57807: Status 404 returned error can't find the container with id bb79de1815c045cbce51673dab036d546f9c426c9e34a64a3a839c3de0d57807
Jul 15 19:15:10.964404 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:10.817187    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8214401_20cc_4d8c_ba6f_7319a81b249b.slice/crio-11c352d7f23053a74e6dd800595ac79b1f26e30e3db13ce8b244fa22ba2d320c WatchSource:0}: Error finding container 11c352d7f23053a74e6dd800595ac79b1f26e30e3db13ce8b244fa22ba2d320c: Status 404 returned error can't find the container with id 11c352d7f23053a74e6dd800595ac79b1f26e30e3db13ce8b244fa22ba2d320c
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.033575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.033699    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.033712    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.033719    2562 projected.go:196] Error preparing data for projected volume kube-api-access-w6222 for pod openshift-network-diagnostics/network-check-target-ghnzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.033764    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222 podName:b191c7e0-dd57-4466-a903-2da9967e06bb nodeName:}" failed. No retries permitted until 2026-07-15 19:15:12.033751016 +0000 UTC m=+4.031729380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6222" (UniqueName: "kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222") pod "network-check-target-ghnzc" (UID: "b191c7e0-dd57-4466-a903-2da9967e06bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:11.125196    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223fad97d4fefa131d98c624d5275eb6.slice/crio-17f9f312dd37a87458936f73010736a19a624263d9c7de8bf91322ca7d818d25 WatchSource:0}: Error finding container 17f9f312dd37a87458936f73010736a19a624263d9c7de8bf91322ca7d818d25: Status 404 returned error can't find the container with id 17f9f312dd37a87458936f73010736a19a624263d9c7de8bf91322ca7d818d25
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.134029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.134064    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.134156    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.134194    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret podName:bc231b65-f3b6-4d93-86f3-127b91e5003b nodeName:}" failed. No retries permitted until 2026-07-15 19:15:12.134183605 +0000 UTC m=+4.132161956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret") pod "global-pull-secret-syncer-5k58n" (UID: "bc231b65-f3b6-4d93-86f3-127b91e5003b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.134156    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:11.220022 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.134273    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs podName:5e447e5a-2320-465c-a36f-98877669e84f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:12.13426032 +0000 UTC m=+4.132238686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs") pod "network-metrics-daemon-4z6xs" (UID: "5e447e5a-2320-465c-a36f-98877669e84f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:11.458275 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.457559    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:10:10 +0000 UTC" deadline="2028-04-24 10:46:31.385498842 +0000 UTC"
Jul 15 19:15:11.458275 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.457608    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15567h31m19.927895263s"
Jul 15 19:15:11.572163 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.558028    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:11.572163 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.558153    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:11.572163 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.558521    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:11.572163 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:11.558614    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:11.572163 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.566041    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vz4lq" event={"ID":"d16352e0-3e66-42a0-bdd1-0ae248e2a454","Type":"ContainerStarted","Data":"0b8dfcca00631b866303f582d76eca2d7c6ff18725c2f0fae3f6d596c216b212"}
Jul 15 19:15:11.572163 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.568896    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87kgw" event={"ID":"eec8209b-8f5c-4054-8ed6-a5a539e2fc48","Type":"ContainerStarted","Data":"e2aacb31effe728282d3544add7c496ee0e835416bdc6306be08ecae6c96802d"}
Jul 15 19:15:11.573818 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.573441    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jndfh" event={"ID":"795aeb1d-df26-44c4-ad4c-412575e35202","Type":"ContainerStarted","Data":"87dbf9e6a74240fcdc0eb425450ad6c368f4e5c99b70fe8043d5acb33189f576"}
Jul 15 19:15:11.686611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.576182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcwrh" event={"ID":"25a24a13-6f85-4c50-ba51-2752c5f800f8","Type":"ContainerStarted","Data":"6446bea7295607001ce969ff16beb99a598ca51ddd3f4f0bd4a1780908ca54a3"}
Jul 15 19:15:11.686611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.588205    2562 generic.go:356] "Generic (PLEG): container finished" podID="e4810317c3b46cabd3c74cf3c88f41f4" containerID="1578545d91d6a03d0c3066ee3a21d5422a6925749c209abaac22a975f1c9b03e" exitCode=0
Jul 15 19:15:11.686611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.588273    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal" event={"ID":"e4810317c3b46cabd3c74cf3c88f41f4","Type":"ContainerDied","Data":"1578545d91d6a03d0c3066ee3a21d5422a6925749c209abaac22a975f1c9b03e"}
Jul 15 19:15:11.686611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.594062    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m" event={"ID":"f8214401-20cc-4d8c-ba6f-7319a81b249b","Type":"ContainerStarted","Data":"11c352d7f23053a74e6dd800595ac79b1f26e30e3db13ce8b244fa22ba2d320c"}
Jul 15 19:15:11.686611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.610436    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqzxf" event={"ID":"3b445ec8-3bfb-4e95-a9a1-e35e3500b489","Type":"ContainerStarted","Data":"bb79de1815c045cbce51673dab036d546f9c426c9e34a64a3a839c3de0d57807"}
Jul 15 19:15:11.686611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.613465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tjhzf" event={"ID":"938e07d9-46e2-43c5-b069-c0181a9e71a6","Type":"ContainerStarted","Data":"ec53f6536d19ccb26335ea30ca935827eeaba1c868f33a3fbc16cf5a76221af1"}
Jul 15 19:15:11.686611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.615605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v7qfz" event={"ID":"52fd42a8-1494-43e0-8693-9c73114574c5","Type":"ContainerStarted","Data":"d81501a4accae907fe8f1d060df2a09d6ccdab2d6efc52a96248ef49a85c15fa"}
Jul 15 19:15:11.686611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.621933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerStarted","Data":"cf4f0e6efaeab393d9e78d8f281a937e8dbbe019834e98115bac0231a085de96"}
Jul 15 19:15:11.686611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:11.639834    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal" event={"ID":"223fad97d4fefa131d98c624d5275eb6","Type":"ContainerStarted","Data":"17f9f312dd37a87458936f73010736a19a624263d9c7de8bf91322ca7d818d25"}
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:12.041332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:12.041547    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:12.041569    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:12.041583    2562 projected.go:196] Error preparing data for projected volume kube-api-access-w6222 for pod openshift-network-diagnostics/network-check-target-ghnzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:12.041634    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222 podName:b191c7e0-dd57-4466-a903-2da9967e06bb nodeName:}" failed. No retries permitted until 2026-07-15 19:15:14.041617919 +0000 UTC m=+6.039596286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6222" (UniqueName: "kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222") pod "network-check-target-ghnzc" (UID: "b191c7e0-dd57-4466-a903-2da9967e06bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:12.142373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:12.142432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:12.142590    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:12.142647    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret podName:bc231b65-f3b6-4d93-86f3-127b91e5003b nodeName:}" failed. No retries permitted until 2026-07-15 19:15:14.142629218 +0000 UTC m=+6.140607586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret") pod "global-pull-secret-syncer-5k58n" (UID: "bc231b65-f3b6-4d93-86f3-127b91e5003b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:12.143028    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:12.164400 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:12.143076    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs podName:5e447e5a-2320-465c-a36f-98877669e84f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:14.143060105 +0000 UTC m=+6.141038462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs") pod "network-metrics-daemon-4z6xs" (UID: "5e447e5a-2320-465c-a36f-98877669e84f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:12.458120 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:12.458030    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:10:10 +0000 UTC" deadline="2028-02-14 10:33:36.408696828 +0000 UTC"
Jul 15 19:15:12.458120 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:12.458071    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13887h18m23.950629758s"
Jul 15 19:15:12.561122 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:12.560603    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:12.561122 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:12.560714    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:12.660763 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:12.660720    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal" event={"ID":"e4810317c3b46cabd3c74cf3c88f41f4","Type":"ContainerStarted","Data":"ca78668692ef963abd6bc0b5a5149ff1e67630f4a56549c21fe00ea2ef71b035"}
Jul 15 19:15:13.558531 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:13.558487    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:13.558981 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:13.558653    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:13.559039 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:13.559025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:13.559268 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:13.559119    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:14.055437 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:14.055366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:14.055588 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:14.055571    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:15:14.055648 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:14.055600    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:15:14.055648 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:14.055613    2562 projected.go:196] Error preparing data for projected volume kube-api-access-w6222 for pod openshift-network-diagnostics/network-check-target-ghnzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:14.055717 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:14.055668    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222 podName:b191c7e0-dd57-4466-a903-2da9967e06bb nodeName:}" failed. No retries permitted until 2026-07-15 19:15:18.055649251 +0000 UTC m=+10.053627621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6222" (UniqueName: "kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222") pod "network-check-target-ghnzc" (UID: "b191c7e0-dd57-4466-a903-2da9967e06bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:14.156056 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:14.156026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:14.156208 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:14.156100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:14.156266 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:14.156213    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:14.156325 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:14.156267    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs podName:5e447e5a-2320-465c-a36f-98877669e84f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:18.15624914 +0000 UTC m=+10.154227493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs") pod "network-metrics-daemon-4z6xs" (UID: "5e447e5a-2320-465c-a36f-98877669e84f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:14.156631 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:14.156614    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:14.156724 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:14.156652    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret podName:bc231b65-f3b6-4d93-86f3-127b91e5003b nodeName:}" failed. No retries permitted until 2026-07-15 19:15:18.15664145 +0000 UTC m=+10.154619814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret") pod "global-pull-secret-syncer-5k58n" (UID: "bc231b65-f3b6-4d93-86f3-127b91e5003b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:14.558118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:14.557866    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:14.558118 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:14.557992    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:15.558311 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:15.557848    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:15.558311 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:15.557981    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:15.558311 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:15.558120    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:15.558311 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:15.558208    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:16.558518 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:16.558420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:16.558935 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:16.558545    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:17.558017 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:17.557984    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:17.558191 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:17.558116    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:17.558479 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:17.558462    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:17.558621 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:17.558572    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:18.094169 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:18.093617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:18.094169 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:18.093777    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:15:18.094169 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:18.093795    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:15:18.094169 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:18.093805    2562 projected.go:196] Error preparing data for projected volume kube-api-access-w6222 for pod openshift-network-diagnostics/network-check-target-ghnzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:18.094169 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:18.093852    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222 podName:b191c7e0-dd57-4466-a903-2da9967e06bb nodeName:}" failed. No retries permitted until 2026-07-15 19:15:26.093838979 +0000 UTC m=+18.091817335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6222" (UniqueName: "kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222") pod "network-check-target-ghnzc" (UID: "b191c7e0-dd57-4466-a903-2da9967e06bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:18.194580 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:18.194538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:18.194750 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:18.194605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:18.194750 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:18.194736    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:18.194859 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:18.194809    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs podName:5e447e5a-2320-465c-a36f-98877669e84f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:26.194788255 +0000 UTC m=+18.192766611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs") pod "network-metrics-daemon-4z6xs" (UID: "5e447e5a-2320-465c-a36f-98877669e84f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:18.194859 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:18.194742    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:18.194957 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:18.194877    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret podName:bc231b65-f3b6-4d93-86f3-127b91e5003b nodeName:}" failed. No retries permitted until 2026-07-15 19:15:26.194859783 +0000 UTC m=+18.192838137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret") pod "global-pull-secret-syncer-5k58n" (UID: "bc231b65-f3b6-4d93-86f3-127b91e5003b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:18.559355 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:18.559275    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:18.559798 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:18.559380    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:19.558574 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:19.558547    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:19.558574 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:19.558570    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:19.558805 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:19.558658    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:19.558862 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:19.558788    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:20.560231 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:20.560206    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:20.560610 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:20.560316    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:21.557864 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:21.557834    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:21.558020 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:21.557964    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:21.558100 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:21.558028    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:21.558161 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:21.558139    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:22.560867 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:22.560838    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:22.561287 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:22.560946    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:23.558756 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:23.558721    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:23.558909 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:23.558736    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:23.558909 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:23.558845    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:23.559007 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:23.558923    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:24.558821 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:24.558783    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:24.559246 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:24.558910    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:25.557754 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:25.557728    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:25.557892 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:25.557772    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:25.557892 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:25.557858    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:25.557979 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:25.557949    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:26.158414 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:26.158379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:26.158813 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:26.158550    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:15:26.158813 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:26.158571    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:15:26.158813 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:26.158581    2562 projected.go:196] Error preparing data for projected volume kube-api-access-w6222 for pod openshift-network-diagnostics/network-check-target-ghnzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:26.158813 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:26.158632    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222 podName:b191c7e0-dd57-4466-a903-2da9967e06bb nodeName:}" failed. No retries permitted until 2026-07-15 19:15:42.158612332 +0000 UTC m=+34.156590683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6222" (UniqueName: "kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222") pod "network-check-target-ghnzc" (UID: "b191c7e0-dd57-4466-a903-2da9967e06bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:26.258940 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:26.258916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:26.259100 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:26.258983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:26.259100 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:26.259070    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:26.259198 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:26.259125    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret podName:bc231b65-f3b6-4d93-86f3-127b91e5003b nodeName:}" failed. No retries permitted until 2026-07-15 19:15:42.259109467 +0000 UTC m=+34.257087834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret") pod "global-pull-secret-syncer-5k58n" (UID: "bc231b65-f3b6-4d93-86f3-127b91e5003b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:26.259198 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:26.259073    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:26.259268 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:26.259235    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs podName:5e447e5a-2320-465c-a36f-98877669e84f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:42.259214073 +0000 UTC m=+34.257192441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs") pod "network-metrics-daemon-4z6xs" (UID: "5e447e5a-2320-465c-a36f-98877669e84f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:26.558033 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:26.557963    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:26.558171 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:26.558085    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:27.558613 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:27.558582    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:27.559059 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:27.558702    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:27.559059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:27.558755    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:27.559059 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:27.558847    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:28.558402 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:28.558367    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:28.558579 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:28.558457    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:29.558131 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:29.558104    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:29.558566 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:29.558205    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:29.558566 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:29.558260    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:29.558566 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:29.558351    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:30.558892 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.558469    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:30.559394 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:30.558946    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:30.696355 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.696322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal" event={"ID":"223fad97d4fefa131d98c624d5275eb6","Type":"ContainerStarted","Data":"ce58a541c159edc600b698df6c3607bfdbd509c9ea464aea7d04d4aba9688b06"}
Jul 15 19:15:30.697745 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.697724    2562 generic.go:356] "Generic (PLEG): container finished" podID="d16352e0-3e66-42a0-bdd1-0ae248e2a454" containerID="299408a755d995157ae933cd935b36bf24e9e264b33be0277694f419036bc775" exitCode=0
Jul 15 19:15:30.697842 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.697786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vz4lq" event={"ID":"d16352e0-3e66-42a0-bdd1-0ae248e2a454","Type":"ContainerDied","Data":"299408a755d995157ae933cd935b36bf24e9e264b33be0277694f419036bc775"}
Jul 15 19:15:30.699165 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.699143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87kgw" event={"ID":"eec8209b-8f5c-4054-8ed6-a5a539e2fc48","Type":"ContainerStarted","Data":"c917d3e0ce5562aa3802cc304e6a1bdb85a7bab1e771a2b751227244348f3444"}
Jul 15 19:15:30.700600 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.700579    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jndfh" event={"ID":"795aeb1d-df26-44c4-ad4c-412575e35202","Type":"ContainerStarted","Data":"10a947a77be8a15b2cbfcebe91da7669f029be0d1ae447a26b16ed7f420ffef5"}
Jul 15 19:15:30.701934 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.701916    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m" event={"ID":"f8214401-20cc-4d8c-ba6f-7319a81b249b","Type":"ContainerStarted","Data":"a9f8702c6d3550b847b0542b0d039a4f3fa6cf4a2807a3d4b2f1babf82b86475"}
Jul 15 19:15:30.703279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.703254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqzxf" event={"ID":"3b445ec8-3bfb-4e95-a9a1-e35e3500b489","Type":"ContainerStarted","Data":"0939426c275b9568e70aca20cfae144cc96ce043d6c12044ebd6befc19201c1e"}
Jul 15 19:15:30.704969 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.704950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tjhzf" event={"ID":"938e07d9-46e2-43c5-b069-c0181a9e71a6","Type":"ContainerStarted","Data":"acd0e405007035387429ea752e11c2715776bc2a4436cc9b036eaef4b1699dd8"}
Jul 15 19:15:30.706196 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.706173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v7qfz" event={"ID":"52fd42a8-1494-43e0-8693-9c73114574c5","Type":"ContainerStarted","Data":"5e18a711afce309113d7b8172eaca9ed2ccbdf387b9a49744e4ea6b7b32af828"}
Jul 15 19:15:30.708621 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.708605    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:15:30.708979 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.708960    2562 generic.go:356] "Generic (PLEG): container finished" podID="8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57" containerID="d85d537aa2fedf5703c79e7369ae4b880a3b432e95b12be38f5134561a307185" exitCode=1
Jul 15 19:15:30.709050 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.708990    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerStarted","Data":"e10ef1bd13c45c15ad975ec491eb1fc4da0b27fd6dd0b8c1bf17999d19ba8bc2"}
Jul 15 19:15:30.709050 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.709045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerStarted","Data":"5eacea4e834adbbeb7848bbaec4960c5e2eb97351e103312d9e3bd9b28b31321"}
Jul 15 19:15:30.709138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.709077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerStarted","Data":"69bac0cb64be9204b924f792711140f39c99ebcd8d6751e5cc19f502adbc05b6"}
Jul 15 19:15:30.709138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.709105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerStarted","Data":"741f34fe9c15dcb65f1171ed0f40e83bb2ea41f3ec360e96efca7ce9c0cefd33"}
Jul 15 19:15:30.709138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.709134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerDied","Data":"d85d537aa2fedf5703c79e7369ae4b880a3b432e95b12be38f5134561a307185"}
Jul 15 19:15:30.709231 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.709164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerStarted","Data":"340ee45f17d87915f4dcf35ec2c0f48fef33f4e35482bd21c0f2451f408b1093"}
Jul 15 19:15:30.711824 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.711790    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-72.ec2.internal" podStartSLOduration=21.711779573 podStartE2EDuration="21.711779573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:30.711357262 +0000 UTC m=+22.709335635" watchObservedRunningTime="2026-07-15 19:15:30.711779573 +0000 UTC m=+22.709757944"
Jul 15 19:15:30.711890 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.711873    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-72.ec2.internal" podStartSLOduration=21.71187001 podStartE2EDuration="21.71187001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:12.678116735 +0000 UTC m=+4.676095108" watchObservedRunningTime="2026-07-15 19:15:30.71187001 +0000 UTC m=+22.709848382"
Jul 15 19:15:30.726250 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.726220    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-87kgw" podStartSLOduration=3.770658446 podStartE2EDuration="22.726208187s" totalImagesPullingTime="18.955549741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:30.726170871 +0000 UTC m=+22.724149243" watchObservedRunningTime="2026-07-15 19:15:30.726208187 +0000 UTC m=+22.724186567"
Jul 15 19:15:30.741232 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.741197    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jndfh" podStartSLOduration=3.7548830779999998 podStartE2EDuration="22.741186162s" totalImagesPullingTime="18.986303084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:30.740808795 +0000 UTC m=+22.738787158" watchObservedRunningTime="2026-07-15 19:15:30.741186162 +0000 UTC m=+22.739164535"
Jul 15 19:15:30.789990 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.789958    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tjhzf" podStartSLOduration=3.830376398 podStartE2EDuration="22.789944015s" totalImagesPullingTime="18.959567617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:30.78978985 +0000 UTC m=+22.787768222" watchObservedRunningTime="2026-07-15 19:15:30.789944015 +0000 UTC m=+22.787922389"
Jul 15 19:15:30.821561 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.821508    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v7qfz" podStartSLOduration=3.853720835 podStartE2EDuration="22.821483914s" totalImagesPullingTime="18.967763079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:30.821443308 +0000 UTC m=+22.819421680" watchObservedRunningTime="2026-07-15 19:15:30.821483914 +0000 UTC m=+22.819462286"
Jul 15 19:15:30.821640 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:30.821559    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gqzxf" podStartSLOduration=3.809905601 podStartE2EDuration="22.821555043s" totalImagesPullingTime="19.011649442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:30.807794077 +0000 UTC m=+22.805772449" watchObservedRunningTime="2026-07-15 19:15:30.821555043 +0000 UTC m=+22.819533416"
Jul 15 19:15:31.558585 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:31.558557    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:31.558585 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:31.558580    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:31.558750 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:31.558671    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:31.558829 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:31.558804    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:31.629570 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:31.629551    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 19:15:31.713507 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:31.713460    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m" event={"ID":"f8214401-20cc-4d8c-ba6f-7319a81b249b","Type":"ContainerStarted","Data":"8b54670f88243b2acd727179eb4cab3cad4a3e7d2a2396b4d8bc635428ad74e7"}
Jul 15 19:15:31.715278 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:31.715249    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcwrh" event={"ID":"25a24a13-6f85-4c50-ba51-2752c5f800f8","Type":"ContainerStarted","Data":"fd6f1d164391f52997e9a650ab2f66536bdfa21c75bbd2da788ec65371217067"}
Jul 15 19:15:31.731297 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:31.731249    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xcwrh" podStartSLOduration=4.750025312 podStartE2EDuration="23.73123208s" totalImagesPullingTime="18.981206768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:31.730538455 +0000 UTC m=+23.728516849" watchObservedRunningTime="2026-07-15 19:15:31.73123208 +0000 UTC m=+23.729210454"
Jul 15 19:15:32.507381 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:32.507287    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T19:15:31.629566581Z","UUID":"29554513-571e-40df-a92d-3c8493a09dc4","Handler":null,"Name":"","Endpoint":""}
Jul 15 19:15:32.508948 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:32.508926    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 19:15:32.509056 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:32.508967    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 19:15:32.558257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:32.558231    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:32.558400 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:32.558350    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:32.649357 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:32.649329    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:32.649946 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:32.649926    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:32.717966 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:32.717939    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:32.718342 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:32.718324    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tjhzf"
Jul 15 19:15:33.558591 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:33.558326    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:33.558753 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:33.558366    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:33.558753 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:33.558663    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:33.558844 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:33.558776    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:33.722522 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:33.722474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m" event={"ID":"f8214401-20cc-4d8c-ba6f-7319a81b249b","Type":"ContainerStarted","Data":"03aa560a2c40f2fbc1cef8884a9391ddb24aedb1316bbdc7cf28fac630235fa5"}
Jul 15 19:15:33.725822 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:33.725806    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:15:33.726227 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:33.726209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerStarted","Data":"acdc414e6f1849ec805de504d606a1ddc51fbb698f38b3f16e0a35e7c5f0306a"}
Jul 15 19:15:34.557844 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:34.557817    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:34.558023 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:34.557927    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:35.558154 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.557941    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:35.558870 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.557954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:35.558870 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:35.558218    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:35.558870 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:35.558297    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:35.733844 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.733796    2562 generic.go:356] "Generic (PLEG): container finished" podID="d16352e0-3e66-42a0-bdd1-0ae248e2a454" containerID="46804f832133e0470b89e9ad3fbae08b8819bfe5c6a369e05ebe5dc85ed42997" exitCode=0
Jul 15 19:15:35.733989 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.733893    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vz4lq" event={"ID":"d16352e0-3e66-42a0-bdd1-0ae248e2a454","Type":"ContainerDied","Data":"46804f832133e0470b89e9ad3fbae08b8819bfe5c6a369e05ebe5dc85ed42997"}
Jul 15 19:15:35.738031 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.738013    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:15:35.738418 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.738388    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerStarted","Data":"7fb0d66fb2d2357545fa92f0726752e9affc1cd997072a52ebe92a228e054563"}
Jul 15 19:15:35.738864 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.738840    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:35.739011 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.738906    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:35.739011 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.738986    2562 scope.go:117] "RemoveContainer" containerID="d85d537aa2fedf5703c79e7369ae4b880a3b432e95b12be38f5134561a307185"
Jul 15 19:15:35.756437 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.756408    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:35.756769 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.756753    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:35.758190 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:35.758132    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6r4m" podStartSLOduration=4.89955407 podStartE2EDuration="26.758115167s" totalImagesPullingTime="21.858561097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:33.739291493 +0000 UTC m=+25.737269869" watchObservedRunningTime="2026-07-15 19:15:35.758115167 +0000 UTC m=+27.756093543"
Jul 15 19:15:36.558331 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.558302    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:36.558967 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:36.558436    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:36.744052 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.744031    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:15:36.744370 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.744348    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" event={"ID":"8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57","Type":"ContainerStarted","Data":"2ca695e7b6b68116a6638938c91cda10aa78e5e47059c384db1d6aa3a5490bc0"}
Jul 15 19:15:36.744456 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.744439    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 19:15:36.771865 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.771820    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6" podStartSLOduration=9.725568581 podStartE2EDuration="28.77180544s" totalImagesPullingTime="19.046236859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:36.769774096 +0000 UTC m=+28.767752470" watchObservedRunningTime="2026-07-15 19:15:36.77180544 +0000 UTC m=+28.769783813"
Jul 15 19:15:36.909179 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.909155    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5k58n"]
Jul 15 19:15:36.909270 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.909261    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:36.909382 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:36.909360    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:36.912361 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.912338    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ghnzc"]
Jul 15 19:15:36.912472 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.912420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:36.912553 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:36.912508    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:36.913063 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.913038    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4z6xs"]
Jul 15 19:15:36.913177 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:36.913164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:36.913336 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:36.913312    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:37.748629 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:37.748599    2562 generic.go:356] "Generic (PLEG): container finished" podID="d16352e0-3e66-42a0-bdd1-0ae248e2a454" containerID="7e6b75acd9249ebf5f529121a0b8a1467c98dbd79859b6561b072c061eb41002" exitCode=0
Jul 15 19:15:37.749082 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:37.748692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vz4lq" event={"ID":"d16352e0-3e66-42a0-bdd1-0ae248e2a454","Type":"ContainerDied","Data":"7e6b75acd9249ebf5f529121a0b8a1467c98dbd79859b6561b072c061eb41002"}
Jul 15 19:15:37.749082 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:37.748763    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 19:15:38.559249 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:38.559222    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:38.559392 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:38.559308    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:38.559432 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:38.559393    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:38.559523 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:38.559485    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:38.559589 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:38.559572    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:38.559669 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:38.559652    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:38.736718 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:38.736695    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:15:39.754663 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:39.754398    2562 generic.go:356] "Generic (PLEG): container finished" podID="d16352e0-3e66-42a0-bdd1-0ae248e2a454" containerID="a81a9c37d2e5bb91d1a241824a37d39d91415a682a84aa005ada62ec1be008fe" exitCode=0
Jul 15 19:15:39.754663 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:39.754481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vz4lq" event={"ID":"d16352e0-3e66-42a0-bdd1-0ae248e2a454","Type":"ContainerDied","Data":"a81a9c37d2e5bb91d1a241824a37d39d91415a682a84aa005ada62ec1be008fe"}
Jul 15 19:15:40.557856 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:40.557826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:40.557990 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:40.557835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:40.557990 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:40.557934    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:40.558105 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:40.557835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:40.558105 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:40.557993    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:40.558197 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:40.558143    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:42.180347 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:42.180312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:42.181023 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.180481    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:15:42.181023 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.180516    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:15:42.181023 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.180528    2562 projected.go:196] Error preparing data for projected volume kube-api-access-w6222 for pod openshift-network-diagnostics/network-check-target-ghnzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:42.181023 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.180586    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222 podName:b191c7e0-dd57-4466-a903-2da9967e06bb nodeName:}" failed. No retries permitted until 2026-07-15 19:16:14.180567587 +0000 UTC m=+66.178545944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6222" (UniqueName: "kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222") pod "network-check-target-ghnzc" (UID: "b191c7e0-dd57-4466-a903-2da9967e06bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:42.281138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:42.281046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:42.281138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:42.281104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:42.281340 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.281180    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:42.281340 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.281203    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:42.281340 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.281243    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs podName:5e447e5a-2320-465c-a36f-98877669e84f nodeName:}" failed. No retries permitted until 2026-07-15 19:16:14.281226457 +0000 UTC m=+66.279204824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs") pod "network-metrics-daemon-4z6xs" (UID: "5e447e5a-2320-465c-a36f-98877669e84f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:42.281340 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.281258    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret podName:bc231b65-f3b6-4d93-86f3-127b91e5003b nodeName:}" failed. No retries permitted until 2026-07-15 19:16:14.281251689 +0000 UTC m=+66.279230041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret") pod "global-pull-secret-syncer-5k58n" (UID: "bc231b65-f3b6-4d93-86f3-127b91e5003b") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:42.558599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:42.558570    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:42.558599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:42.558586    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:42.558808 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:42.558570    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:42.558808 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.558673    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghnzc" podUID="b191c7e0-dd57-4466-a903-2da9967e06bb"
Jul 15 19:15:42.558808 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.558786    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4z6xs" podUID="5e447e5a-2320-465c-a36f-98877669e84f"
Jul 15 19:15:42.558917 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:42.558869    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5k58n" podUID="bc231b65-f3b6-4d93-86f3-127b91e5003b"
Jul 15 19:15:43.764685 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.764658    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-72.ec2.internal" event="NodeReady"
Jul 15 19:15:43.765109 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.764788    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 19:15:43.801776 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.801750    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54cf59cf7c-zrf42"]
Jul 15 19:15:43.805086 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.805067    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.807689 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.807672    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 19:15:43.808137 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.808120    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tlkgd\""
Jul 15 19:15:43.808137 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.808128    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 19:15:43.808246 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.808134    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 19:15:43.815534 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.815517    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 19:15:43.816115 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.816092    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"]
Jul 15 19:15:43.818405 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.818381    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:43.823575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.820946    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"]
Jul 15 19:15:43.823575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.822485    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hnk7g\""
Jul 15 19:15:43.823575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.823343    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 19:15:43.825569 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.825394    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 19:15:43.827324 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.827309    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"]
Jul 15 19:15:43.827448 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.827427    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:43.829666 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.829649    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq"]
Jul 15 19:15:43.829791 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.829765    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:43.830734 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.830715    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 19:15:43.830868 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.830751    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:15:43.831047 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.830872    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 19:15:43.831551 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.831528    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 19:15:43.831639 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.831597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dxk7m\""
Jul 15 19:15:43.833162 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.833142    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 19:15:43.833378 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.833363    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:15:43.833508 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.833479    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54cf59cf7c-zrf42"]
Jul 15 19:15:43.833569 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.833146    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 19:15:43.833569 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.833533    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-92kfp"]
Jul 15 19:15:43.833672 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.833663    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ds827\""
Jul 15 19:15:43.833727 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.833709    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 19:15:43.834361 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.834042    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq"
Jul 15 19:15:43.837545 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.837471    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-djn55\""
Jul 15 19:15:43.837639 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.837555    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 19:15:43.838363 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.838343    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qdgrw"]
Jul 15 19:15:43.838662 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.838643    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 19:15:43.838925 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.838907    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:43.841018 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.841000    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"]
Jul 15 19:15:43.841109 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.841032    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"]
Jul 15 19:15:43.841309 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.841289    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq"]
Jul 15 19:15:43.841380 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.841318    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8qrjh\""
Jul 15 19:15:43.841380 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.841375    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qdgrw"
Jul 15 19:15:43.841691 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.841323    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"]
Jul 15 19:15:43.842445 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.842429    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qdgrw"]
Jul 15 19:15:43.842543 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.842459    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-92kfp"]
Jul 15 19:15:43.842543 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.842146    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 19:15:43.842653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.842069    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 19:15:43.844074 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.844053    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 19:15:43.844165 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.844104    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-swcsq\""
Jul 15 19:15:43.844165 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.844118    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 19:15:43.844269 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.844054    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 19:15:43.890291 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.890266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-installation-pull-secrets\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.890382 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.890314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-image-registry-private-configuration\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.890382 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.890333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-bound-sa-token\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.890470 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.890433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06197dbb-d062-45e6-80fc-8820bee91da9-ca-trust-extracted\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.890529 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.890471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-registry-certificates\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.890529 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.890516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-trusted-ca\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.890616 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.890559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm58q\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-kube-api-access-rm58q\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.890616 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.890594    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.949658 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.949621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tjhzf_938e07d9-46e2-43c5-b069-c0181a9e71a6/konnectivity-agent/0.log" limit=1024
Jul 15 19:15:43.991469 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:43.991601 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-installation-pull-secrets\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.991601 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2167e746-a49c-46e0-ab9c-0df48d88bb21-tmp-dir\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:43.991601 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991556    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-image-registry-private-configuration\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.991601 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-bound-sa-token\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.991799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgw8f\" (UniqueName: \"kubernetes.io/projected/11c15850-8296-443e-9848-c516550468d5-kube-api-access-jgw8f\") pod \"network-check-source-869dcfcdcd-p77jq\" (UID: \"11c15850-8296-443e-9848-c516550468d5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq"
Jul 15 19:15:43.991799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06197dbb-d062-45e6-80fc-8820bee91da9-ca-trust-extracted\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.991799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-registry-certificates\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.991799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-trusted-ca\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.991799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:43.991799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c22bacc0-0044-419e-bbd4-0ede3a29e34f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-87kpb\" (UID: \"c22bacc0-0044-419e-bbd4-0ede3a29e34f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:43.992047 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swbf7\" (UniqueName: \"kubernetes.io/projected/c22bacc0-0044-419e-bbd4-0ede3a29e34f-kube-api-access-swbf7\") pod \"kube-storage-version-migrator-operator-799cb7f958-87kpb\" (UID: \"c22bacc0-0044-419e-bbd4-0ede3a29e34f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:43.992047 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwblh\" (UniqueName: \"kubernetes.io/projected/156270f5-25a1-47ff-8df7-265d457c2539-kube-api-access-lwblh\") pod \"service-ca-operator-7695fc6c8c-bncrr\" (UID: \"156270f5-25a1-47ff-8df7-265d457c2539\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:43.992047 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6afbfb61-4e3b-4be6-af71-07deeefb81e9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:43.992047 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2167e746-a49c-46e0-ab9c-0df48d88bb21-config-volume\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:43.992047 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9p7p\" (UniqueName: \"kubernetes.io/projected/2167e746-a49c-46e0-ab9c-0df48d88bb21-kube-api-access-q9p7p\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:43.992047 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/156270f5-25a1-47ff-8df7-265d457c2539-config\") pod \"service-ca-operator-7695fc6c8c-bncrr\" (UID: \"156270f5-25a1-47ff-8df7-265d457c2539\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:43.992047 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.991980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c6faa3-dd7d-4b59-85e8-4c37f32454d1-cert\") pod \"ingress-canary-qdgrw\" (UID: \"98c6faa3-dd7d-4b59-85e8-4c37f32454d1\") " pod="openshift-ingress-canary/ingress-canary-qdgrw"
Jul 15 19:15:43.992047 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.992024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c22bacc0-0044-419e-bbd4-0ede3a29e34f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-87kpb\" (UID: \"c22bacc0-0044-419e-bbd4-0ede3a29e34f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:43.992405 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.992052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/156270f5-25a1-47ff-8df7-265d457c2539-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bncrr\" (UID: \"156270f5-25a1-47ff-8df7-265d457c2539\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:43.992405 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.992058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06197dbb-d062-45e6-80fc-8820bee91da9-ca-trust-extracted\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.992405 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.992092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm58q\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-kube-api-access-rm58q\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.992405 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.992123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.992405 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.992146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgvd\" (UniqueName: \"kubernetes.io/projected/98c6faa3-dd7d-4b59-85e8-4c37f32454d1-kube-api-access-gcgvd\") pod \"ingress-canary-qdgrw\" (UID: \"98c6faa3-dd7d-4b59-85e8-4c37f32454d1\") " pod="openshift-ingress-canary/ingress-canary-qdgrw"
Jul 15 19:15:43.992405 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:43.992239    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:15:43.992405 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:43.992258    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cf59cf7c-zrf42: secret "image-registry-tls" not found
Jul 15 19:15:43.992405 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.992287    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-registry-certificates\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.992405 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:43.992311    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls podName:06197dbb-d062-45e6-80fc-8820bee91da9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:44.49229157 +0000 UTC m=+36.490269927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls") pod "image-registry-54cf59cf7c-zrf42" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9") : secret "image-registry-tls" not found
Jul 15 19:15:43.992840 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.992716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-trusted-ca\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.995845 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.995822    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-installation-pull-secrets\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:43.995936 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:43.995858    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-image-registry-private-configuration\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:44.003186 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.003167    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-bound-sa-token\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:44.003720 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.003702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm58q\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-kube-api-access-rm58q\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:44.029090 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.028998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tjhzf_938e07d9-46e2-43c5-b069-c0181a9e71a6/konnectivity-agent/0.log" limit=1024
Jul 15 19:15:44.092794 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.092767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgw8f\" (UniqueName: \"kubernetes.io/projected/11c15850-8296-443e-9848-c516550468d5-kube-api-access-jgw8f\") pod \"network-check-source-869dcfcdcd-p77jq\" (UID: \"11c15850-8296-443e-9848-c516550468d5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq"
Jul 15 19:15:44.092890 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.092834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:44.092890 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.092861    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c22bacc0-0044-419e-bbd4-0ede3a29e34f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-87kpb\" (UID: \"c22bacc0-0044-419e-bbd4-0ede3a29e34f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:44.092890 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.092885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swbf7\" (UniqueName: \"kubernetes.io/projected/c22bacc0-0044-419e-bbd4-0ede3a29e34f-kube-api-access-swbf7\") pod \"kube-storage-version-migrator-operator-799cb7f958-87kpb\" (UID: \"c22bacc0-0044-419e-bbd4-0ede3a29e34f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:44.093039 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.092910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwblh\" (UniqueName: \"kubernetes.io/projected/156270f5-25a1-47ff-8df7-265d457c2539-kube-api-access-lwblh\") pod \"service-ca-operator-7695fc6c8c-bncrr\" (UID: \"156270f5-25a1-47ff-8df7-265d457c2539\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:44.093180 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.093160    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:15:44.093237 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.093212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6afbfb61-4e3b-4be6-af71-07deeefb81e9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:44.093237 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.093226    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert podName:6afbfb61-4e3b-4be6-af71-07deeefb81e9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:44.593209019 +0000 UTC m=+36.591187384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-zjhqb" (UID: "6afbfb61-4e3b-4be6-af71-07deeefb81e9") : secret "networking-console-plugin-cert" not found
Jul 15 19:15:44.093348 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.093267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2167e746-a49c-46e0-ab9c-0df48d88bb21-config-volume\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:44.093348 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.093292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9p7p\" (UniqueName: \"kubernetes.io/projected/2167e746-a49c-46e0-ab9c-0df48d88bb21-kube-api-access-q9p7p\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:44.093348 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.093320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/156270f5-25a1-47ff-8df7-265d457c2539-config\") pod \"service-ca-operator-7695fc6c8c-bncrr\" (UID: \"156270f5-25a1-47ff-8df7-265d457c2539\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:44.093485 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.093346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c6faa3-dd7d-4b59-85e8-4c37f32454d1-cert\") pod \"ingress-canary-qdgrw\" (UID: \"98c6faa3-dd7d-4b59-85e8-4c37f32454d1\") " pod="openshift-ingress-canary/ingress-canary-qdgrw"
Jul 15 19:15:44.093485 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.093463    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c22bacc0-0044-419e-bbd4-0ede3a29e34f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-87kpb\" (UID: \"c22bacc0-0044-419e-bbd4-0ede3a29e34f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:44.093871 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.093537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c22bacc0-0044-419e-bbd4-0ede3a29e34f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-87kpb\" (UID: \"c22bacc0-0044-419e-bbd4-0ede3a29e34f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:44.093943 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.093903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/156270f5-25a1-47ff-8df7-265d457c2539-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bncrr\" (UID: \"156270f5-25a1-47ff-8df7-265d457c2539\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:44.093998 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.093979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgvd\" (UniqueName: \"kubernetes.io/projected/98c6faa3-dd7d-4b59-85e8-4c37f32454d1-kube-api-access-gcgvd\") pod \"ingress-canary-qdgrw\" (UID: \"98c6faa3-dd7d-4b59-85e8-4c37f32454d1\") " pod="openshift-ingress-canary/ingress-canary-qdgrw"
Jul 15 19:15:44.094052 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.094023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:44.094099 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.094063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2167e746-a49c-46e0-ab9c-0df48d88bb21-tmp-dir\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:44.094359 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.094334    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6afbfb61-4e3b-4be6-af71-07deeefb81e9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:44.094359 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.094351    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/156270f5-25a1-47ff-8df7-265d457c2539-config\") pod \"service-ca-operator-7695fc6c8c-bncrr\" (UID: \"156270f5-25a1-47ff-8df7-265d457c2539\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:44.094469 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.094358    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2167e746-a49c-46e0-ab9c-0df48d88bb21-config-volume\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:44.094469 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.094343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2167e746-a49c-46e0-ab9c-0df48d88bb21-tmp-dir\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:44.094469 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.094445    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:15:44.094628 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.094538    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls podName:2167e746-a49c-46e0-ab9c-0df48d88bb21 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:44.594519712 +0000 UTC m=+36.592498069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls") pod "dns-default-92kfp" (UID: "2167e746-a49c-46e0-ab9c-0df48d88bb21") : secret "dns-default-metrics-tls" not found
Jul 15 19:15:44.098112 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.096299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c6faa3-dd7d-4b59-85e8-4c37f32454d1-cert\") pod \"ingress-canary-qdgrw\" (UID: \"98c6faa3-dd7d-4b59-85e8-4c37f32454d1\") " pod="openshift-ingress-canary/ingress-canary-qdgrw"
Jul 15 19:15:44.098898 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.098875    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c22bacc0-0044-419e-bbd4-0ede3a29e34f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-87kpb\" (UID: \"c22bacc0-0044-419e-bbd4-0ede3a29e34f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:44.099449 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.099428    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/156270f5-25a1-47ff-8df7-265d457c2539-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bncrr\" (UID: \"156270f5-25a1-47ff-8df7-265d457c2539\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:44.102030 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.102008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swbf7\" (UniqueName: \"kubernetes.io/projected/c22bacc0-0044-419e-bbd4-0ede3a29e34f-kube-api-access-swbf7\") pod \"kube-storage-version-migrator-operator-799cb7f958-87kpb\" (UID: \"c22bacc0-0044-419e-bbd4-0ede3a29e34f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:44.102160 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.102083    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9p7p\" (UniqueName: \"kubernetes.io/projected/2167e746-a49c-46e0-ab9c-0df48d88bb21-kube-api-access-q9p7p\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:44.103263 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.103168    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgvd\" (UniqueName: \"kubernetes.io/projected/98c6faa3-dd7d-4b59-85e8-4c37f32454d1-kube-api-access-gcgvd\") pod \"ingress-canary-qdgrw\" (UID: \"98c6faa3-dd7d-4b59-85e8-4c37f32454d1\") " pod="openshift-ingress-canary/ingress-canary-qdgrw"
Jul 15 19:15:44.103694 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.103671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgw8f\" (UniqueName: \"kubernetes.io/projected/11c15850-8296-443e-9848-c516550468d5-kube-api-access-jgw8f\") pod \"network-check-source-869dcfcdcd-p77jq\" (UID: \"11c15850-8296-443e-9848-c516550468d5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq"
Jul 15 19:15:44.103899 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.103878    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwblh\" (UniqueName: \"kubernetes.io/projected/156270f5-25a1-47ff-8df7-265d457c2539-kube-api-access-lwblh\") pod \"service-ca-operator-7695fc6c8c-bncrr\" (UID: \"156270f5-25a1-47ff-8df7-265d457c2539\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:44.145019 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.144998    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"
Jul 15 19:15:44.152121 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.152106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"
Jul 15 19:15:44.158456 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.158439    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq"
Jul 15 19:15:44.171279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.171262    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qdgrw"
Jul 15 19:15:44.497949 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.497913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:44.498109 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.498070    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:15:44.498109 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.498089    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cf59cf7c-zrf42: secret "image-registry-tls" not found
Jul 15 19:15:44.498198 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.498153    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls podName:06197dbb-d062-45e6-80fc-8820bee91da9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:45.498133448 +0000 UTC m=+37.496111802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls") pod "image-registry-54cf59cf7c-zrf42" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9") : secret "image-registry-tls" not found
Jul 15 19:15:44.558707 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.558679    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:15:44.558857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.558683    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:15:44.558857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.558829    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:15:44.561788 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.561760    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:15:44.561908 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.561795    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:15:44.561908 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.561847    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pzvzj\""
Jul 15 19:15:44.562104 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.562088    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6x7t\""
Jul 15 19:15:44.598453 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.598427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:44.598623 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.598589    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:15:44.598737 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.598623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:44.598737 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.598655    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert podName:6afbfb61-4e3b-4be6-af71-07deeefb81e9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:45.598636398 +0000 UTC m=+37.596614764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-zjhqb" (UID: "6afbfb61-4e3b-4be6-af71-07deeefb81e9") : secret "networking-console-plugin-cert" not found
Jul 15 19:15:44.598852 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.598740    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:15:44.598852 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:44.598795    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls podName:2167e746-a49c-46e0-ab9c-0df48d88bb21 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:45.598779389 +0000 UTC m=+37.596757756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls") pod "dns-default-92kfp" (UID: "2167e746-a49c-46e0-ab9c-0df48d88bb21") : secret "dns-default-metrics-tls" not found
Jul 15 19:15:44.945894 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.944719    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb"]
Jul 15 19:15:44.951526 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:44.951486    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22bacc0_0044_419e_bbd4_0ede3a29e34f.slice/crio-77dd71330241cec98dabd2f572c4f59d2cf0f1afb38feb6d2554aab05c4b934a WatchSource:0}: Error finding container 77dd71330241cec98dabd2f572c4f59d2cf0f1afb38feb6d2554aab05c4b934a: Status 404 returned error can't find the container with id 77dd71330241cec98dabd2f572c4f59d2cf0f1afb38feb6d2554aab05c4b934a
Jul 15 19:15:44.962046 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.962020    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq"]
Jul 15 19:15:44.962888 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.962871    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr"]
Jul 15 19:15:44.964934 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:44.964912    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c15850_8296_443e_9848_c516550468d5.slice/crio-764fb5fa4b8545f875cb906b950094a4fdd11b1fc067841eb35c88dd583c6e9b WatchSource:0}: Error finding container 764fb5fa4b8545f875cb906b950094a4fdd11b1fc067841eb35c88dd583c6e9b: Status 404 returned error can't find the container with id 764fb5fa4b8545f875cb906b950094a4fdd11b1fc067841eb35c88dd583c6e9b
Jul 15 19:15:44.965363 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:44.965226    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qdgrw"]
Jul 15 19:15:44.965733 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:44.965716    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156270f5_25a1_47ff_8df7_265d457c2539.slice/crio-058482bfc470181da58724d3f3c4aeb3ef5957560ac695da1a232977fdb7765f WatchSource:0}: Error finding container 058482bfc470181da58724d3f3c4aeb3ef5957560ac695da1a232977fdb7765f: Status 404 returned error can't find the container with id 058482bfc470181da58724d3f3c4aeb3ef5957560ac695da1a232977fdb7765f
Jul 15 19:15:44.968583 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:44.968469    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c6faa3_dd7d_4b59_85e8_4c37f32454d1.slice/crio-fef9789f946ead802f4abdcdef7cffad24497cc6f5eea69c43dff7275eb6b9c3 WatchSource:0}: Error finding container fef9789f946ead802f4abdcdef7cffad24497cc6f5eea69c43dff7275eb6b9c3: Status 404 returned error can't find the container with id fef9789f946ead802f4abdcdef7cffad24497cc6f5eea69c43dff7275eb6b9c3
Jul 15 19:15:45.507991 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:45.507960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:45.508190 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:45.508129    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:15:45.508291 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:45.508195    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cf59cf7c-zrf42: secret "image-registry-tls" not found
Jul 15 19:15:45.508339 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:45.508320    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls podName:06197dbb-d062-45e6-80fc-8820bee91da9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:47.508246826 +0000 UTC m=+39.506225197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls") pod "image-registry-54cf59cf7c-zrf42" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9") : secret "image-registry-tls" not found
Jul 15 19:15:45.609105 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:45.609074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:45.609243 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:45.609173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:45.609356 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:45.609319    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:15:45.609403 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:45.609390    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert podName:6afbfb61-4e3b-4be6-af71-07deeefb81e9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:47.609371101 +0000 UTC m=+39.607349455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-zjhqb" (UID: "6afbfb61-4e3b-4be6-af71-07deeefb81e9") : secret "networking-console-plugin-cert" not found
Jul 15 19:15:45.609827 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:45.609791    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:15:45.609922 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:45.609839    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls podName:2167e746-a49c-46e0-ab9c-0df48d88bb21 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:47.609824127 +0000 UTC m=+39.607802482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls") pod "dns-default-92kfp" (UID: "2167e746-a49c-46e0-ab9c-0df48d88bb21") : secret "dns-default-metrics-tls" not found
Jul 15 19:15:45.771315 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:45.771205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq" event={"ID":"11c15850-8296-443e-9848-c516550468d5","Type":"ContainerStarted","Data":"764fb5fa4b8545f875cb906b950094a4fdd11b1fc067841eb35c88dd583c6e9b"}
Jul 15 19:15:45.772923 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:45.772871    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr" event={"ID":"156270f5-25a1-47ff-8df7-265d457c2539","Type":"ContainerStarted","Data":"058482bfc470181da58724d3f3c4aeb3ef5957560ac695da1a232977fdb7765f"}
Jul 15 19:15:45.774800 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:45.774776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb" event={"ID":"c22bacc0-0044-419e-bbd4-0ede3a29e34f","Type":"ContainerStarted","Data":"77dd71330241cec98dabd2f572c4f59d2cf0f1afb38feb6d2554aab05c4b934a"}
Jul 15 19:15:45.776373 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:45.776347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qdgrw" event={"ID":"98c6faa3-dd7d-4b59-85e8-4c37f32454d1","Type":"ContainerStarted","Data":"fef9789f946ead802f4abdcdef7cffad24497cc6f5eea69c43dff7275eb6b9c3"}
Jul 15 19:15:45.780067 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:45.780041    2562 generic.go:356] "Generic (PLEG): container finished" podID="d16352e0-3e66-42a0-bdd1-0ae248e2a454" containerID="2fd12d8d51232cc9f4404a28f47d7a70888f00dc08b42b06c8df5f159019f2ad" exitCode=0
Jul 15 19:15:45.780153 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:45.780070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vz4lq" event={"ID":"d16352e0-3e66-42a0-bdd1-0ae248e2a454","Type":"ContainerDied","Data":"2fd12d8d51232cc9f4404a28f47d7a70888f00dc08b42b06c8df5f159019f2ad"}
Jul 15 19:15:46.318637 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:46.318574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tjhzf_938e07d9-46e2-43c5-b069-c0181a9e71a6/konnectivity-agent/0.log" limit=1024
Jul 15 19:15:46.371436 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:46.371290    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tjhzf_938e07d9-46e2-43c5-b069-c0181a9e71a6/konnectivity-agent/0.log" limit=1024
Jul 15 19:15:46.786637 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:46.786600    2562 generic.go:356] "Generic (PLEG): container finished" podID="d16352e0-3e66-42a0-bdd1-0ae248e2a454" containerID="9e28b474b1e69ab891af1c6559e6910ee9e9708cd87bae46c36f8e4d920b1a20" exitCode=0
Jul 15 19:15:46.786820 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:46.786668    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vz4lq" event={"ID":"d16352e0-3e66-42a0-bdd1-0ae248e2a454","Type":"ContainerDied","Data":"9e28b474b1e69ab891af1c6559e6910ee9e9708cd87bae46c36f8e4d920b1a20"}
Jul 15 19:15:47.527052 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:47.526976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:47.527428 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:47.527143    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:15:47.527428 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:47.527165    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cf59cf7c-zrf42: secret "image-registry-tls" not found
Jul 15 19:15:47.527428 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:47.527226    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls podName:06197dbb-d062-45e6-80fc-8820bee91da9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:51.52721102 +0000 UTC m=+43.525189395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls") pod "image-registry-54cf59cf7c-zrf42" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9") : secret "image-registry-tls" not found
Jul 15 19:15:47.627817 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:47.627784    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:47.627975 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:47.627877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:47.627975 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:47.627945    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:15:47.628081 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:47.627986    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:15:47.628081 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:47.628005    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls podName:2167e746-a49c-46e0-ab9c-0df48d88bb21 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:51.627989521 +0000 UTC m=+43.625967883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls") pod "dns-default-92kfp" (UID: "2167e746-a49c-46e0-ab9c-0df48d88bb21") : secret "dns-default-metrics-tls" not found
Jul 15 19:15:47.628081 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:47.628036    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert podName:6afbfb61-4e3b-4be6-af71-07deeefb81e9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:51.628021331 +0000 UTC m=+43.625999704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-zjhqb" (UID: "6afbfb61-4e3b-4be6-af71-07deeefb81e9") : secret "networking-console-plugin-cert" not found
Jul 15 19:15:48.103906 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:48.103703    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tjhzf_938e07d9-46e2-43c5-b069-c0181a9e71a6/konnectivity-agent/0.log" limit=1024
Jul 15 19:15:50.798608 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.798561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq" event={"ID":"11c15850-8296-443e-9848-c516550468d5","Type":"ContainerStarted","Data":"35d34742f0178c03763882972ab3638760cedcffd7a1469249c21d5ebb553b16"}
Jul 15 19:15:50.800134 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.800089    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr" event={"ID":"156270f5-25a1-47ff-8df7-265d457c2539","Type":"ContainerStarted","Data":"cf5a1d3efdce227b13e3db734cdfd2a1fa72d5d2c22ace4a7d33fc24ebc210f0"}
Jul 15 19:15:50.801641 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.801609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb" event={"ID":"c22bacc0-0044-419e-bbd4-0ede3a29e34f","Type":"ContainerStarted","Data":"c4f0aad5d2080106d61859a09513749a157bd5f628bbd209dd6c3b3ac81d4d66"}
Jul 15 19:15:50.803265 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.803231    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qdgrw" event={"ID":"98c6faa3-dd7d-4b59-85e8-4c37f32454d1","Type":"ContainerStarted","Data":"bb6b4dd247b1507c0daebf01dc9fac08ab8cad850a16162df9b673592a7df74c"}
Jul 15 19:15:50.806566 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.806541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vz4lq" event={"ID":"d16352e0-3e66-42a0-bdd1-0ae248e2a454","Type":"ContainerStarted","Data":"b0beab73adc4f704230c7f1250a6a7e7ab36b7519806e4813ffb4f75ed5be148"}
Jul 15 19:15:50.828056 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.828011    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p77jq" podStartSLOduration=33.696855333 podStartE2EDuration="38.827994475s" totalImagesPullingTime="5.131139142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:50.813521002 +0000 UTC m=+42.811499377" watchObservedRunningTime="2026-07-15 19:15:50.827994475 +0000 UTC m=+42.825972844"
Jul 15 19:15:50.828166 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.828100    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qdgrw" podStartSLOduration=2.710797531 podStartE2EDuration="7.828093793s" totalImagesPullingTime="5.117296262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:50.827061871 +0000 UTC m=+42.825040245" watchObservedRunningTime="2026-07-15 19:15:50.828093793 +0000 UTC m=+42.826072170"
Jul 15 19:15:50.848107 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.848068    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vz4lq" podStartSLOduration=12.261005014 podStartE2EDuration="42.848053561s" totalImagesPullingTime="30.587048547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:50.846519576 +0000 UTC m=+42.844497948" watchObservedRunningTime="2026-07-15 19:15:50.848053561 +0000 UTC m=+42.846031932"
Jul 15 19:15:50.861481 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.861382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb" podStartSLOduration=35.727184392 podStartE2EDuration="40.861366786s" totalImagesPullingTime="5.134182394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:50.861163576 +0000 UTC m=+42.859141949" watchObservedRunningTime="2026-07-15 19:15:50.861366786 +0000 UTC m=+42.859345160"
Jul 15 19:15:50.878177 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:50.878145    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr" podStartSLOduration=33.75785155 podStartE2EDuration="38.878138225s" totalImagesPullingTime="5.120286675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:50.877546861 +0000 UTC m=+42.875525234" watchObservedRunningTime="2026-07-15 19:15:50.878138225 +0000 UTC m=+42.876116598"
Jul 15 19:15:51.559312 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.559278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:51.559545 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:51.559451    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:15:51.559545 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:51.559472    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cf59cf7c-zrf42: secret "image-registry-tls" not found
Jul 15 19:15:51.559694 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:51.559554    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls podName:06197dbb-d062-45e6-80fc-8820bee91da9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:59.559532188 +0000 UTC m=+51.557510543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls") pod "image-registry-54cf59cf7c-zrf42" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9") : secret "image-registry-tls" not found
Jul 15 19:15:51.660544 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.660510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:51.660698 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.660572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:51.660698 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:51.660655    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:15:51.660698 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:51.660668    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:15:51.660799 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:51.660729    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert podName:6afbfb61-4e3b-4be6-af71-07deeefb81e9 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:59.660704428 +0000 UTC m=+51.658682780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-zjhqb" (UID: "6afbfb61-4e3b-4be6-af71-07deeefb81e9") : secret "networking-console-plugin-cert" not found
Jul 15 19:15:51.660799 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:51.660749    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls podName:2167e746-a49c-46e0-ab9c-0df48d88bb21 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:59.66074271 +0000 UTC m=+51.658721094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls") pod "dns-default-92kfp" (UID: "2167e746-a49c-46e0-ab9c-0df48d88bb21") : secret "dns-default-metrics-tls" not found
Jul 15 19:15:51.753778 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.753749    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s"]
Jul 15 19:15:51.778735 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.778712    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s"]
Jul 15 19:15:51.778894 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.778868    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s"
Jul 15 19:15:51.781274 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.781252    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 19:15:51.781366 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.781252    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-n7tck\""
Jul 15 19:15:51.782332 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.782312    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 19:15:51.963816 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:51.963753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ksh\" (UniqueName: \"kubernetes.io/projected/6cb5665a-95f8-4d91-9a11-7cb8a62fff51-kube-api-access-98ksh\") pod \"migrator-7f59b54f6c-68r4s\" (UID: \"6cb5665a-95f8-4d91-9a11-7cb8a62fff51\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s"
Jul 15 19:15:52.064841 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:52.064813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ksh\" (UniqueName: \"kubernetes.io/projected/6cb5665a-95f8-4d91-9a11-7cb8a62fff51-kube-api-access-98ksh\") pod \"migrator-7f59b54f6c-68r4s\" (UID: \"6cb5665a-95f8-4d91-9a11-7cb8a62fff51\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s"
Jul 15 19:15:52.074818 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:52.074787    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ksh\" (UniqueName: \"kubernetes.io/projected/6cb5665a-95f8-4d91-9a11-7cb8a62fff51-kube-api-access-98ksh\") pod \"migrator-7f59b54f6c-68r4s\" (UID: \"6cb5665a-95f8-4d91-9a11-7cb8a62fff51\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s"
Jul 15 19:15:52.087622 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:52.087596    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s"
Jul 15 19:15:52.221303 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:52.221250    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s"]
Jul 15 19:15:52.224020 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:52.223996    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb5665a_95f8_4d91_9a11_7cb8a62fff51.slice/crio-02c5118115e21fd94abaf0c017877cdb22bb1b20dc53cc1b6ee8c8ae787504de WatchSource:0}: Error finding container 02c5118115e21fd94abaf0c017877cdb22bb1b20dc53cc1b6ee8c8ae787504de: Status 404 returned error can't find the container with id 02c5118115e21fd94abaf0c017877cdb22bb1b20dc53cc1b6ee8c8ae787504de
Jul 15 19:15:52.812144 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:52.812108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s" event={"ID":"6cb5665a-95f8-4d91-9a11-7cb8a62fff51","Type":"ContainerStarted","Data":"02c5118115e21fd94abaf0c017877cdb22bb1b20dc53cc1b6ee8c8ae787504de"}
Jul 15 19:15:53.922849 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.922823    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pqm8c"]
Jul 15 19:15:53.938591 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.938571    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pqm8c"]
Jul 15 19:15:53.938705 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.938673    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:53.941309 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.941289    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 19:15:53.941602 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.941385    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 19:15:53.941602 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.941391    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-b5rrs\""
Jul 15 19:15:53.942443 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.942426    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 19:15:53.942543 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.942465    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 19:15:53.979485 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.979456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2c0fbd58-b4a6-466e-bf2d-e1e928f368f4-signing-key\") pod \"service-ca-79f68b9f4f-pqm8c\" (UID: \"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:53.979607 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.979571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkxft\" (UniqueName: \"kubernetes.io/projected/2c0fbd58-b4a6-466e-bf2d-e1e928f368f4-kube-api-access-vkxft\") pod \"service-ca-79f68b9f4f-pqm8c\" (UID: \"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:53.979651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:53.979614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2c0fbd58-b4a6-466e-bf2d-e1e928f368f4-signing-cabundle\") pod \"service-ca-79f68b9f4f-pqm8c\" (UID: \"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:54.080812 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.080787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2c0fbd58-b4a6-466e-bf2d-e1e928f368f4-signing-cabundle\") pod \"service-ca-79f68b9f4f-pqm8c\" (UID: \"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:54.080902 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.080834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2c0fbd58-b4a6-466e-bf2d-e1e928f368f4-signing-key\") pod \"service-ca-79f68b9f4f-pqm8c\" (UID: \"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:54.080992 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.080973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkxft\" (UniqueName: \"kubernetes.io/projected/2c0fbd58-b4a6-466e-bf2d-e1e928f368f4-kube-api-access-vkxft\") pod \"service-ca-79f68b9f4f-pqm8c\" (UID: \"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:54.081440 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.081425    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2c0fbd58-b4a6-466e-bf2d-e1e928f368f4-signing-cabundle\") pod \"service-ca-79f68b9f4f-pqm8c\" (UID: \"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:54.083010 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.082995    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2c0fbd58-b4a6-466e-bf2d-e1e928f368f4-signing-key\") pod \"service-ca-79f68b9f4f-pqm8c\" (UID: \"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:54.088782 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.088759    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkxft\" (UniqueName: \"kubernetes.io/projected/2c0fbd58-b4a6-466e-bf2d-e1e928f368f4-kube-api-access-vkxft\") pod \"service-ca-79f68b9f4f-pqm8c\" (UID: \"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:54.246849 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.246833    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c"
Jul 15 19:15:54.390295 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.390275    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pqm8c"]
Jul 15 19:15:54.392204 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:54.392183    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0fbd58_b4a6_466e_bf2d_e1e928f368f4.slice/crio-ee9155f219a997f40d03586ea43f56980db5563fef5c97eb0b655f8aca888fa5 WatchSource:0}: Error finding container ee9155f219a997f40d03586ea43f56980db5563fef5c97eb0b655f8aca888fa5: Status 404 returned error can't find the container with id ee9155f219a997f40d03586ea43f56980db5563fef5c97eb0b655f8aca888fa5
Jul 15 19:15:54.819404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.819377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c" event={"ID":"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4","Type":"ContainerStarted","Data":"edf3a45027782a50df189100c7e588cb99f6db89cf4fcdc851ae370253ed298a"}
Jul 15 19:15:54.819596 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.819423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c" event={"ID":"2c0fbd58-b4a6-466e-bf2d-e1e928f368f4","Type":"ContainerStarted","Data":"ee9155f219a997f40d03586ea43f56980db5563fef5c97eb0b655f8aca888fa5"}
Jul 15 19:15:54.821110 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.821085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s" event={"ID":"6cb5665a-95f8-4d91-9a11-7cb8a62fff51","Type":"ContainerStarted","Data":"35ef4d4cad5803a441fb39c73a6e483e263de95fd4e5db4d53703aaf2944a6bc"}
Jul 15 19:15:54.821227 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.821132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s" event={"ID":"6cb5665a-95f8-4d91-9a11-7cb8a62fff51","Type":"ContainerStarted","Data":"e8e8c6e100fe5da345a99c6a24753dab0b636f78a286a2d796ca630518c3e2a4"}
Jul 15 19:15:54.845995 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.845948    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-pqm8c" podStartSLOduration=1.845933485 podStartE2EDuration="1.845933485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:54.841579293 +0000 UTC m=+46.839557696" watchObservedRunningTime="2026-07-15 19:15:54.845933485 +0000 UTC m=+46.843911857"
Jul 15 19:15:54.862802 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:54.862766    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-68r4s" podStartSLOduration=1.8855021760000001 podStartE2EDuration="3.862749988s" totalImagesPullingTime="1.977247812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:54.861862354 +0000 UTC m=+46.859840737" watchObservedRunningTime="2026-07-15 19:15:54.862749988 +0000 UTC m=+46.860728361"
Jul 15 19:15:59.620972 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:59.620942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:59.623130 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:59.623107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") pod \"image-registry-54cf59cf7c-zrf42\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") " pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:59.716082 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:59.716057    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:15:59.722252 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:59.722228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:15:59.722312 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:59.722264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:59.722395 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:59.722376    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 19:15:59.722454 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:15:59.722444    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert podName:6afbfb61-4e3b-4be6-af71-07deeefb81e9 nodeName:}" failed. No retries permitted until 2026-07-15 19:16:15.722429931 +0000 UTC m=+67.720408285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-zjhqb" (UID: "6afbfb61-4e3b-4be6-af71-07deeefb81e9") : secret "networking-console-plugin-cert" not found
Jul 15 19:15:59.724178 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:59.724160    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167e746-a49c-46e0-ab9c-0df48d88bb21-metrics-tls\") pod \"dns-default-92kfp\" (UID: \"2167e746-a49c-46e0-ab9c-0df48d88bb21\") " pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:59.766691 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:59.766666    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-92kfp"
Jul 15 19:15:59.851330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:59.851305    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54cf59cf7c-zrf42"]
Jul 15 19:15:59.854939 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:59.854916    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06197dbb_d062_45e6_80fc_8820bee91da9.slice/crio-da5d770e460bcf96699d5d5a19e32dd3980f159655a349091423e83a3f9699fb WatchSource:0}: Error finding container da5d770e460bcf96699d5d5a19e32dd3980f159655a349091423e83a3f9699fb: Status 404 returned error can't find the container with id da5d770e460bcf96699d5d5a19e32dd3980f159655a349091423e83a3f9699fb
Jul 15 19:15:59.908841 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:15:59.908817    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-92kfp"]
Jul 15 19:15:59.911517 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:15:59.911476    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2167e746_a49c_46e0_ab9c_0df48d88bb21.slice/crio-8f6ad6e3cc7df533e006a13c37a60cd218510bb67df8a48170f51cebb4462127 WatchSource:0}: Error finding container 8f6ad6e3cc7df533e006a13c37a60cd218510bb67df8a48170f51cebb4462127: Status 404 returned error can't find the container with id 8f6ad6e3cc7df533e006a13c37a60cd218510bb67df8a48170f51cebb4462127
Jul 15 19:16:00.844548 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:00.844508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-92kfp" event={"ID":"2167e746-a49c-46e0-ab9c-0df48d88bb21","Type":"ContainerStarted","Data":"8f6ad6e3cc7df533e006a13c37a60cd218510bb67df8a48170f51cebb4462127"}
Jul 15 19:16:00.845808 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:00.845784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42" event={"ID":"06197dbb-d062-45e6-80fc-8820bee91da9","Type":"ContainerStarted","Data":"1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42"}
Jul 15 19:16:00.845915 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:00.845825    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42" event={"ID":"06197dbb-d062-45e6-80fc-8820bee91da9","Type":"ContainerStarted","Data":"da5d770e460bcf96699d5d5a19e32dd3980f159655a349091423e83a3f9699fb"}
Jul 15 19:16:00.845915 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:00.845903    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:16:00.865731 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:00.865688    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42" podStartSLOduration=52.865674088 podStartE2EDuration="52.865674088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:00.864330152 +0000 UTC m=+52.862308543" watchObservedRunningTime="2026-07-15 19:16:00.865674088 +0000 UTC m=+52.863652491"
Jul 15 19:16:03.856028 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:03.855999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-92kfp" event={"ID":"2167e746-a49c-46e0-ab9c-0df48d88bb21","Type":"ContainerStarted","Data":"3bbd8ce19b64ba47a5d239dba82b5c1accf28e122b765518a4441d07af848aa0"}
Jul 15 19:16:03.856331 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:03.856077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-92kfp" event={"ID":"2167e746-a49c-46e0-ab9c-0df48d88bb21","Type":"ContainerStarted","Data":"9b78979987f5f3824baf50d61be407ea4cb89bb3aad4e722f8c4306492f96d12"}
Jul 15 19:16:03.856331 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:03.856148    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-92kfp"
Jul 15 19:16:03.873663 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:03.873622    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-92kfp" podStartSLOduration=17.41536087 podStartE2EDuration="20.873586747s" totalImagesPullingTime="3.458225877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:03.872892963 +0000 UTC m=+55.870871336" watchObservedRunningTime="2026-07-15 19:16:03.873586747 +0000 UTC m=+55.871565119"
Jul 15 19:16:08.767585 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:08.767562    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dphc6"
Jul 15 19:16:13.861281 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:13.861248    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-92kfp"
Jul 15 19:16:14.226072 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.225985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:16:14.228668 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.228646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6222\" (UniqueName: \"kubernetes.io/projected/b191c7e0-dd57-4466-a903-2da9967e06bb-kube-api-access-w6222\") pod \"network-check-target-ghnzc\" (UID: \"b191c7e0-dd57-4466-a903-2da9967e06bb\") " pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:16:14.273646 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.273622    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pzvzj\""
Jul 15 19:16:14.281794 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.281772    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:16:14.326589 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.326549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:16:14.326589 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.326588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:16:14.329355 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.329325    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:16:14.329729 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.329365    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:16:14.339621 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.339595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e447e5a-2320-465c-a36f-98877669e84f-metrics-certs\") pod \"network-metrics-daemon-4z6xs\" (UID: \"5e447e5a-2320-465c-a36f-98877669e84f\") " pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:16:14.339738 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.339716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc231b65-f3b6-4d93-86f3-127b91e5003b-original-pull-secret\") pod \"global-pull-secret-syncer-5k58n\" (UID: \"bc231b65-f3b6-4d93-86f3-127b91e5003b\") " pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:16:14.400140 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.400115    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ghnzc"]
Jul 15 19:16:14.402936 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:14.402904    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb191c7e0_dd57_4466_a903_2da9967e06bb.slice/crio-aa331e14c9aa3681fd6046fa91fede2bc6665896846bd446b632cb40e0cd0f5f WatchSource:0}: Error finding container aa331e14c9aa3681fd6046fa91fede2bc6665896846bd446b632cb40e0cd0f5f: Status 404 returned error can't find the container with id aa331e14c9aa3681fd6046fa91fede2bc6665896846bd446b632cb40e0cd0f5f
Jul 15 19:16:14.577758 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.577734    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5k58n"
Jul 15 19:16:14.585744 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.585725    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6x7t\""
Jul 15 19:16:14.593757 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.593740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4z6xs"
Jul 15 19:16:14.698234 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.698208    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5k58n"]
Jul 15 19:16:14.701588 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:14.701554    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc231b65_f3b6_4d93_86f3_127b91e5003b.slice/crio-6b155456b7f8aed8b92d08e04021a94a118cf77e7264a4001dd1f66bfd34fb9a WatchSource:0}: Error finding container 6b155456b7f8aed8b92d08e04021a94a118cf77e7264a4001dd1f66bfd34fb9a: Status 404 returned error can't find the container with id 6b155456b7f8aed8b92d08e04021a94a118cf77e7264a4001dd1f66bfd34fb9a
Jul 15 19:16:14.713528 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.713503    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4z6xs"]
Jul 15 19:16:14.715961 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:14.715942    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e447e5a_2320_465c_a36f_98877669e84f.slice/crio-20d83da286f30f1c3f354b01ffbeaa83ddedaa10235063d344b6b9b6b8107215 WatchSource:0}: Error finding container 20d83da286f30f1c3f354b01ffbeaa83ddedaa10235063d344b6b9b6b8107215: Status 404 returned error can't find the container with id 20d83da286f30f1c3f354b01ffbeaa83ddedaa10235063d344b6b9b6b8107215
Jul 15 19:16:14.893099 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.893031    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4z6xs" event={"ID":"5e447e5a-2320-465c-a36f-98877669e84f","Type":"ContainerStarted","Data":"20d83da286f30f1c3f354b01ffbeaa83ddedaa10235063d344b6b9b6b8107215"}
Jul 15 19:16:14.894387 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.894365    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ghnzc" event={"ID":"b191c7e0-dd57-4466-a903-2da9967e06bb","Type":"ContainerStarted","Data":"20f99a8d27982dbfcd6b6c1a33133720c7afb99248bbdea2f9f5c6fb6cbb5088"}
Jul 15 19:16:14.894519 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.894405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ghnzc" event={"ID":"b191c7e0-dd57-4466-a903-2da9967e06bb","Type":"ContainerStarted","Data":"aa331e14c9aa3681fd6046fa91fede2bc6665896846bd446b632cb40e0cd0f5f"}
Jul 15 19:16:14.894519 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.894509    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:16:14.895470 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.895447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5k58n" event={"ID":"bc231b65-f3b6-4d93-86f3-127b91e5003b","Type":"ContainerStarted","Data":"6b155456b7f8aed8b92d08e04021a94a118cf77e7264a4001dd1f66bfd34fb9a"}
Jul 15 19:16:14.912739 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:14.912704    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ghnzc" podStartSLOduration=66.912692084 podStartE2EDuration="1m6.912692084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:14.912201738 +0000 UTC m=+66.910180111" watchObservedRunningTime="2026-07-15 19:16:14.912692084 +0000 UTC m=+66.910670451"
Jul 15 19:16:15.738031 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:15.738004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:16:15.740613 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:15.740590    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afbfb61-4e3b-4be6-af71-07deeefb81e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-zjhqb\" (UID: \"6afbfb61-4e3b-4be6-af71-07deeefb81e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:16:15.938613 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:15.938583    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hnk7g\""
Jul 15 19:16:15.945641 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:15.945621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"
Jul 15 19:16:16.249598 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:16.249572    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-zjhqb"]
Jul 15 19:16:16.252459 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:16.252435    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afbfb61_4e3b_4be6_af71_07deeefb81e9.slice/crio-b566722b2c0d61ad15cbe0d57c025944db17ba3381085dda311c194c47f310dd WatchSource:0}: Error finding container b566722b2c0d61ad15cbe0d57c025944db17ba3381085dda311c194c47f310dd: Status 404 returned error can't find the container with id b566722b2c0d61ad15cbe0d57c025944db17ba3381085dda311c194c47f310dd
Jul 15 19:16:16.907297 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:16.907229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4z6xs" event={"ID":"5e447e5a-2320-465c-a36f-98877669e84f","Type":"ContainerStarted","Data":"462097b2ec1a7c87b837e6e53058652e848b3aa4037b19c66a9ce4f54a8b9e4a"}
Jul 15 19:16:16.907431 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:16.907302    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4z6xs" event={"ID":"5e447e5a-2320-465c-a36f-98877669e84f","Type":"ContainerStarted","Data":"a0b56ead8ca46d3e00535aeab6c5940c5716dc442a73e765a76c65fd01805c9f"}
Jul 15 19:16:16.908418 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:16.908393    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb" event={"ID":"6afbfb61-4e3b-4be6-af71-07deeefb81e9","Type":"ContainerStarted","Data":"b566722b2c0d61ad15cbe0d57c025944db17ba3381085dda311c194c47f310dd"}
Jul 15 19:16:16.924285 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:16.924243    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4z6xs" podStartSLOduration=67.136616581 podStartE2EDuration="1m8.924230819s" totalImagesPullingTime="1.787614238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:16.923082268 +0000 UTC m=+68.921060661" watchObservedRunningTime="2026-07-15 19:16:16.924230819 +0000 UTC m=+68.922209190"
Jul 15 19:16:17.452978 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.452946    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm"]
Jul 15 19:16:17.489411 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.489381    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"]
Jul 15 19:16:17.489735 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.489520    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm"
Jul 15 19:16:17.492255 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.492232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2frsg\""
Jul 15 19:16:17.492695 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.492678    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 19:16:17.493111 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.493095    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:16:17.501082 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.501063    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"]
Jul 15 19:16:17.501178 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.501164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"
Jul 15 19:16:17.503641 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.503620    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 19:16:17.504397 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.504380    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 19:16:17.504532 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.504513    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xxdq7\""
Jul 15 19:16:17.504610 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.504536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 19:16:17.505651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.505637    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 19:16:17.523148 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.523129    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm"]
Jul 15 19:16:17.523148 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.523140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.523279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.523173    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"]
Jul 15 19:16:17.523279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.523189    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"]
Jul 15 19:16:17.523279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.523205    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"]
Jul 15 19:16:17.525960 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.525946    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 19:16:17.526149 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.526135    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 19:16:17.526217 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.526136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 19:16:17.526217 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.526181    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 19:16:17.543077 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.543049    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-qkjjm"]
Jul 15 19:16:17.543203 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.543141    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"
Jul 15 19:16:17.547015 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.546999    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5gvqv\""
Jul 15 19:16:17.547148 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.547015    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 19:16:17.547148 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.547035    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:16:17.547517 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.547503    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 19:16:17.550032 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.550012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/666293fe-32d3-4199-ae80-9d17b3c4dbde-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.550124 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.550043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.550124 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.550061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9smm6\" (UniqueName: \"kubernetes.io/projected/666293fe-32d3-4199-ae80-9d17b3c4dbde-kube-api-access-9smm6\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.550124 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.550102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmtgv\" (UniqueName: \"kubernetes.io/projected/3d5b8e3e-053b-4a92-a282-9051431890a0-kube-api-access-xmtgv\") pod \"managed-serviceaccount-addon-agent-84546db78b-82cvc\" (UID: \"3d5b8e3e-053b-4a92-a282-9051431890a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"
Jul 15 19:16:17.550279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.550125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.550279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.550139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhmrn\" (UniqueName: \"kubernetes.io/projected/90013186-895d-441d-996a-233fccde0e33-kube-api-access-nhmrn\") pod \"volume-data-source-validator-78495597f6-b7rnm\" (UID: \"90013186-895d-441d-996a-233fccde0e33\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm"
Jul 15 19:16:17.550279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.550199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-ca\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.550279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.550227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-hub\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.550279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.550257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d5b8e3e-053b-4a92-a282-9051431890a0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84546db78b-82cvc\" (UID: \"3d5b8e3e-053b-4a92-a282-9051431890a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"
Jul 15 19:16:17.561224 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.561204    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8vnwb"]
Jul 15 19:16:17.561346 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.561327    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.564313 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.564295    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 19:16:17.564965 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.564939    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 19:16:17.565074 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.565005    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:16:17.566548 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.566532    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tjdnq\""
Jul 15 19:16:17.566867 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.566850    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 19:16:17.570104 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.570088    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 19:16:17.583192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.583172    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"]
Jul 15 19:16:17.583307 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.583293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.589248 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.589105    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 19:16:17.589248 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.589185    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 19:16:17.589401 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.589305    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 19:16:17.589456 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.589432    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-l5x78\""
Jul 15 19:16:17.591594 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.591575    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 19:16:17.594113 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.594093    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 19:16:17.605477 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.605448    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"]
Jul 15 19:16:17.605590 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.605518    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-qkjjm"]
Jul 15 19:16:17.605590 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.605539    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"]
Jul 15 19:16:17.605590 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.605559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8vnwb"]
Jul 15 19:16:17.605590 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.605592    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54cf59cf7c-zrf42"]
Jul 15 19:16:17.605787 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.605616    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b89bdf754-j46cg"]
Jul 15 19:16:17.605787 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.605718    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.609580 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.609560    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 19:16:17.612387 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.612349    2562 patch_prober.go:28] interesting pod/image-registry-54cf59cf7c-zrf42 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 19:16:17.612507 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.612433    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42" podUID="06197dbb-d062-45e6-80fc-8820bee91da9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:16:17.624868 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.624804    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"]
Jul 15 19:16:17.624969 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.624916    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.628848 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.628829    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4r6ts\""
Jul 15 19:16:17.629663 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.629644    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 19:16:17.630039 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.629649    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 19:16:17.630134 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.629937    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 19:16:17.630301 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.629980    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 19:16:17.631655 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.631634    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 19:16:17.631959 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.631768    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 19:16:17.649024 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.649000    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"]
Jul 15 19:16:17.649130 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.649028    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b89bdf754-j46cg"]
Jul 15 19:16:17.649130 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.649097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.650744 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm2lk\" (UniqueName: \"kubernetes.io/projected/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-kube-api-access-rm2lk\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.650837 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b51a70e3-c9da-425a-a02a-06d875456490-stats-auth\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.650837 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/060df79a-00dd-4e6d-95ee-1d308717c125-serving-cert\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.650837 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7n7z\" (UniqueName: \"kubernetes.io/projected/b51a70e3-c9da-425a-a02a-06d875456490-kube-api-access-f7n7z\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.651004 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-tmp\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.651004 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87r9x\" (UniqueName: \"kubernetes.io/projected/060df79a-00dd-4e6d-95ee-1d308717c125-kube-api-access-87r9x\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.651004 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/060df79a-00dd-4e6d-95ee-1d308717c125-config\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.651004 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650944    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58c839c6-9dbf-4913-8f0a-42bf2e433f85-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9999876d-n94wg\" (UID: \"58c839c6-9dbf-4913-8f0a-42bf2e433f85\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.651004 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-ca\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.651004 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.650996    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10c2d3f4-95fb-4e74-871c-b4934e4b692c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45p7n\" (UID: \"10c2d3f4-95fb-4e74-871c-b4934e4b692c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651021    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-hub\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d5b8e3e-053b-4a92-a282-9051431890a0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84546db78b-82cvc\" (UID: \"3d5b8e3e-053b-4a92-a282-9051431890a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/060df79a-00dd-4e6d-95ee-1d308717c125-trusted-ca\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51a70e3-c9da-425a-a02a-06d875456490-metrics-certs\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651110    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-serving-cert\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51a70e3-c9da-425a-a02a-06d875456490-service-ca-bundle\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58c839c6-9dbf-4913-8f0a-42bf2e433f85-tmp\") pod \"klusterlet-addon-workmgr-6b9999876d-n94wg\" (UID: \"58c839c6-9dbf-4913-8f0a-42bf2e433f85\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/666293fe-32d3-4199-ae80-9d17b3c4dbde-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.651300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntdb9\" (UniqueName: \"kubernetes.io/projected/10c2d3f4-95fb-4e74-871c-b4934e4b692c-kube-api-access-ntdb9\") pod \"cluster-samples-operator-65db858894-45p7n\" (UID: \"10c2d3f4-95fb-4e74-871c-b4934e4b692c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"
Jul 15 19:16:17.651865 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bgs2\" (UniqueName: \"kubernetes.io/projected/58c839c6-9dbf-4913-8f0a-42bf2e433f85-kube-api-access-4bgs2\") pod \"klusterlet-addon-workmgr-6b9999876d-n94wg\" (UID: \"58c839c6-9dbf-4913-8f0a-42bf2e433f85\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.651865 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.651865 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9smm6\" (UniqueName: \"kubernetes.io/projected/666293fe-32d3-4199-ae80-9d17b3c4dbde-kube-api-access-9smm6\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.651865 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmtgv\" (UniqueName: \"kubernetes.io/projected/3d5b8e3e-053b-4a92-a282-9051431890a0-kube-api-access-xmtgv\") pod \"managed-serviceaccount-addon-agent-84546db78b-82cvc\" (UID: \"3d5b8e3e-053b-4a92-a282-9051431890a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"
Jul 15 19:16:17.651865 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.651865 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-snapshots\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.651865 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.651865 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhmrn\" (UniqueName: \"kubernetes.io/projected/90013186-895d-441d-996a-233fccde0e33-kube-api-access-nhmrn\") pod \"volume-data-source-validator-78495597f6-b7rnm\" (UID: \"90013186-895d-441d-996a-233fccde0e33\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm"
Jul 15 19:16:17.652251 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.651901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b51a70e3-c9da-425a-a02a-06d875456490-default-certificate\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.652251 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.652097    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/666293fe-32d3-4199-ae80-9d17b3c4dbde-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.655122 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.655098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-ca\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.655372 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.655317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.655461 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.655447    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d5b8e3e-053b-4a92-a282-9051431890a0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84546db78b-82cvc\" (UID: \"3d5b8e3e-053b-4a92-a282-9051431890a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"
Jul 15 19:16:17.655595 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.655573    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-hub\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.655891 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.655873    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/666293fe-32d3-4199-ae80-9d17b3c4dbde-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.659615 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.659593    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-p25p9\""
Jul 15 19:16:17.659706 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.659647    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 19:16:17.659706 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.659668    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 19:16:17.660465 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.660449    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 19:16:17.660621 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.660484    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 19:16:17.670646 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.670628    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b67c88554-rwkts"]
Jul 15 19:16:17.692717 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.692696    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.694068 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.694049    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9smm6\" (UniqueName: \"kubernetes.io/projected/666293fe-32d3-4199-ae80-9d17b3c4dbde-kube-api-access-9smm6\") pod \"cluster-proxy-proxy-agent-7c4b66845d-fb2zp\" (UID: \"666293fe-32d3-4199-ae80-9d17b3c4dbde\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.695213 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.695189    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhmrn\" (UniqueName: \"kubernetes.io/projected/90013186-895d-441d-996a-233fccde0e33-kube-api-access-nhmrn\") pod \"volume-data-source-validator-78495597f6-b7rnm\" (UID: \"90013186-895d-441d-996a-233fccde0e33\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm"
Jul 15 19:16:17.695316 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.695256    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmtgv\" (UniqueName: \"kubernetes.io/projected/3d5b8e3e-053b-4a92-a282-9051431890a0-kube-api-access-xmtgv\") pod \"managed-serviceaccount-addon-agent-84546db78b-82cvc\" (UID: \"3d5b8e3e-053b-4a92-a282-9051431890a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"
Jul 15 19:16:17.712683 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.712659    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b67c88554-rwkts"]
Jul 15 19:16:17.752504 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fb27c73-f28d-4211-9526-8b8c8f212878-registry-certificates\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.752644 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7nrn\" (UniqueName: \"kubernetes.io/projected/bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280-kube-api-access-z7nrn\") pod \"cluster-monitoring-operator-5f7f494dd4-fdkmm\" (UID: \"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.752644 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-serving-cert\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.752644 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.752644 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51a70e3-c9da-425a-a02a-06d875456490-service-ca-bundle\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.752860 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58c839c6-9dbf-4913-8f0a-42bf2e433f85-tmp\") pod \"klusterlet-addon-workmgr-6b9999876d-n94wg\" (UID: \"58c839c6-9dbf-4913-8f0a-42bf2e433f85\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.752860 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fb27c73-f28d-4211-9526-8b8c8f212878-trusted-ca\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.752860 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntdb9\" (UniqueName: \"kubernetes.io/projected/10c2d3f4-95fb-4e74-871c-b4934e4b692c-kube-api-access-ntdb9\") pod \"cluster-samples-operator-65db858894-45p7n\" (UID: \"10c2d3f4-95fb-4e74-871c-b4934e4b692c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"
Jul 15 19:16:17.752860 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bgs2\" (UniqueName: \"kubernetes.io/projected/58c839c6-9dbf-4913-8f0a-42bf2e433f85-kube-api-access-4bgs2\") pod \"klusterlet-addon-workmgr-6b9999876d-n94wg\" (UID: \"58c839c6-9dbf-4913-8f0a-42bf2e433f85\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.752860 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.752860 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fdkmm\" (UID: \"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.753138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-snapshots\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.753138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwfjs\" (UniqueName: \"kubernetes.io/projected/5fb27c73-f28d-4211-9526-8b8c8f212878-kube-api-access-wwfjs\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.753138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b51a70e3-c9da-425a-a02a-06d875456490-default-certificate\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.753138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.752958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fb27c73-f28d-4211-9526-8b8c8f212878-installation-pull-secrets\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.753333 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58c839c6-9dbf-4913-8f0a-42bf2e433f85-tmp\") pod \"klusterlet-addon-workmgr-6b9999876d-n94wg\" (UID: \"58c839c6-9dbf-4913-8f0a-42bf2e433f85\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.753789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753539    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.753789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fb27c73-f28d-4211-9526-8b8c8f212878-ca-trust-extracted\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.753789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2lk\" (UniqueName: \"kubernetes.io/projected/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-kube-api-access-rm2lk\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.753789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b51a70e3-c9da-425a-a02a-06d875456490-stats-auth\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.753789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/060df79a-00dd-4e6d-95ee-1d308717c125-serving-cert\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.753789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n7z\" (UniqueName: \"kubernetes.io/projected/b51a70e3-c9da-425a-a02a-06d875456490-kube-api-access-f7n7z\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.753789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-tmp\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.753789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87r9x\" (UniqueName: \"kubernetes.io/projected/060df79a-00dd-4e6d-95ee-1d308717c125-kube-api-access-87r9x\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/060df79a-00dd-4e6d-95ee-1d308717c125-config\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fdkmm\" (UID: \"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58c839c6-9dbf-4913-8f0a-42bf2e433f85-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9999876d-n94wg\" (UID: \"58c839c6-9dbf-4913-8f0a-42bf2e433f85\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fb27c73-f28d-4211-9526-8b8c8f212878-image-registry-private-configuration\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10c2d3f4-95fb-4e74-871c-b4934e4b692c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45p7n\" (UID: \"10c2d3f4-95fb-4e74-871c-b4934e4b692c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fb27c73-f28d-4211-9526-8b8c8f212878-bound-sa-token\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.753971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/060df79a-00dd-4e6d-95ee-1d308717c125-trusted-ca\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.754000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51a70e3-c9da-425a-a02a-06d875456490-metrics-certs\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.754024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fb27c73-f28d-4211-9526-8b8c8f212878-registry-tls\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.754271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-snapshots\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.755013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/060df79a-00dd-4e6d-95ee-1d308717c125-config\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.755100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-tmp\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.755330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.755293    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51a70e3-c9da-425a-a02a-06d875456490-service-ca-bundle\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.756962 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.756112    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/060df79a-00dd-4e6d-95ee-1d308717c125-trusted-ca\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.756962 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.756275    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.756962 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.756477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-serving-cert\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.756962 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.756949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58c839c6-9dbf-4913-8f0a-42bf2e433f85-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9999876d-n94wg\" (UID: \"58c839c6-9dbf-4913-8f0a-42bf2e433f85\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.757896 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.757870    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b51a70e3-c9da-425a-a02a-06d875456490-default-certificate\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.758343 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.758317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b51a70e3-c9da-425a-a02a-06d875456490-stats-auth\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.758672 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.758632    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10c2d3f4-95fb-4e74-871c-b4934e4b692c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45p7n\" (UID: \"10c2d3f4-95fb-4e74-871c-b4934e4b692c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"
Jul 15 19:16:17.758749 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.758726    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51a70e3-c9da-425a-a02a-06d875456490-metrics-certs\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.759719 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.759699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/060df79a-00dd-4e6d-95ee-1d308717c125-serving-cert\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.765301 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.765279    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntdb9\" (UniqueName: \"kubernetes.io/projected/10c2d3f4-95fb-4e74-871c-b4934e4b692c-kube-api-access-ntdb9\") pod \"cluster-samples-operator-65db858894-45p7n\" (UID: \"10c2d3f4-95fb-4e74-871c-b4934e4b692c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"
Jul 15 19:16:17.772461 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.772436    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bgs2\" (UniqueName: \"kubernetes.io/projected/58c839c6-9dbf-4913-8f0a-42bf2e433f85-kube-api-access-4bgs2\") pod \"klusterlet-addon-workmgr-6b9999876d-n94wg\" (UID: \"58c839c6-9dbf-4913-8f0a-42bf2e433f85\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.772753 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.772727    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7n7z\" (UniqueName: \"kubernetes.io/projected/b51a70e3-c9da-425a-a02a-06d875456490-kube-api-access-f7n7z\") pod \"router-default-b89bdf754-j46cg\" (UID: \"b51a70e3-c9da-425a-a02a-06d875456490\") " pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.772895 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.772879    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87r9x\" (UniqueName: \"kubernetes.io/projected/060df79a-00dd-4e6d-95ee-1d308717c125-kube-api-access-87r9x\") pod \"console-operator-7866497494-qkjjm\" (UID: \"060df79a-00dd-4e6d-95ee-1d308717c125\") " pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.773317 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.773295    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm2lk\" (UniqueName: \"kubernetes.io/projected/b170f5ff-c899-4db4-bbb0-a4e06a1c431d-kube-api-access-rm2lk\") pod \"insights-operator-68d9dd94cf-8vnwb\" (UID: \"b170f5ff-c899-4db4-bbb0-a4e06a1c431d\") " pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.800710 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.800689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm"
Jul 15 19:16:17.819868 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.818922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"
Jul 15 19:16:17.833256 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.832019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"
Jul 15 19:16:17.854600 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fdkmm\" (UID: \"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.854600 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fb27c73-f28d-4211-9526-8b8c8f212878-image-registry-private-configuration\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.854600 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fb27c73-f28d-4211-9526-8b8c8f212878-bound-sa-token\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.854821 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fb27c73-f28d-4211-9526-8b8c8f212878-registry-tls\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.854821 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fb27c73-f28d-4211-9526-8b8c8f212878-registry-certificates\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.854821 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7nrn\" (UniqueName: \"kubernetes.io/projected/bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280-kube-api-access-z7nrn\") pod \"cluster-monitoring-operator-5f7f494dd4-fdkmm\" (UID: \"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.854821 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fb27c73-f28d-4211-9526-8b8c8f212878-trusted-ca\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.854821 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fdkmm\" (UID: \"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.854821 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwfjs\" (UniqueName: \"kubernetes.io/projected/5fb27c73-f28d-4211-9526-8b8c8f212878-kube-api-access-wwfjs\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.855105 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fb27c73-f28d-4211-9526-8b8c8f212878-installation-pull-secrets\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.855105 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.854858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fb27c73-f28d-4211-9526-8b8c8f212878-ca-trust-extracted\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.856095 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.855214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fb27c73-f28d-4211-9526-8b8c8f212878-ca-trust-extracted\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.856095 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.855249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fdkmm\" (UID: \"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.856539 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.856408    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fb27c73-f28d-4211-9526-8b8c8f212878-registry-certificates\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.856624 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.856482    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fb27c73-f28d-4211-9526-8b8c8f212878-trusted-ca\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.858195 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.858167    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fb27c73-f28d-4211-9526-8b8c8f212878-registry-tls\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.859027 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.858981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fb27c73-f28d-4211-9526-8b8c8f212878-image-registry-private-configuration\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.859613 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.859538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fb27c73-f28d-4211-9526-8b8c8f212878-installation-pull-secrets\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.859613 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.859572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fdkmm\" (UID: \"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.859755 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.859613    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"
Jul 15 19:16:17.869803 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.869747    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7nrn\" (UniqueName: \"kubernetes.io/projected/bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280-kube-api-access-z7nrn\") pod \"cluster-monitoring-operator-5f7f494dd4-fdkmm\" (UID: \"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:17.871175 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.871149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwfjs\" (UniqueName: \"kubernetes.io/projected/5fb27c73-f28d-4211-9526-8b8c8f212878-kube-api-access-wwfjs\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.871295 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.871278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:17.871786 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.871755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fb27c73-f28d-4211-9526-8b8c8f212878-bound-sa-token\") pod \"image-registry-6b67c88554-rwkts\" (UID: \"5fb27c73-f28d-4211-9526-8b8c8f212878\") " pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:17.895905 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.895847    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb"
Jul 15 19:16:17.917985 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.917961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:17.937088 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.936988    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:17.974367 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:17.973941    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"
Jul 15 19:16:18.001599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.001570    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm"]
Jul 15 19:16:18.009926 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:18.009890    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90013186_895d_441d_996a_233fccde0e33.slice/crio-8bc717c53fdb518b91cc8bfab0ea45b7533ca1fe554ad2e7f99bcbee5a7eeba1 WatchSource:0}: Error finding container 8bc717c53fdb518b91cc8bfab0ea45b7533ca1fe554ad2e7f99bcbee5a7eeba1: Status 404 returned error can't find the container with id 8bc717c53fdb518b91cc8bfab0ea45b7533ca1fe554ad2e7f99bcbee5a7eeba1
Jul 15 19:16:18.014551 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.014303    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:18.041651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.041584    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc"]
Jul 15 19:16:18.089401 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.086336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp"]
Jul 15 19:16:18.100100 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:18.097640    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod666293fe_32d3_4199_ae80_9d17b3c4dbde.slice/crio-0b28ae673ca49367c012f7a61daee73fe803eac8ff87e746d9066ce6f71b12d3 WatchSource:0}: Error finding container 0b28ae673ca49367c012f7a61daee73fe803eac8ff87e746d9066ce6f71b12d3: Status 404 returned error can't find the container with id 0b28ae673ca49367c012f7a61daee73fe803eac8ff87e746d9066ce6f71b12d3
Jul 15 19:16:18.146820 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.146215    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n"]
Jul 15 19:16:18.196908 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.196450    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8vnwb"]
Jul 15 19:16:18.212786 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:18.212716    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb170f5ff_c899_4db4_bbb0_a4e06a1c431d.slice/crio-c53142ad49459bf11478c9e49af3d03c6a023f3a3b6f9d724bbd878771e6eaa2 WatchSource:0}: Error finding container c53142ad49459bf11478c9e49af3d03c6a023f3a3b6f9d724bbd878771e6eaa2: Status 404 returned error can't find the container with id c53142ad49459bf11478c9e49af3d03c6a023f3a3b6f9d724bbd878771e6eaa2
Jul 15 19:16:18.228485 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.228463    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-qkjjm"]
Jul 15 19:16:18.232779 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:18.232712    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060df79a_00dd_4e6d_95ee_1d308717c125.slice/crio-0403830775bd61b4d64f5f3d0bb8edb0f9dc6790f9b37f17471fff691fbf2bc6 WatchSource:0}: Error finding container 0403830775bd61b4d64f5f3d0bb8edb0f9dc6790f9b37f17471fff691fbf2bc6: Status 404 returned error can't find the container with id 0403830775bd61b4d64f5f3d0bb8edb0f9dc6790f9b37f17471fff691fbf2bc6
Jul 15 19:16:18.248506 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.248453    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"]
Jul 15 19:16:18.251372 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:18.251344    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c839c6_9dbf_4913_8f0a_42bf2e433f85.slice/crio-3454be75596bd6ccf452883f70cf864d90ce893aa7e31cebee3c18e10251cafd WatchSource:0}: Error finding container 3454be75596bd6ccf452883f70cf864d90ce893aa7e31cebee3c18e10251cafd: Status 404 returned error can't find the container with id 3454be75596bd6ccf452883f70cf864d90ce893aa7e31cebee3c18e10251cafd
Jul 15 19:16:18.280779 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.280725    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm"]
Jul 15 19:16:18.282254 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:18.282226    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca73b7e_e2ec_48fd_aaee_5fa5d2ab3280.slice/crio-372fdf8add2ab3563ba32e27ca96e3359be899d3060911e4a12cf1f925f0b485 WatchSource:0}: Error finding container 372fdf8add2ab3563ba32e27ca96e3359be899d3060911e4a12cf1f925f0b485: Status 404 returned error can't find the container with id 372fdf8add2ab3563ba32e27ca96e3359be899d3060911e4a12cf1f925f0b485
Jul 15 19:16:18.295196 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.295171    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b89bdf754-j46cg"]
Jul 15 19:16:18.296895 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:18.296869    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51a70e3_c9da_425a_a02a_06d875456490.slice/crio-40378487f2e024d6eecde07690c97b410bb3418b2f32c6853f97bbce6bf20abc WatchSource:0}: Error finding container 40378487f2e024d6eecde07690c97b410bb3418b2f32c6853f97bbce6bf20abc: Status 404 returned error can't find the container with id 40378487f2e024d6eecde07690c97b410bb3418b2f32c6853f97bbce6bf20abc
Jul 15 19:16:18.316901 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.316876    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b67c88554-rwkts"]
Jul 15 19:16:18.319348 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:18.319326    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb27c73_f28d_4211_9526_8b8c8f212878.slice/crio-1bc3f5d1daa2212823edc02701cee3c74a2d88883ddd295ccd74382b2c2b9c34 WatchSource:0}: Error finding container 1bc3f5d1daa2212823edc02701cee3c74a2d88883ddd295ccd74382b2c2b9c34: Status 404 returned error can't find the container with id 1bc3f5d1daa2212823edc02701cee3c74a2d88883ddd295ccd74382b2c2b9c34
Jul 15 19:16:18.925805 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.925712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm" event={"ID":"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280","Type":"ContainerStarted","Data":"372fdf8add2ab3563ba32e27ca96e3359be899d3060911e4a12cf1f925f0b485"}
Jul 15 19:16:18.929671 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.928740    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b89bdf754-j46cg" event={"ID":"b51a70e3-c9da-425a-a02a-06d875456490","Type":"ContainerStarted","Data":"6f72b326c743c8d3460cb6cd64b0a3f8b3a841820c2cf40e02473f66d67657e4"}
Jul 15 19:16:18.929671 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.928797    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b89bdf754-j46cg" event={"ID":"b51a70e3-c9da-425a-a02a-06d875456490","Type":"ContainerStarted","Data":"40378487f2e024d6eecde07690c97b410bb3418b2f32c6853f97bbce6bf20abc"}
Jul 15 19:16:18.931319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.931224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc" event={"ID":"3d5b8e3e-053b-4a92-a282-9051431890a0","Type":"ContainerStarted","Data":"61be4a9806ef78ee8cff3ebe7118f3a1f20c21e05a8b96ddeb368dd80f2daef1"}
Jul 15 19:16:18.937028 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.933345    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qkjjm" event={"ID":"060df79a-00dd-4e6d-95ee-1d308717c125","Type":"ContainerStarted","Data":"0403830775bd61b4d64f5f3d0bb8edb0f9dc6790f9b37f17471fff691fbf2bc6"}
Jul 15 19:16:18.937748 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.937693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:18.939074 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.939011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb" event={"ID":"b170f5ff-c899-4db4-bbb0-a4e06a1c431d","Type":"ContainerStarted","Data":"c53142ad49459bf11478c9e49af3d03c6a023f3a3b6f9d724bbd878771e6eaa2"}
Jul 15 19:16:18.940626 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.940587    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:18.944146 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.944090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm" event={"ID":"90013186-895d-441d-996a-233fccde0e33","Type":"ContainerStarted","Data":"8bc717c53fdb518b91cc8bfab0ea45b7533ca1fe554ad2e7f99bcbee5a7eeba1"}
Jul 15 19:16:18.948073 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.947365    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b67c88554-rwkts" event={"ID":"5fb27c73-f28d-4211-9526-8b8c8f212878","Type":"ContainerStarted","Data":"747a39cbc113d26fe6b18246d7b79ef88ddc4e5148600af97428334463d74010"}
Jul 15 19:16:18.948073 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.947407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b67c88554-rwkts" event={"ID":"5fb27c73-f28d-4211-9526-8b8c8f212878","Type":"ContainerStarted","Data":"1bc3f5d1daa2212823edc02701cee3c74a2d88883ddd295ccd74382b2c2b9c34"}
Jul 15 19:16:18.948073 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.947969    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:18.952351 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.952294    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg" event={"ID":"58c839c6-9dbf-4913-8f0a-42bf2e433f85","Type":"ContainerStarted","Data":"3454be75596bd6ccf452883f70cf864d90ce893aa7e31cebee3c18e10251cafd"}
Jul 15 19:16:18.958287 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.955227    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b89bdf754-j46cg" podStartSLOduration=1.955209693 podStartE2EDuration="1.955209693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:18.954008108 +0000 UTC m=+70.951986481" watchObservedRunningTime="2026-07-15 19:16:18.955209693 +0000 UTC m=+70.953188070"
Jul 15 19:16:18.958287 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.957352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp" event={"ID":"666293fe-32d3-4199-ae80-9d17b3c4dbde","Type":"ContainerStarted","Data":"0b28ae673ca49367c012f7a61daee73fe803eac8ff87e746d9066ce6f71b12d3"}
Jul 15 19:16:18.959528 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:18.959426    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n" event={"ID":"10c2d3f4-95fb-4e74-871c-b4934e4b692c","Type":"ContainerStarted","Data":"34829f742fd193847c192ef814f376b4a983e6954738fcf306b2e8988f90b7a1"}
Jul 15 19:16:19.981284 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:19.981260    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:19.988205 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:19.987975    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b89bdf754-j46cg"
Jul 15 19:16:20.007809 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:20.006954    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b67c88554-rwkts" podStartSLOduration=3.006935363 podStartE2EDuration="3.006935363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:18.999758446 +0000 UTC m=+70.997736837" watchObservedRunningTime="2026-07-15 19:16:20.006935363 +0000 UTC m=+72.004913737"
Jul 15 19:16:27.611603 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:27.611515    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:16:29.024171 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.024123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc" event={"ID":"3d5b8e3e-053b-4a92-a282-9051431890a0","Type":"ContainerStarted","Data":"3558967f726ee1a672b3a524ad898964558f8a8b156c24f5384bf69bf47240c3"}
Jul 15 19:16:29.026703 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.026672    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qkjjm" event={"ID":"060df79a-00dd-4e6d-95ee-1d308717c125","Type":"ContainerStarted","Data":"2852f22dffd7ad2d0adf4d8f960b0140a33acc33605f97e33e01d3b481ef7a9d"}
Jul 15 19:16:29.034689 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.034452    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:29.034689 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.034487    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:29.034689 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.034526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb" event={"ID":"b170f5ff-c899-4db4-bbb0-a4e06a1c431d","Type":"ContainerStarted","Data":"9ee9c108056e4165c5027301bd0d0cb0327d8964b7d9b1e7358e1b18aeed6ea0"}
Jul 15 19:16:29.034689 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.034550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm" event={"ID":"90013186-895d-441d-996a-233fccde0e33","Type":"ContainerStarted","Data":"f99261e18327e500a176ed509b7047633c11fbfb37e66a1dad0d1d16c871e34b"}
Jul 15 19:16:29.034689 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.034570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg" event={"ID":"58c839c6-9dbf-4913-8f0a-42bf2e433f85","Type":"ContainerStarted","Data":"87da3ab4d1d1f0e56ca5a468010510b82574274f66cc26792486bd349b44ff17"}
Jul 15 19:16:29.037353 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.037332    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg"
Jul 15 19:16:29.037566 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.037548    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp" event={"ID":"666293fe-32d3-4199-ae80-9d17b3c4dbde","Type":"ContainerStarted","Data":"ddfae924226b63237a036005b1dff43987e849c296e97deecf29d271e567e051"}
Jul 15 19:16:29.037791 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.037762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp" event={"ID":"666293fe-32d3-4199-ae80-9d17b3c4dbde","Type":"ContainerStarted","Data":"b6882d7be0d96412357051669043f01a1aebd2e306132e470771275e255ecb33"}
Jul 15 19:16:29.037994 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.037978    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp" event={"ID":"666293fe-32d3-4199-ae80-9d17b3c4dbde","Type":"ContainerStarted","Data":"4a5b0ac2c0934e87ecdc0eb90e54261841d4ba1ad5460810a8432e12f9bb60f7"}
Jul 15 19:16:29.039418 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.039375    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84546db78b-82cvc" podStartSLOduration=1.84288665 podStartE2EDuration="12.039359298s" totalImagesPullingTime="10.196472648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.038983547 +0000 UTC m=+81.036961935" watchObservedRunningTime="2026-07-15 19:16:29.039359298 +0000 UTC m=+81.037337672"
Jul 15 19:16:29.039947 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.039922    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5k58n" event={"ID":"bc231b65-f3b6-4d93-86f3-127b91e5003b","Type":"ContainerStarted","Data":"991823f18fe8cc58c1c89ac6d8d1a4e1ad59d6934af1dcfab14e62e2813044c2"}
Jul 15 19:16:29.041530 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.041403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-qkjjm"
Jul 15 19:16:29.043455 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.043139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n" event={"ID":"10c2d3f4-95fb-4e74-871c-b4934e4b692c","Type":"ContainerStarted","Data":"9a6b400b287c6c4f72e8f472ae71251d2e288c7c7169d798ef2f0df1d01c43f6"}
Jul 15 19:16:29.043455 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.043174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n" event={"ID":"10c2d3f4-95fb-4e74-871c-b4934e4b692c","Type":"ContainerStarted","Data":"7ab61126d384c4968b933590a6e9c4d1f4def250ad417e5f3d98e167ca02f327"}
Jul 15 19:16:29.044977 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.044944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb" event={"ID":"6afbfb61-4e3b-4be6-af71-07deeefb81e9","Type":"ContainerStarted","Data":"938a3723e4ea7ca8265f75736f99696157d1a99fbd44f9ce036f84c943041dee"}
Jul 15 19:16:29.047131 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.047072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm" event={"ID":"bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280","Type":"ContainerStarted","Data":"cbbca0f7319e0ef245e2a945740d01e9d75d0d59ec480f9cb02c82d868242dd6"}
Jul 15 19:16:29.056187 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.056148    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-8vnwb" podStartSLOduration=2.017891187 podStartE2EDuration="12.056132565s" totalImagesPullingTime="10.038241378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.055394829 +0000 UTC m=+81.053373221" watchObservedRunningTime="2026-07-15 19:16:29.056132565 +0000 UTC m=+81.054110939"
Jul 15 19:16:29.089040 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.088995    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9999876d-n94wg" podStartSLOduration=2.083002562 podStartE2EDuration="12.088979159s" totalImagesPullingTime="10.005976597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.088635398 +0000 UTC m=+81.086613777" watchObservedRunningTime="2026-07-15 19:16:29.088979159 +0000 UTC m=+81.086957516"
Jul 15 19:16:29.090358 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.090322    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-b7rnm" podStartSLOduration=1.850384251 podStartE2EDuration="12.090309627s" totalImagesPullingTime="10.239925376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.071272842 +0000 UTC m=+81.069251215" watchObservedRunningTime="2026-07-15 19:16:29.090309627 +0000 UTC m=+81.088288000"
Jul 15 19:16:29.105946 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.105903    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-qkjjm" podStartSLOduration=2.073309825 podStartE2EDuration="12.105888435s" totalImagesPullingTime="10.03257861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.105315808 +0000 UTC m=+81.103294179" watchObservedRunningTime="2026-07-15 19:16:29.105888435 +0000 UTC m=+81.103866809"
Jul 15 19:16:29.128826 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.128788    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4b66845d-fb2zp" podStartSLOduration=1.938329467 podStartE2EDuration="12.128766785s" totalImagesPullingTime="10.190437318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.128258661 +0000 UTC m=+81.126237045" watchObservedRunningTime="2026-07-15 19:16:29.128766785 +0000 UTC m=+81.126745160"
Jul 15 19:16:29.150872 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.150828    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-zjhqb" podStartSLOduration=40.088770897 podStartE2EDuration="50.150811929s" totalImagesPullingTime="10.062041032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.150449189 +0000 UTC m=+81.148427587" watchObservedRunningTime="2026-07-15 19:16:29.150811929 +0000 UTC m=+81.148790302"
Jul 15 19:16:29.167380 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.167336    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fdkmm" podStartSLOduration=2.197281763 podStartE2EDuration="12.167320051s" totalImagesPullingTime="9.970038288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.167256327 +0000 UTC m=+81.165234713" watchObservedRunningTime="2026-07-15 19:16:29.167320051 +0000 UTC m=+81.165298426"
Jul 15 19:16:29.220339 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.220294    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45p7n" podStartSLOduration=2.230578446 podStartE2EDuration="12.220281933s" totalImagesPullingTime="9.989703487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.219190577 +0000 UTC m=+81.217168953" watchObservedRunningTime="2026-07-15 19:16:29.220281933 +0000 UTC m=+81.218260341"
Jul 15 19:16:29.240443 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.240403    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5k58n" podStartSLOduration=67.688675856 podStartE2EDuration="1m21.240391517s" totalImagesPullingTime="13.551715661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:29.240158973 +0000 UTC m=+81.238137374" watchObservedRunningTime="2026-07-15 19:16:29.240391517 +0000 UTC m=+81.238369887"
Jul 15 19:16:29.723717 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.723684    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l9l5c"]
Jul 15 19:16:29.726975 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.726956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.729841 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.729821    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bl2wc\""
Jul 15 19:16:29.730109 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.730090    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 19:16:29.730975 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.730960    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 19:16:29.747669 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.747646    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l9l5c"]
Jul 15 19:16:29.790176 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.790156    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54cf59cf7c-zrf42_06197dbb-d062-45e6-80fc-8820bee91da9/registry/0.log"
Jul 15 19:16:29.796825 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.796803    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b67c88554-rwkts_5fb27c73-f28d-4211-9526-8b8c8f212878/registry/0.log"
Jul 15 19:16:29.887871 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.887846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ff45dc3-6024-4360-aebe-caaa349943d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.887956 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.887884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4hpk\" (UniqueName: \"kubernetes.io/projected/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-api-access-r4hpk\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.888002 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.887950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.888002 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.887975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ff45dc3-6024-4360-aebe-caaa349943d0-crio-socket\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.888063 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.888034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ff45dc3-6024-4360-aebe-caaa349943d0-data-volume\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.989154 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.989133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.989271 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.989164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ff45dc3-6024-4360-aebe-caaa349943d0-crio-socket\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.989271 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.989186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ff45dc3-6024-4360-aebe-caaa349943d0-data-volume\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.989271 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.989232    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ff45dc3-6024-4360-aebe-caaa349943d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.989271 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.989258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4hpk\" (UniqueName: \"kubernetes.io/projected/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-api-access-r4hpk\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.989456 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.989271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ff45dc3-6024-4360-aebe-caaa349943d0-crio-socket\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.989456 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:16:29.989347    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:16:29.989456 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:16:29.989360    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:16:29.989456 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:16:29.989416    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ff45dc3-6024-4360-aebe-caaa349943d0-insights-runtime-extractor-tls podName:3ff45dc3-6024-4360-aebe-caaa349943d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:16:30.489398647 +0000 UTC m=+82.487377008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ff45dc3-6024-4360-aebe-caaa349943d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9l5c" (UID: "3ff45dc3-6024-4360-aebe-caaa349943d0") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:16:29.989630 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:16:29.989466    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-rbac-proxy-cm podName:3ff45dc3-6024-4360-aebe-caaa349943d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:16:30.489424369 +0000 UTC m=+82.487402721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9l5c" (UID: "3ff45dc3-6024-4360-aebe-caaa349943d0") : configmap "kube-rbac-proxy" not found
Jul 15 19:16:29.989630 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.989524    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ff45dc3-6024-4360-aebe-caaa349943d0-data-volume\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:29.999834 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:29.999815    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4hpk\" (UniqueName: \"kubernetes.io/projected/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-api-access-r4hpk\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:30.110714 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:30.110692    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jndfh_795aeb1d-df26-44c4-ad4c-412575e35202/node-ca/0.log"
Jul 15 19:16:30.493266 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:30.493242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ff45dc3-6024-4360-aebe-caaa349943d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:30.493393 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:30.493289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:30.493393 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:16:30.493370    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:16:30.493454 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:16:30.493423    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-rbac-proxy-cm podName:3ff45dc3-6024-4360-aebe-caaa349943d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:16:31.493410553 +0000 UTC m=+83.491388904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9l5c" (UID: "3ff45dc3-6024-4360-aebe-caaa349943d0") : configmap "kube-rbac-proxy" not found
Jul 15 19:16:30.493454 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:16:30.493372    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:16:30.493543 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:16:30.493513    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ff45dc3-6024-4360-aebe-caaa349943d0-insights-runtime-extractor-tls podName:3ff45dc3-6024-4360-aebe-caaa349943d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:16:31.49348183 +0000 UTC m=+83.491460182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ff45dc3-6024-4360-aebe-caaa349943d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9l5c" (UID: "3ff45dc3-6024-4360-aebe-caaa349943d0") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:16:30.711051 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:30.711025    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b89bdf754-j46cg_b51a70e3-c9da-425a-a02a-06d875456490/router/0.log"
Jul 15 19:16:31.111792 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:31.111675    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qdgrw_98c6faa3-dd7d-4b59-85e8-4c37f32454d1/serve-healthcheck-canary/0.log"
Jul 15 19:16:31.501746 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:31.501715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:31.501916 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:31.501792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ff45dc3-6024-4360-aebe-caaa349943d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:31.502252 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:31.502226    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ff45dc3-6024-4360-aebe-caaa349943d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:31.504399 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:31.504361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ff45dc3-6024-4360-aebe-caaa349943d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9l5c\" (UID: \"3ff45dc3-6024-4360-aebe-caaa349943d0\") " pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:31.537570 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:31.537542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l9l5c"
Jul 15 19:16:31.662526 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:31.662482    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l9l5c"]
Jul 15 19:16:31.664257 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:31.664228    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff45dc3_6024_4360_aebe_caaa349943d0.slice/crio-5ebdbdf32842b9b7d4f11febb042d73771d4a2597160359149c212b18ca27d35 WatchSource:0}: Error finding container 5ebdbdf32842b9b7d4f11febb042d73771d4a2597160359149c212b18ca27d35: Status 404 returned error can't find the container with id 5ebdbdf32842b9b7d4f11febb042d73771d4a2597160359149c212b18ca27d35
Jul 15 19:16:32.061476 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:32.061435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9l5c" event={"ID":"3ff45dc3-6024-4360-aebe-caaa349943d0","Type":"ContainerStarted","Data":"5ebdbdf32842b9b7d4f11febb042d73771d4a2597160359149c212b18ca27d35"}
Jul 15 19:16:37.085109 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:37.085073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9l5c" event={"ID":"3ff45dc3-6024-4360-aebe-caaa349943d0","Type":"ContainerStarted","Data":"356426f464c89bb86ca55bcdfe97c6c8b9a1e735392aa72fec1305a2acdd0a0c"}
Jul 15 19:16:40.098225 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.098151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9l5c" event={"ID":"3ff45dc3-6024-4360-aebe-caaa349943d0","Type":"ContainerStarted","Data":"cde3ebf816effaadc299c53d4605bf4ed0da38683c8bd2e71f258f9cdbbac717"}
Jul 15 19:16:40.308671 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.308639    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v57kj"]
Jul 15 19:16:40.315101 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.313822    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.317360 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.317330    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q2bf5\""
Jul 15 19:16:40.320175 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.317525    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 19:16:40.320175 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.317798    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 19:16:40.320175 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.318886    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 19:16:40.320175 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.319146    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 19:16:40.379061 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.378989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrjws\" (UniqueName: \"kubernetes.io/projected/72ceca93-26fb-4030-a6c5-f06f11fe987e-kube-api-access-qrjws\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.379061 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.379033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72ceca93-26fb-4030-a6c5-f06f11fe987e-sys\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.379233 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.379069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-wtmp\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.379233 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.379101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-accelerators-collector-config\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.379233 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.379130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-textfile\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.379233 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.379147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-tls\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.379233 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.379227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.379537 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.379259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72ceca93-26fb-4030-a6c5-f06f11fe987e-metrics-client-ca\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.379537 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.379308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72ceca93-26fb-4030-a6c5-f06f11fe987e-root\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.479656 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72ceca93-26fb-4030-a6c5-f06f11fe987e-root\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.479781 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrjws\" (UniqueName: \"kubernetes.io/projected/72ceca93-26fb-4030-a6c5-f06f11fe987e-kube-api-access-qrjws\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.479781 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72ceca93-26fb-4030-a6c5-f06f11fe987e-sys\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.479781 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-wtmp\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.479781 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479733    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72ceca93-26fb-4030-a6c5-f06f11fe987e-root\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.480319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-accelerators-collector-config\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.480319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-textfile\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.480319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-tls\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.480319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.480319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.479965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72ceca93-26fb-4030-a6c5-f06f11fe987e-metrics-client-ca\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.480319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.480186    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72ceca93-26fb-4030-a6c5-f06f11fe987e-sys\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.483370 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.480654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-textfile\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.483370 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.480779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-wtmp\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.483370 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.480841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72ceca93-26fb-4030-a6c5-f06f11fe987e-metrics-client-ca\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.483370 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.480990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-accelerators-collector-config\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.491007 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.490981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrjws\" (UniqueName: \"kubernetes.io/projected/72ceca93-26fb-4030-a6c5-f06f11fe987e-kube-api-access-qrjws\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.495372 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.495333    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-tls\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.497986 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.497582    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72ceca93-26fb-4030-a6c5-f06f11fe987e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v57kj\" (UID: \"72ceca93-26fb-4030-a6c5-f06f11fe987e\") " pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.631518 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.631422    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v57kj"
Jul 15 19:16:40.647400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:16:40.647371    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ceca93_26fb_4030_a6c5_f06f11fe987e.slice/crio-99ab5700db6df74832818118c0333377771b125e4ef058fd859e85a7a028dd23 WatchSource:0}: Error finding container 99ab5700db6df74832818118c0333377771b125e4ef058fd859e85a7a028dd23: Status 404 returned error can't find the container with id 99ab5700db6df74832818118c0333377771b125e4ef058fd859e85a7a028dd23
Jul 15 19:16:40.993238 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:40.993211    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b67c88554-rwkts"
Jul 15 19:16:41.104834 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:41.104790    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v57kj" event={"ID":"72ceca93-26fb-4030-a6c5-f06f11fe987e","Type":"ContainerStarted","Data":"99ab5700db6df74832818118c0333377771b125e4ef058fd859e85a7a028dd23"}
Jul 15 19:16:42.634485 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:42.634432    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42" podUID="06197dbb-d062-45e6-80fc-8820bee91da9" containerName="registry" containerID="cri-o://1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42" gracePeriod=30
Jul 15 19:16:43.715012 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.714987    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:16:43.810672 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.810620    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-registry-certificates\") pod \"06197dbb-d062-45e6-80fc-8820bee91da9\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") "
Jul 15 19:16:43.810672 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.810654    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-bound-sa-token\") pod \"06197dbb-d062-45e6-80fc-8820bee91da9\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") "
Jul 15 19:16:43.810809 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.810693    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rm58q\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-kube-api-access-rm58q\") pod \"06197dbb-d062-45e6-80fc-8820bee91da9\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") "
Jul 15 19:16:43.810886 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.810866    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-installation-pull-secrets\") pod \"06197dbb-d062-45e6-80fc-8820bee91da9\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") "
Jul 15 19:16:43.810929 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.810916    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06197dbb-d062-45e6-80fc-8820bee91da9-ca-trust-extracted\") pod \"06197dbb-d062-45e6-80fc-8820bee91da9\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") "
Jul 15 19:16:43.811158 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.810969    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-trusted-ca\") pod \"06197dbb-d062-45e6-80fc-8820bee91da9\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") "
Jul 15 19:16:43.811158 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.811016    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "06197dbb-d062-45e6-80fc-8820bee91da9" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:16:43.811158 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.811021    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-image-registry-private-configuration\") pod \"06197dbb-d062-45e6-80fc-8820bee91da9\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") "
Jul 15 19:16:43.811158 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.811078    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") pod \"06197dbb-d062-45e6-80fc-8820bee91da9\" (UID: \"06197dbb-d062-45e6-80fc-8820bee91da9\") "
Jul 15 19:16:43.811375 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.811283    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-registry-certificates\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:16:43.811375 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.811326    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "06197dbb-d062-45e6-80fc-8820bee91da9" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:16:43.813350 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.813326    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "06197dbb-d062-45e6-80fc-8820bee91da9" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:16:43.813454 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.813334    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "06197dbb-d062-45e6-80fc-8820bee91da9" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:16:43.813454 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.813396    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-kube-api-access-rm58q" (OuterVolumeSpecName: "kube-api-access-rm58q") pod "06197dbb-d062-45e6-80fc-8820bee91da9" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9"). InnerVolumeSpecName "kube-api-access-rm58q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:16:43.813454 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.813427    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "06197dbb-d062-45e6-80fc-8820bee91da9" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:16:43.813454 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.813446    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "06197dbb-d062-45e6-80fc-8820bee91da9" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:16:43.819173 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.819151    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06197dbb-d062-45e6-80fc-8820bee91da9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "06197dbb-d062-45e6-80fc-8820bee91da9" (UID: "06197dbb-d062-45e6-80fc-8820bee91da9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:16:43.911579 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.911554    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm58q\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-kube-api-access-rm58q\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:16:43.911579 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.911577    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-installation-pull-secrets\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:16:43.911706 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.911591    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06197dbb-d062-45e6-80fc-8820bee91da9-ca-trust-extracted\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:16:43.911706 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.911604    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06197dbb-d062-45e6-80fc-8820bee91da9-trusted-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:16:43.911706 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.911617    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06197dbb-d062-45e6-80fc-8820bee91da9-image-registry-private-configuration\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:16:43.911706 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.911629    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-registry-tls\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:16:43.911706 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:43.911641    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06197dbb-d062-45e6-80fc-8820bee91da9-bound-sa-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:16:44.119614 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.119551    2562 generic.go:356] "Generic (PLEG): container finished" podID="06197dbb-d062-45e6-80fc-8820bee91da9" containerID="1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42" exitCode=0
Jul 15 19:16:44.119614 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.119604    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42"
Jul 15 19:16:44.119759 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.119642    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42" event={"ID":"06197dbb-d062-45e6-80fc-8820bee91da9","Type":"ContainerDied","Data":"1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42"}
Jul 15 19:16:44.119759 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.119716    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cf59cf7c-zrf42" event={"ID":"06197dbb-d062-45e6-80fc-8820bee91da9","Type":"ContainerDied","Data":"da5d770e460bcf96699d5d5a19e32dd3980f159655a349091423e83a3f9699fb"}
Jul 15 19:16:44.119832 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.119767    2562 scope.go:117] "RemoveContainer" containerID="1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42"
Jul 15 19:16:44.121614 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.121590    2562 generic.go:356] "Generic (PLEG): container finished" podID="72ceca93-26fb-4030-a6c5-f06f11fe987e" containerID="af8b2db7746c21bb43feabb81088033e61d9ae347e19c12431576580359c34d7" exitCode=0
Jul 15 19:16:44.121723 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.121681    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v57kj" event={"ID":"72ceca93-26fb-4030-a6c5-f06f11fe987e","Type":"ContainerDied","Data":"af8b2db7746c21bb43feabb81088033e61d9ae347e19c12431576580359c34d7"}
Jul 15 19:16:44.131069 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.131043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9l5c" event={"ID":"3ff45dc3-6024-4360-aebe-caaa349943d0","Type":"ContainerStarted","Data":"6ab506ce8fd55b606116fb15b5a3f38e4c8ac34552d778696263b44bed2d0c8f"}
Jul 15 19:16:44.136646 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.136622    2562 scope.go:117] "RemoveContainer" containerID="1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42"
Jul 15 19:16:44.136941 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:16:44.136911    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42\": container with ID starting with 1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42 not found: ID does not exist" containerID="1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42"
Jul 15 19:16:44.136990 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.136949    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42"} err="failed to get container status \"1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42\": rpc error: code = NotFound desc = could not find container \"1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42\": container with ID starting with 1e17b27c2f7197bc01b066159528a3fc6a65b9467cb20edb9b52d4cf8b85ea42 not found: ID does not exist"
Jul 15 19:16:44.163277 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.163238    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l9l5c" podStartSLOduration=3.372006996 podStartE2EDuration="15.16322496s" totalImagesPullingTime="11.791217964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:16:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:44.162298068 +0000 UTC m=+96.160276456" watchObservedRunningTime="2026-07-15 19:16:44.16322496 +0000 UTC m=+96.161203620"
Jul 15 19:16:44.178206 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.178184    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54cf59cf7c-zrf42"]
Jul 15 19:16:44.182378 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.182356    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54cf59cf7c-zrf42"]
Jul 15 19:16:44.563401 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:44.563378    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06197dbb-d062-45e6-80fc-8820bee91da9" path="/var/lib/kubelet/pods/06197dbb-d062-45e6-80fc-8820bee91da9/volumes"
Jul 15 19:16:45.137854 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:45.137816    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v57kj" event={"ID":"72ceca93-26fb-4030-a6c5-f06f11fe987e","Type":"ContainerStarted","Data":"464652dc7633b9a371087dc66027bd047b631de94ca3b447e9aac2cea152b1be"}
Jul 15 19:16:45.138291 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:45.137880    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v57kj" event={"ID":"72ceca93-26fb-4030-a6c5-f06f11fe987e","Type":"ContainerStarted","Data":"b684389b6727b5f50fb00059ef44faf6abb6806c9079d16ec04cb7ab82e47a87"}
Jul 15 19:16:45.169669 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:45.169622    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v57kj" podStartSLOduration=2.175469698 podStartE2EDuration="5.169608618s" totalImagesPullingTime="2.930997958s" totalInitContainerRuntime="63.140962ms" isStatefulPod=true podCreationTimestamp="2026-07-15 19:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:45.167841172 +0000 UTC m=+97.165819568" watchObservedRunningTime="2026-07-15 19:16:45.169608618 +0000 UTC m=+97.167587048"
Jul 15 19:16:45.901979 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:16:45.901955    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ghnzc"
Jul 15 19:17:16.256427 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:17:16.256401    2562 generic.go:356] "Generic (PLEG): container finished" podID="c22bacc0-0044-419e-bbd4-0ede3a29e34f" containerID="c4f0aad5d2080106d61859a09513749a157bd5f628bbd209dd6c3b3ac81d4d66" exitCode=0
Jul 15 19:17:16.256805 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:17:16.256466    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb" event={"ID":"c22bacc0-0044-419e-bbd4-0ede3a29e34f","Type":"ContainerDied","Data":"c4f0aad5d2080106d61859a09513749a157bd5f628bbd209dd6c3b3ac81d4d66"}
Jul 15 19:17:16.256805 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:17:16.256754    2562 scope.go:117] "RemoveContainer" containerID="c4f0aad5d2080106d61859a09513749a157bd5f628bbd209dd6c3b3ac81d4d66"
Jul 15 19:17:17.263178 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:17:17.263137    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-87kpb" event={"ID":"c22bacc0-0044-419e-bbd4-0ede3a29e34f","Type":"ContainerStarted","Data":"17264f970a2f252096ce59363b9ae43e02f281d96698c502954d1cbfbb175616"}
Jul 15 19:17:21.282158 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:17:21.282118    2562 generic.go:356] "Generic (PLEG): container finished" podID="156270f5-25a1-47ff-8df7-265d457c2539" containerID="cf5a1d3efdce227b13e3db734cdfd2a1fa72d5d2c22ace4a7d33fc24ebc210f0" exitCode=0
Jul 15 19:17:21.282539 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:17:21.282190    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr" event={"ID":"156270f5-25a1-47ff-8df7-265d457c2539","Type":"ContainerDied","Data":"cf5a1d3efdce227b13e3db734cdfd2a1fa72d5d2c22ace4a7d33fc24ebc210f0"}
Jul 15 19:17:21.282592 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:17:21.282564    2562 scope.go:117] "RemoveContainer" containerID="cf5a1d3efdce227b13e3db734cdfd2a1fa72d5d2c22ace4a7d33fc24ebc210f0"
Jul 15 19:17:22.287878 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:17:22.287842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bncrr" event={"ID":"156270f5-25a1-47ff-8df7-265d457c2539","Type":"ContainerStarted","Data":"0a18174e8181804346f508112487733821497d22f41afd36993bf6a033d098c4"}
Jul 15 19:20:08.430002 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:20:08.429966    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:20:08.433449 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:20:08.433426    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 19:20:08.435510 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:20:08.435476    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:22:18.500652 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.500612    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"]
Jul 15 19:22:18.501154 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.500979    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06197dbb-d062-45e6-80fc-8820bee91da9" containerName="registry"
Jul 15 19:22:18.501154 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.500994    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="06197dbb-d062-45e6-80fc-8820bee91da9" containerName="registry"
Jul 15 19:22:18.501154 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.501062    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="06197dbb-d062-45e6-80fc-8820bee91da9" containerName="registry"
Jul 15 19:22:18.504111 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.504093    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.508982 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.508904    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-glh4z\""
Jul 15 19:22:18.508982 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.508918    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 19:22:18.508982 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.508949    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 19:22:18.509232 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.509029    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 19:22:18.509232 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.509032    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 19:22:18.522698 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.522674    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"]
Jul 15 19:22:18.549892 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.549872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d34de05b-2014-4342-b525-abf85f3e79ef-tmp\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.549980 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.549904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d34de05b-2014-4342-b525-abf85f3e79ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.549980 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.549927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvj5b\" (UniqueName: \"kubernetes.io/projected/d34de05b-2014-4342-b525-abf85f3e79ef-kube-api-access-cvj5b\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.549980 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.549970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d34de05b-2014-4342-b525-abf85f3e79ef-manifests\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.550078 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.550000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d34de05b-2014-4342-b525-abf85f3e79ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.650409 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.650374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d34de05b-2014-4342-b525-abf85f3e79ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.650534 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.650436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d34de05b-2014-4342-b525-abf85f3e79ef-tmp\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.650534 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.650458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d34de05b-2014-4342-b525-abf85f3e79ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.650534 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.650479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvj5b\" (UniqueName: \"kubernetes.io/projected/d34de05b-2014-4342-b525-abf85f3e79ef-kube-api-access-cvj5b\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.650534 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.650520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d34de05b-2014-4342-b525-abf85f3e79ef-manifests\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.650932 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.650904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d34de05b-2014-4342-b525-abf85f3e79ef-manifests\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.652747 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.652720    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d34de05b-2014-4342-b525-abf85f3e79ef-tmp\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.652822 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.652772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d34de05b-2014-4342-b525-abf85f3e79ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.652860 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.652838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d34de05b-2014-4342-b525-abf85f3e79ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.658598 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.658578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvj5b\" (UniqueName: \"kubernetes.io/projected/d34de05b-2014-4342-b525-abf85f3e79ef-kube-api-access-cvj5b\") pod \"opendatahub-operator-controller-manager-f46f5478c-zcs9p\" (UID: \"d34de05b-2014-4342-b525-abf85f3e79ef\") " pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.814879 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.814819    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:18.950867 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.950844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"]
Jul 15 19:22:18.952877 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:22:18.952853    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34de05b_2014_4342_b525_abf85f3e79ef.slice/crio-18ddcb4578122460a4da5499a8419cc655466bb142de78c2a0a4da8f77977f4d WatchSource:0}: Error finding container 18ddcb4578122460a4da5499a8419cc655466bb142de78c2a0a4da8f77977f4d: Status 404 returned error can't find the container with id 18ddcb4578122460a4da5499a8419cc655466bb142de78c2a0a4da8f77977f4d
Jul 15 19:22:18.954678 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:18.954659    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:22:19.457822 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:19.457788    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p" event={"ID":"d34de05b-2014-4342-b525-abf85f3e79ef","Type":"ContainerStarted","Data":"18ddcb4578122460a4da5499a8419cc655466bb142de78c2a0a4da8f77977f4d"}
Jul 15 19:22:22.473762 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:22.473728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p" event={"ID":"d34de05b-2014-4342-b525-abf85f3e79ef","Type":"ContainerStarted","Data":"9bc99cf5747d5d6416e98dfc24414aa6071dc3d1d53f59d83e5da581a2408207"}
Jul 15 19:22:23.480242 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:23.480177    2562 generic.go:356] "Generic (PLEG): container finished" podID="d34de05b-2014-4342-b525-abf85f3e79ef" containerID="9bc99cf5747d5d6416e98dfc24414aa6071dc3d1d53f59d83e5da581a2408207" exitCode=0
Jul 15 19:22:23.480584 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:23.480265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p" event={"ID":"d34de05b-2014-4342-b525-abf85f3e79ef","Type":"ContainerDied","Data":"9bc99cf5747d5d6416e98dfc24414aa6071dc3d1d53f59d83e5da581a2408207"}
Jul 15 19:22:24.487731 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:24.487695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p" event={"ID":"d34de05b-2014-4342-b525-abf85f3e79ef","Type":"ContainerStarted","Data":"4b36e2e6e59a03176bfd25eef80ccc3c7c51dd1af353dc35f35c9c87de390a23"}
Jul 15 19:22:24.488191 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:24.487821    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:24.509121 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:24.509075    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p" podStartSLOduration=2.029099644 podStartE2EDuration="6.509062363s" totalImagesPullingTime="3.454209962s" totalInitContainerRuntime="1.025752757s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:24.506828588 +0000 UTC m=+436.504806974" watchObservedRunningTime="2026-07-15 19:22:24.509062363 +0000 UTC m=+436.507040736"
Jul 15 19:22:35.495190 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:35.495117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f46f5478c-zcs9p"
Jul 15 19:22:47.067399 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.067361    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"]
Jul 15 19:22:47.075460 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.075438    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:22:47.079244 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.079224    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 19:22:47.079839 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.079826    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6hdt9\""
Jul 15 19:22:47.105227 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.105207    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"]
Jul 15 19:22:47.158237 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.158198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d0a4ec3-9548-4f61-ac18-79b1a5312cd2-cert\") pod \"kserve-controller-manager-d6f4b65b8-flpqq\" (UID: \"4d0a4ec3-9548-4f61-ac18-79b1a5312cd2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:22:47.158580 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.158558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwdq4\" (UniqueName: \"kubernetes.io/projected/4d0a4ec3-9548-4f61-ac18-79b1a5312cd2-kube-api-access-dwdq4\") pod \"kserve-controller-manager-d6f4b65b8-flpqq\" (UID: \"4d0a4ec3-9548-4f61-ac18-79b1a5312cd2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:22:47.259131 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.259101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwdq4\" (UniqueName: \"kubernetes.io/projected/4d0a4ec3-9548-4f61-ac18-79b1a5312cd2-kube-api-access-dwdq4\") pod \"kserve-controller-manager-d6f4b65b8-flpqq\" (UID: \"4d0a4ec3-9548-4f61-ac18-79b1a5312cd2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:22:47.259259 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.259162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d0a4ec3-9548-4f61-ac18-79b1a5312cd2-cert\") pod \"kserve-controller-manager-d6f4b65b8-flpqq\" (UID: \"4d0a4ec3-9548-4f61-ac18-79b1a5312cd2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:22:47.261473 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.261453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d0a4ec3-9548-4f61-ac18-79b1a5312cd2-cert\") pod \"kserve-controller-manager-d6f4b65b8-flpqq\" (UID: \"4d0a4ec3-9548-4f61-ac18-79b1a5312cd2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:22:47.269954 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.269926    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwdq4\" (UniqueName: \"kubernetes.io/projected/4d0a4ec3-9548-4f61-ac18-79b1a5312cd2-kube-api-access-dwdq4\") pod \"kserve-controller-manager-d6f4b65b8-flpqq\" (UID: \"4d0a4ec3-9548-4f61-ac18-79b1a5312cd2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:22:47.385270 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.385218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:22:47.729629 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:47.729608    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"]
Jul 15 19:22:47.731545 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:22:47.731520    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0a4ec3_9548_4f61_ac18_79b1a5312cd2.slice/crio-d3df80d31cf3fd7ea9729d1835082de8cedff9854d64798468db31b1df551bfa WatchSource:0}: Error finding container d3df80d31cf3fd7ea9729d1835082de8cedff9854d64798468db31b1df551bfa: Status 404 returned error can't find the container with id d3df80d31cf3fd7ea9729d1835082de8cedff9854d64798468db31b1df551bfa
Jul 15 19:22:48.484676 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.484628    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"]
Jul 15 19:22:48.488913 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.488895    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:48.491841 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.491825    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 19:22:48.492127 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.492111    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 19:22:48.506112 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.506087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"]
Jul 15 19:22:48.571187 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.571159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpxz\" (UniqueName: \"kubernetes.io/projected/5ccc4f81-db96-4ffd-8a75-03948e010221-kube-api-access-mmpxz\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:48.571313 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.571190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ccc4f81-db96-4ffd-8a75-03948e010221-tmp\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:48.571377 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.571337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccc4f81-db96-4ffd-8a75-03948e010221-tls-certs\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:48.594778 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.594755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq" event={"ID":"4d0a4ec3-9548-4f61-ac18-79b1a5312cd2","Type":"ContainerStarted","Data":"d3df80d31cf3fd7ea9729d1835082de8cedff9854d64798468db31b1df551bfa"}
Jul 15 19:22:48.673017 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.672028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpxz\" (UniqueName: \"kubernetes.io/projected/5ccc4f81-db96-4ffd-8a75-03948e010221-kube-api-access-mmpxz\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:48.673017 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.672063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ccc4f81-db96-4ffd-8a75-03948e010221-tmp\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:48.673017 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.672144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccc4f81-db96-4ffd-8a75-03948e010221-tls-certs\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:48.673017 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:22:48.672246    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 15 19:22:48.673017 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:22:48.672308    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ccc4f81-db96-4ffd-8a75-03948e010221-tls-certs podName:5ccc4f81-db96-4ffd-8a75-03948e010221 nodeName:}" failed. No retries permitted until 2026-07-15 19:22:49.172289331 +0000 UTC m=+461.170267695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5ccc4f81-db96-4ffd-8a75-03948e010221-tls-certs") pod "kube-auth-proxy-59b767f7ff-n8wnj" (UID: "5ccc4f81-db96-4ffd-8a75-03948e010221") : secret "kube-auth-proxy-tls" not found
Jul 15 19:22:48.675692 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.675651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ccc4f81-db96-4ffd-8a75-03948e010221-tmp\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:48.686134 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:48.686111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpxz\" (UniqueName: \"kubernetes.io/projected/5ccc4f81-db96-4ffd-8a75-03948e010221-kube-api-access-mmpxz\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:49.177485 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:49.177453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccc4f81-db96-4ffd-8a75-03948e010221-tls-certs\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:49.180093 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:49.180069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccc4f81-db96-4ffd-8a75-03948e010221-tls-certs\") pod \"kube-auth-proxy-59b767f7ff-n8wnj\" (UID: \"5ccc4f81-db96-4ffd-8a75-03948e010221\") " pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:49.398805 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:49.398781    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"
Jul 15 19:22:49.540413 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:49.540363    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj"]
Jul 15 19:22:49.555546 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:22:49.555522    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccc4f81_db96_4ffd_8a75_03948e010221.slice/crio-be03d3a35b52292c018238c078a973bfd47efd8c94a4047d810df294610a07f3 WatchSource:0}: Error finding container be03d3a35b52292c018238c078a973bfd47efd8c94a4047d810df294610a07f3: Status 404 returned error can't find the container with id be03d3a35b52292c018238c078a973bfd47efd8c94a4047d810df294610a07f3
Jul 15 19:22:49.599427 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:49.599400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj" event={"ID":"5ccc4f81-db96-4ffd-8a75-03948e010221","Type":"ContainerStarted","Data":"be03d3a35b52292c018238c078a973bfd47efd8c94a4047d810df294610a07f3"}
Jul 15 19:22:50.321465 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.321434    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"]
Jul 15 19:22:50.324529 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.324511    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.327225 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.327202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 19:22:50.327225 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.327202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 19:22:50.327367 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.327235    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 19:22:50.327695 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.327680    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 19:22:50.327756 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.327735    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dc8r6\""
Jul 15 19:22:50.337292 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.337273    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"]
Jul 15 19:22:50.388799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.388777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1249d79e-708c-4a3b-903d-d9a7212a3e76-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.388907 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.388803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.388907 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.388824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqtcd\" (UniqueName: \"kubernetes.io/projected/1249d79e-708c-4a3b-903d-d9a7212a3e76-kube-api-access-tqtcd\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.388907 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.388845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.389073 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.388926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.389073 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.388974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.389073 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.389017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1249d79e-708c-4a3b-903d-d9a7212a3e76-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.489595 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.489566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.489739 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.489623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.489739 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.489679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.489739 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.489703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1249d79e-708c-4a3b-903d-d9a7212a3e76-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.489910 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.489748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1249d79e-708c-4a3b-903d-d9a7212a3e76-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.489910 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.489770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.489910 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.489798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqtcd\" (UniqueName: \"kubernetes.io/projected/1249d79e-708c-4a3b-903d-d9a7212a3e76-kube-api-access-tqtcd\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.490255 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.490224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.492373 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.492347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.492474 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.492425    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1249d79e-708c-4a3b-903d-d9a7212a3e76-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.492761 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.492738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.492982 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.492961    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1249d79e-708c-4a3b-903d-d9a7212a3e76-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.502864 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.502823    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqtcd\" (UniqueName: \"kubernetes.io/projected/1249d79e-708c-4a3b-903d-d9a7212a3e76-kube-api-access-tqtcd\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.503799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.503763    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1249d79e-708c-4a3b-903d-d9a7212a3e76-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-95klg\" (UID: \"1249d79e-708c-4a3b-903d-d9a7212a3e76\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.607520 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.607432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq" event={"ID":"4d0a4ec3-9548-4f61-ac18-79b1a5312cd2","Type":"ContainerStarted","Data":"3c2aa74e31fc8558f8b230f0c7e128bebc181a6b7515602a117eb828d8611031"}
Jul 15 19:22:50.608013 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.607995    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:22:50.633792 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.633769    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:50.655148 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.655105    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq" podStartSLOduration=1.040719228 podStartE2EDuration="3.655087645s" totalImagesPullingTime="2.614368417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:50.645103695 +0000 UTC m=+462.643082068" watchObservedRunningTime="2026-07-15 19:22:50.655087645 +0000 UTC m=+462.653066018"
Jul 15 19:22:50.814825 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:50.814798    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"]
Jul 15 19:22:50.817876 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:22:50.817847    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1249d79e_708c_4a3b_903d_d9a7212a3e76.slice/crio-5144d8718530b3a54536a37290829c2216fd421d8ad3f380547bc491aac80b47 WatchSource:0}: Error finding container 5144d8718530b3a54536a37290829c2216fd421d8ad3f380547bc491aac80b47: Status 404 returned error can't find the container with id 5144d8718530b3a54536a37290829c2216fd421d8ad3f380547bc491aac80b47
Jul 15 19:22:51.613855 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:51.613803    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg" event={"ID":"1249d79e-708c-4a3b-903d-d9a7212a3e76","Type":"ContainerStarted","Data":"5144d8718530b3a54536a37290829c2216fd421d8ad3f380547bc491aac80b47"}
Jul 15 19:22:53.528931 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:53.528895    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:22:53.529275 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:53.528971    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:22:53.623755 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:53.623719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj" event={"ID":"5ccc4f81-db96-4ffd-8a75-03948e010221","Type":"ContainerStarted","Data":"5376d320c5abca10b035d1cf90c4a5f677399f7a8964699bc30b9c7d105678c2"}
Jul 15 19:22:53.625256 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:53.625231    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg" event={"ID":"1249d79e-708c-4a3b-903d-d9a7212a3e76","Type":"ContainerStarted","Data":"93ab283390ef796e952bacaacdab937c9f378b017a291e3646f96f0b0d418a04"}
Jul 15 19:22:53.625358 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:53.625329    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:22:53.640913 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:53.640875    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59b767f7ff-n8wnj" podStartSLOduration=1.72261249 podStartE2EDuration="5.640863127s" totalImagesPullingTime="3.918250637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:53.639914531 +0000 UTC m=+465.637892902" watchObservedRunningTime="2026-07-15 19:22:53.640863127 +0000 UTC m=+465.638841545"
Jul 15 19:22:53.659416 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:53.659376    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg" podStartSLOduration=0.951421247 podStartE2EDuration="3.659360229s" totalImagesPullingTime="2.707938982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:53.658400636 +0000 UTC m=+465.656379011" watchObservedRunningTime="2026-07-15 19:22:53.659360229 +0000 UTC m=+465.657338602"
Jul 15 19:22:54.630822 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:22:54.630797    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-95klg"
Jul 15 19:23:22.622671 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:23:22.622644    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-flpqq"
Jul 15 19:24:21.469284 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.469194    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"]
Jul 15 19:24:21.472789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.472763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"
Jul 15 19:24:21.475988 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.475955    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 19:24:21.476107 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.476006    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-49l6b\""
Jul 15 19:24:21.476990 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.476968    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 19:24:21.485791 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.485766    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"]
Jul 15 19:24:21.546769 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.546733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz8d5\" (UniqueName: \"kubernetes.io/projected/a82ee433-edfe-430b-bb69-5ef9e55d4d2e-kube-api-access-wz8d5\") pod \"authorino-operator-75cc8d5cb7-8gmc2\" (UID: \"a82ee433-edfe-430b-bb69-5ef9e55d4d2e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"
Jul 15 19:24:21.647199 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.647171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz8d5\" (UniqueName: \"kubernetes.io/projected/a82ee433-edfe-430b-bb69-5ef9e55d4d2e-kube-api-access-wz8d5\") pod \"authorino-operator-75cc8d5cb7-8gmc2\" (UID: \"a82ee433-edfe-430b-bb69-5ef9e55d4d2e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"
Jul 15 19:24:21.655353 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.655334    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz8d5\" (UniqueName: \"kubernetes.io/projected/a82ee433-edfe-430b-bb69-5ef9e55d4d2e-kube-api-access-wz8d5\") pod \"authorino-operator-75cc8d5cb7-8gmc2\" (UID: \"a82ee433-edfe-430b-bb69-5ef9e55d4d2e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"
Jul 15 19:24:21.783453 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.783419    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"
Jul 15 19:24:21.913645 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:21.913621    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"]
Jul 15 19:24:21.915205 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:24:21.915180    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82ee433_edfe_430b_bb69_5ef9e55d4d2e.slice/crio-4e0ece053523349caa81e78b8b3dc35da289f7462d573878e91b4ec2e55667ab WatchSource:0}: Error finding container 4e0ece053523349caa81e78b8b3dc35da289f7462d573878e91b4ec2e55667ab: Status 404 returned error can't find the container with id 4e0ece053523349caa81e78b8b3dc35da289f7462d573878e91b4ec2e55667ab
Jul 15 19:24:22.011946 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:22.011920    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2" event={"ID":"a82ee433-edfe-430b-bb69-5ef9e55d4d2e","Type":"ContainerStarted","Data":"4e0ece053523349caa81e78b8b3dc35da289f7462d573878e91b4ec2e55667ab"}
Jul 15 19:24:25.027441 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:25.027407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2" event={"ID":"a82ee433-edfe-430b-bb69-5ef9e55d4d2e","Type":"ContainerStarted","Data":"b2a2f35b49bd344b340f8cfc53fed0267649efde872414d938603d7d247c1b0b"}
Jul 15 19:24:25.027833 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:25.027468    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"
Jul 15 19:24:25.046105 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:25.046000    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2" podStartSLOduration=1.858862273 podStartE2EDuration="4.045981039s" totalImagesPullingTime="2.187118766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:24:25.045868903 +0000 UTC m=+557.043847279" watchObservedRunningTime="2026-07-15 19:24:25.045981039 +0000 UTC m=+557.043959410"
Jul 15 19:24:36.034378 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:24:36.034350    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gmc2"
Jul 15 19:25:05.563912 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.563876    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:25:05.567337 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.567320    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:25:05.570129 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.570104    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 19:25:05.570259 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.570159    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ds664\""
Jul 15 19:25:05.575267 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.575243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:25:05.604984 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.604960    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:25:05.678943 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.678922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d591032-334a-4165-94a0-fc652f64bb14-config-file\") pod \"limitador-limitador-54d6d988d5-dkw2d\" (UID: \"2d591032-334a-4165-94a0-fc652f64bb14\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:25:05.679033 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.678973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttnlc\" (UniqueName: \"kubernetes.io/projected/2d591032-334a-4165-94a0-fc652f64bb14-kube-api-access-ttnlc\") pod \"limitador-limitador-54d6d988d5-dkw2d\" (UID: \"2d591032-334a-4165-94a0-fc652f64bb14\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:25:05.779551 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.779487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d591032-334a-4165-94a0-fc652f64bb14-config-file\") pod \"limitador-limitador-54d6d988d5-dkw2d\" (UID: \"2d591032-334a-4165-94a0-fc652f64bb14\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:25:05.779655 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.779628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnlc\" (UniqueName: \"kubernetes.io/projected/2d591032-334a-4165-94a0-fc652f64bb14-kube-api-access-ttnlc\") pod \"limitador-limitador-54d6d988d5-dkw2d\" (UID: \"2d591032-334a-4165-94a0-fc652f64bb14\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:25:05.780174 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.780158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d591032-334a-4165-94a0-fc652f64bb14-config-file\") pod \"limitador-limitador-54d6d988d5-dkw2d\" (UID: \"2d591032-334a-4165-94a0-fc652f64bb14\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:25:05.787981 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.787958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttnlc\" (UniqueName: \"kubernetes.io/projected/2d591032-334a-4165-94a0-fc652f64bb14-kube-api-access-ttnlc\") pod \"limitador-limitador-54d6d988d5-dkw2d\" (UID: \"2d591032-334a-4165-94a0-fc652f64bb14\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:25:05.879224 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:05.879171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:25:06.001182 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:06.001156    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:25:06.002791 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:25:06.002762    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d591032_334a_4165_94a0_fc652f64bb14.slice/crio-43745567d4c3767f42c1db2a81678935a18b4e76328983476369e11abda82706 WatchSource:0}: Error finding container 43745567d4c3767f42c1db2a81678935a18b4e76328983476369e11abda82706: Status 404 returned error can't find the container with id 43745567d4c3767f42c1db2a81678935a18b4e76328983476369e11abda82706
Jul 15 19:25:06.214065 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:06.214011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d" event={"ID":"2d591032-334a-4165-94a0-fc652f64bb14","Type":"ContainerStarted","Data":"43745567d4c3767f42c1db2a81678935a18b4e76328983476369e11abda82706"}
Jul 15 19:25:08.459775 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:08.459758    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:25:08.469195 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:08.469170    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:25:09.228399 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:09.228363    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d" event={"ID":"2d591032-334a-4165-94a0-fc652f64bb14","Type":"ContainerStarted","Data":"cc4561aee37955265c8651c5baa65c64b343c73e353e78fb3eb13782a885b5cf"}
Jul 15 19:25:09.228593 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:09.228483    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:25:09.247238 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:09.247191    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d" podStartSLOduration=1.841787247 podStartE2EDuration="4.24717771s" totalImagesPullingTime="2.405390463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:25:09.245627252 +0000 UTC m=+601.243605623" watchObservedRunningTime="2026-07-15 19:25:09.24717771 +0000 UTC m=+601.245156174"
Jul 15 19:25:20.234762 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:25:20.234736    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"
Jul 15 19:26:22.750018 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:26:22.749989    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:26:41.430863 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:26:41.430833    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:26:49.541084 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:26:49.541049    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:27:04.236630 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:27:04.236544    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:27:17.438172 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:27:17.438137    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:27:28.438313 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:27:28.438282    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:27:39.734388 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:27:39.734357    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:29:17.242621 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:29:17.242573    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:29:27.332994 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:29:27.332949    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:29:37.428023 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:29:37.427979    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:29:44.926754 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:29:44.926705    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:29:53.929050 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:29:53.928999    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:30:00.137887 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:00.137846    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb"]
Jul 15 19:30:00.141469 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:00.141445    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb"
Jul 15 19:30:00.144193 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:00.144161    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:30:00.147635 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:00.147606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb"]
Jul 15 19:30:00.172120 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:00.172093    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb"
Jul 15 19:30:00.325848 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:00.325820    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb"]
Jul 15 19:30:00.328470 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:30:00.328440    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf260cd56_6f13_459f_a984_af776e8bd2fc.slice/crio-c07c65edf3cf0e711f06bc2a4739a5439a9bdc89b371cfc7b58626de090346b6 WatchSource:0}: Error finding container c07c65edf3cf0e711f06bc2a4739a5439a9bdc89b371cfc7b58626de090346b6: Status 404 returned error can't find the container with id c07c65edf3cf0e711f06bc2a4739a5439a9bdc89b371cfc7b58626de090346b6
Jul 15 19:30:00.330329 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:00.330312    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:30:00.532743 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:00.532705    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb" event={"ID":"f260cd56-6f13-459f-a984-af776e8bd2fc","Type":"ContainerStarted","Data":"c07c65edf3cf0e711f06bc2a4739a5439a9bdc89b371cfc7b58626de090346b6"}
Jul 15 19:30:02.738251 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:02.737277    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:30:03.552058 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:03.552024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb" event={"ID":"f260cd56-6f13-459f-a984-af776e8bd2fc","Type":"ContainerStarted","Data":"b5d51400e20b5e3f4569a360e33993e57733aa1a5cdc6c01a5beca3ffb01e5a4"}
Jul 15 19:30:03.567730 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:03.567671    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb" podStartSLOduration=1.209795613 podStartE2EDuration="3.567652303s" totalImagesPullingTime="2.35785669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:03.566688668 +0000 UTC m=+895.564667042" watchObservedRunningTime="2026-07-15 19:30:03.567652303 +0000 UTC m=+895.565630678"
Jul 15 19:30:04.559061 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:04.559026    2562 generic.go:356] "Generic (PLEG): container finished" podID="f260cd56-6f13-459f-a984-af776e8bd2fc" containerID="b5d51400e20b5e3f4569a360e33993e57733aa1a5cdc6c01a5beca3ffb01e5a4" exitCode=0
Jul 15 19:30:04.563883 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:04.563850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb" event={"ID":"f260cd56-6f13-459f-a984-af776e8bd2fc","Type":"ContainerDied","Data":"b5d51400e20b5e3f4569a360e33993e57733aa1a5cdc6c01a5beca3ffb01e5a4"}
Jul 15 19:30:05.704183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:05.704151    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb"
Jul 15 19:30:06.570558 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:06.570522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb" event={"ID":"f260cd56-6f13-459f-a984-af776e8bd2fc","Type":"ContainerDied","Data":"c07c65edf3cf0e711f06bc2a4739a5439a9bdc89b371cfc7b58626de090346b6"}
Jul 15 19:30:06.570732 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:06.570575    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c07c65edf3cf0e711f06bc2a4739a5439a9bdc89b371cfc7b58626de090346b6"
Jul 15 19:30:06.570732 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:06.570588    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-q9qdb"
Jul 15 19:30:08.494755 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:08.494728    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:30:08.495187 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:08.494937    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:30:27.028542 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:27.028482    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:30:39.128249 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:30:39.128199    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:31:11.034684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:31:11.034640    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:31:23.140952 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:31:23.140910    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:31:32.331000 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:31:32.330903    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:31:37.934353 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:31:37.934311    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:31:47.644628 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:31:47.644581    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:31:58.741859 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:31:58.741816    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:32:09.435369 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:32:09.435324    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:32:19.644081 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:32:19.644038    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:32:45.242556 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:32:45.242466    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:32:56.328660 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:32:56.328617    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:33:18.434631 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:33:18.434546    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:33:29.337553 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:33:29.337485    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:33:44.239246 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:33:44.239206    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:33:54.535934 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:33:54.535889    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:34:03.231287 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:34:03.231243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:34:14.233283 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:34:14.233240    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:34:23.337334 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:34:23.337279    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:35:08.521939 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:35:08.521910    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:35:08.522456 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:35:08.521961    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:36:10.334863 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:36:10.334822    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:36:18.835503 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:36:18.835454    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:36:33.733055 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:36:33.733013    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:36:41.942214 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:36:41.942167    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:36:52.333283 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:36:52.333238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:37:00.930911 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:37:00.930869    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:37:11.431668 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:37:11.431620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:37:23.027228 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:37:23.027185    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:37:31.431101 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:37:31.431005    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:37:42.128153 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:37:42.128112    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:37:49.439138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:37:49.439097    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:37:59.639440 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:37:59.639398    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:38:22.235806 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:38:22.235763    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:38:30.735637 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:38:30.735591    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:38:41.136060 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:38:41.136021    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:38:52.238196 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:38:52.238151    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:39:07.635396 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:39:07.635306    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:39:17.132014 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:39:17.131966    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:39:26.035541 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:39:26.035505    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:39:35.637991 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:39:35.637953    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:39:44.329175 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:39:44.329139    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:39:53.226067 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:39:53.226029    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:40:08.033070 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:40:08.033032    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:40:08.548380 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:40:08.548353    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:40:08.549288 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:40:08.549268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:40:16.639770 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:40:16.639736    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:40:26.031508 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:40:26.031466    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:40:37.927880 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:40:37.927789    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:40:49.635986 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:40:49.635944    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:40:57.845509 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:40:57.845469    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:41:09.232929 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:41:09.232890    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:41:18.745161 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:41:18.745128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:41:31.933381 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:41:31.933344    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:41:44.138987 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:41:44.138954    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:41:52.436634 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:41:52.436566    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:42:00.434601 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:00.434570    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:42:05.293925 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.293898    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"]
Jul 15 19:42:05.294264 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.294199    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f260cd56-6f13-459f-a984-af776e8bd2fc" containerName="cleanup"
Jul 15 19:42:05.294264 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.294210    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f260cd56-6f13-459f-a984-af776e8bd2fc" containerName="cleanup"
Jul 15 19:42:05.294335 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.294276    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f260cd56-6f13-459f-a984-af776e8bd2fc" containerName="cleanup"
Jul 15 19:42:05.297399 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.297380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.300001 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.299979    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-daf69041-serving-cert\""
Jul 15 19:42:05.300113 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.299999    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:42:05.300113 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.299999    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 19:42:05.301091 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.301074    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5qhz\""
Jul 15 19:42:05.309926 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.309905    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"]
Jul 15 19:42:05.434148 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.434122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc4rg\" (UniqueName: \"kubernetes.io/projected/020579c6-57a5-4133-ba7a-46c8f150de7d-kube-api-access-sc4rg\") pod \"maas-api-e2e-ait-daf69041-77884f97dd-tqtkq\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.434261 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.434172    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/020579c6-57a5-4133-ba7a-46c8f150de7d-openshift-service-ca\") pod \"maas-api-e2e-ait-daf69041-77884f97dd-tqtkq\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.434261 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.434250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/020579c6-57a5-4133-ba7a-46c8f150de7d-maas-api-tls\") pod \"maas-api-e2e-ait-daf69041-77884f97dd-tqtkq\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.534826 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.534797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/020579c6-57a5-4133-ba7a-46c8f150de7d-openshift-service-ca\") pod \"maas-api-e2e-ait-daf69041-77884f97dd-tqtkq\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.534946 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.534846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/020579c6-57a5-4133-ba7a-46c8f150de7d-maas-api-tls\") pod \"maas-api-e2e-ait-daf69041-77884f97dd-tqtkq\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.534946 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.534907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc4rg\" (UniqueName: \"kubernetes.io/projected/020579c6-57a5-4133-ba7a-46c8f150de7d-kube-api-access-sc4rg\") pod \"maas-api-e2e-ait-daf69041-77884f97dd-tqtkq\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.535563 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.535544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/020579c6-57a5-4133-ba7a-46c8f150de7d-openshift-service-ca\") pod \"maas-api-e2e-ait-daf69041-77884f97dd-tqtkq\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.537343 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.537323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/020579c6-57a5-4133-ba7a-46c8f150de7d-maas-api-tls\") pod \"maas-api-e2e-ait-daf69041-77884f97dd-tqtkq\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.543735 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.543712    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc4rg\" (UniqueName: \"kubernetes.io/projected/020579c6-57a5-4133-ba7a-46c8f150de7d-kube-api-access-sc4rg\") pod \"maas-api-e2e-ait-daf69041-77884f97dd-tqtkq\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.607593 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.607539    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:05.742558 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.742380    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"]
Jul 15 19:42:05.744881 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:42:05.744852    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020579c6_57a5_4133_ba7a_46c8f150de7d.slice/crio-e5a811f3072a1c07cace001960b5d863ba73e33f37044fb538807792d3a445cc WatchSource:0}: Error finding container e5a811f3072a1c07cace001960b5d863ba73e33f37044fb538807792d3a445cc: Status 404 returned error can't find the container with id e5a811f3072a1c07cace001960b5d863ba73e33f37044fb538807792d3a445cc
Jul 15 19:42:05.746210 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.746190    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:42:05.960964 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:05.960894    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq" event={"ID":"020579c6-57a5-4133-ba7a-46c8f150de7d","Type":"ContainerStarted","Data":"e5a811f3072a1c07cace001960b5d863ba73e33f37044fb538807792d3a445cc"}
Jul 15 19:42:08.136161 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:08.136134    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:42:08.980384 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:08.980350    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq" event={"ID":"020579c6-57a5-4133-ba7a-46c8f150de7d","Type":"ContainerStarted","Data":"f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257"}
Jul 15 19:42:08.980576 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:08.980439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:08.999687 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:08.999636    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq" podStartSLOduration=1.6510722979999999 podStartE2EDuration="3.99961905s" totalImagesPullingTime="2.348546752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:42:08.997425038 +0000 UTC m=+1620.995403422" watchObservedRunningTime="2026-07-15 19:42:08.99961905 +0000 UTC m=+1620.997597425"
Jul 15 19:42:10.347073 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.347045    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"]
Jul 15 19:42:10.350312 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.350291    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"
Jul 15 19:42:10.352621 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.352604    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:42:10.358045 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.358023    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"]
Jul 15 19:42:10.475890 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.475866    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c010e4d0-dbcf-4007-83c4-8be07aca156e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf69041-824wj\" (UID: \"c010e4d0-dbcf-4007-83c4-8be07aca156e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"
Jul 15 19:42:10.576462 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.576441    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c010e4d0-dbcf-4007-83c4-8be07aca156e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf69041-824wj\" (UID: \"c010e4d0-dbcf-4007-83c4-8be07aca156e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"
Jul 15 19:42:10.577003 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.576986    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c010e4d0-dbcf-4007-83c4-8be07aca156e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf69041-824wj\" (UID: \"c010e4d0-dbcf-4007-83c4-8be07aca156e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"
Jul 15 19:42:10.662585 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.662538    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"
Jul 15 19:42:10.788767 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.788737    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"]
Jul 15 19:42:10.792861 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:42:10.792836    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc010e4d0_dbcf_4007_83c4_8be07aca156e.slice/crio-fdc0413c00d5b7aba90fe26195045d90f469037595fe8c9a396dfd2999d1be8b WatchSource:0}: Error finding container fdc0413c00d5b7aba90fe26195045d90f469037595fe8c9a396dfd2999d1be8b: Status 404 returned error can't find the container with id fdc0413c00d5b7aba90fe26195045d90f469037595fe8c9a396dfd2999d1be8b
Jul 15 19:42:10.991334 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:10.991307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj" event={"ID":"c010e4d0-dbcf-4007-83c4-8be07aca156e","Type":"ContainerStarted","Data":"fdc0413c00d5b7aba90fe26195045d90f469037595fe8c9a396dfd2999d1be8b"}
Jul 15 19:42:11.999249 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:11.999217    2562 generic.go:356] "Generic (PLEG): container finished" podID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerID="fe5ae69855751011528afdc4162bc8e9ce5c101370f6944cd70afc6b3d79f20a" exitCode=7
Jul 15 19:42:11.999616 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:11.999281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj" event={"ID":"c010e4d0-dbcf-4007-83c4-8be07aca156e","Type":"ContainerDied","Data":"fe5ae69855751011528afdc4162bc8e9ce5c101370f6944cd70afc6b3d79f20a"}
Jul 15 19:42:11.999616 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:11.999441    2562 scope.go:117] "RemoveContainer" containerID="fe5ae69855751011528afdc4162bc8e9ce5c101370f6944cd70afc6b3d79f20a"
Jul 15 19:42:13.006386 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:13.006361    2562 generic.go:356] "Generic (PLEG): container finished" podID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerID="c56a7d2f57b3d2f270efec467b2b196a1973a1a1b4fe15de0fe39f99f2d3a41e" exitCode=7
Jul 15 19:42:13.006784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:13.006433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj" event={"ID":"c010e4d0-dbcf-4007-83c4-8be07aca156e","Type":"ContainerDied","Data":"c56a7d2f57b3d2f270efec467b2b196a1973a1a1b4fe15de0fe39f99f2d3a41e"}
Jul 15 19:42:13.006784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:13.006488    2562 scope.go:117] "RemoveContainer" containerID="fe5ae69855751011528afdc4162bc8e9ce5c101370f6944cd70afc6b3d79f20a"
Jul 15 19:42:13.006784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:13.006698    2562 scope.go:117] "RemoveContainer" containerID="c56a7d2f57b3d2f270efec467b2b196a1973a1a1b4fe15de0fe39f99f2d3a41e"
Jul 15 19:42:13.006909 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:42:13.006873    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-daf69041-824wj_odh-ai-gateway-infra(c010e4d0-dbcf-4007-83c4-8be07aca156e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e"
Jul 15 19:42:14.013322 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:14.013296    2562 scope.go:117] "RemoveContainer" containerID="c56a7d2f57b3d2f270efec467b2b196a1973a1a1b4fe15de0fe39f99f2d3a41e"
Jul 15 19:42:14.013705 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:42:14.013456    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-daf69041-824wj_odh-ai-gateway-infra(c010e4d0-dbcf-4007-83c4-8be07aca156e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e"
Jul 15 19:42:14.991027 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:14.991003    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:42:24.558811 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:24.558770    2562 scope.go:117] "RemoveContainer" containerID="c56a7d2f57b3d2f270efec467b2b196a1973a1a1b4fe15de0fe39f99f2d3a41e"
Jul 15 19:42:25.068557 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:25.068524    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj" event={"ID":"c010e4d0-dbcf-4007-83c4-8be07aca156e","Type":"ContainerStarted","Data":"5ff44d49e1a9edb4a06e560f6b4120890b0a1d12a9bee6656a1ac37950f1e5f5"}
Jul 15 19:42:25.086160 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:25.086119    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj" podStartSLOduration=15.08610605 podStartE2EDuration="15.08610605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:42:25.084932713 +0000 UTC m=+1637.082911088" watchObservedRunningTime="2026-07-15 19:42:25.08610605 +0000 UTC m=+1637.084084403"
Jul 15 19:42:26.074976 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:26.074945    2562 generic.go:356] "Generic (PLEG): container finished" podID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerID="5ff44d49e1a9edb4a06e560f6b4120890b0a1d12a9bee6656a1ac37950f1e5f5" exitCode=0
Jul 15 19:42:26.075428 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:26.075014    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj" event={"ID":"c010e4d0-dbcf-4007-83c4-8be07aca156e","Type":"ContainerDied","Data":"5ff44d49e1a9edb4a06e560f6b4120890b0a1d12a9bee6656a1ac37950f1e5f5"}
Jul 15 19:42:26.075428 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:26.075071    2562 scope.go:117] "RemoveContainer" containerID="c56a7d2f57b3d2f270efec467b2b196a1973a1a1b4fe15de0fe39f99f2d3a41e"
Jul 15 19:42:26.099863 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:26.099834    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"]
Jul 15 19:42:27.223117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:27.223091    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"
Jul 15 19:42:27.413779 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:27.413718    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c010e4d0-dbcf-4007-83c4-8be07aca156e-maas-api-service-ca\") pod \"c010e4d0-dbcf-4007-83c4-8be07aca156e\" (UID: \"c010e4d0-dbcf-4007-83c4-8be07aca156e\") "
Jul 15 19:42:27.414085 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:27.414064    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c010e4d0-dbcf-4007-83c4-8be07aca156e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c010e4d0-dbcf-4007-83c4-8be07aca156e" (UID: "c010e4d0-dbcf-4007-83c4-8be07aca156e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:42:27.515188 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:27.515162    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c010e4d0-dbcf-4007-83c4-8be07aca156e-maas-api-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:42:28.086444 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:28.086416    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"
Jul 15 19:42:28.086606 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:28.086454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj" event={"ID":"c010e4d0-dbcf-4007-83c4-8be07aca156e","Type":"ContainerDied","Data":"fdc0413c00d5b7aba90fe26195045d90f469037595fe8c9a396dfd2999d1be8b"}
Jul 15 19:42:28.086606 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:28.086511    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdc0413c00d5b7aba90fe26195045d90f469037595fe8c9a396dfd2999d1be8b"
Jul 15 19:42:28.117417 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:28.117394    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"]
Jul 15 19:42:28.121028 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:28.121009    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-824wj"]
Jul 15 19:42:28.564344 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:42:28.564316    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" path="/var/lib/kubelet/pods/c010e4d0-dbcf-4007-83c4-8be07aca156e/volumes"
Jul 15 19:43:00.388978 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.388937    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"]
Jul 15 19:43:00.389478 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.389308    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerName="revoke-keys"
Jul 15 19:43:00.389478 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.389319    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerName="revoke-keys"
Jul 15 19:43:00.389478 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.389333    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerName="revoke-keys"
Jul 15 19:43:00.389478 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.389339    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerName="revoke-keys"
Jul 15 19:43:00.389478 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.389347    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerName="revoke-keys"
Jul 15 19:43:00.389478 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.389354    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerName="revoke-keys"
Jul 15 19:43:00.389478 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.389420    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerName="revoke-keys"
Jul 15 19:43:00.389478 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.389427    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerName="revoke-keys"
Jul 15 19:43:00.392718 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.392698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"
Jul 15 19:43:00.395751 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.395728    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:43:00.399661 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.399638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"]
Jul 15 19:43:00.457782 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.457759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52208a7-141f-4d4c-8ab0-c21b9e52dc80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf69041-vf9jt\" (UID: \"f52208a7-141f-4d4c-8ab0-c21b9e52dc80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"
Jul 15 19:43:00.558348 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.558322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52208a7-141f-4d4c-8ab0-c21b9e52dc80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf69041-vf9jt\" (UID: \"f52208a7-141f-4d4c-8ab0-c21b9e52dc80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"
Jul 15 19:43:00.558930 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.558910    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52208a7-141f-4d4c-8ab0-c21b9e52dc80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf69041-vf9jt\" (UID: \"f52208a7-141f-4d4c-8ab0-c21b9e52dc80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"
Jul 15 19:43:00.706543 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.706473    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"
Jul 15 19:43:00.832114 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:00.832019    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"]
Jul 15 19:43:00.834335 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:43:00.834308    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52208a7_141f_4d4c_8ab0_c21b9e52dc80.slice/crio-6e935664ffa19cfa2f077c65e30752567b6e28d807a42837e129e0be0239009d WatchSource:0}: Error finding container 6e935664ffa19cfa2f077c65e30752567b6e28d807a42837e129e0be0239009d: Status 404 returned error can't find the container with id 6e935664ffa19cfa2f077c65e30752567b6e28d807a42837e129e0be0239009d
Jul 15 19:43:01.245178 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:01.245150    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt" event={"ID":"f52208a7-141f-4d4c-8ab0-c21b9e52dc80","Type":"ContainerStarted","Data":"315268786e4e544686566aab4ee3c8b0e667ad1e71ca28fb788b841abe6ad226"}
Jul 15 19:43:01.245285 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:01.245211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt" event={"ID":"f52208a7-141f-4d4c-8ab0-c21b9e52dc80","Type":"ContainerStarted","Data":"6e935664ffa19cfa2f077c65e30752567b6e28d807a42837e129e0be0239009d"}
Jul 15 19:43:01.261942 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:01.261875    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt" podStartSLOduration=1.261861692 podStartE2EDuration="1.261861692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:43:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:43:01.260100327 +0000 UTC m=+1673.258078728" watchObservedRunningTime="2026-07-15 19:43:01.261861692 +0000 UTC m=+1673.259840044"
Jul 15 19:43:02.252557 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:02.252524    2562 generic.go:356] "Generic (PLEG): container finished" podID="f52208a7-141f-4d4c-8ab0-c21b9e52dc80" containerID="315268786e4e544686566aab4ee3c8b0e667ad1e71ca28fb788b841abe6ad226" exitCode=0
Jul 15 19:43:02.252945 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:02.252615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt" event={"ID":"f52208a7-141f-4d4c-8ab0-c21b9e52dc80","Type":"ContainerDied","Data":"315268786e4e544686566aab4ee3c8b0e667ad1e71ca28fb788b841abe6ad226"}
Jul 15 19:43:03.389452 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:03.389426    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"
Jul 15 19:43:03.478884 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:03.478862    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52208a7-141f-4d4c-8ab0-c21b9e52dc80-maas-api-service-ca\") pod \"f52208a7-141f-4d4c-8ab0-c21b9e52dc80\" (UID: \"f52208a7-141f-4d4c-8ab0-c21b9e52dc80\") "
Jul 15 19:43:03.479177 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:03.479156    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f52208a7-141f-4d4c-8ab0-c21b9e52dc80-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f52208a7-141f-4d4c-8ab0-c21b9e52dc80" (UID: "f52208a7-141f-4d4c-8ab0-c21b9e52dc80"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:43:03.579662 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:03.579613    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52208a7-141f-4d4c-8ab0-c21b9e52dc80-maas-api-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:43:04.263468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:04.263440    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt"
Jul 15 19:43:04.263638 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:04.263481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf69041-vf9jt" event={"ID":"f52208a7-141f-4d4c-8ab0-c21b9e52dc80","Type":"ContainerDied","Data":"6e935664ffa19cfa2f077c65e30752567b6e28d807a42837e129e0be0239009d"}
Jul 15 19:43:04.263638 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:04.263541    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e935664ffa19cfa2f077c65e30752567b6e28d807a42837e129e0be0239009d"
Jul 15 19:43:10.760076 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:10.760035    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"]
Jul 15 19:43:10.760567 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:10.760295    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq" podUID="020579c6-57a5-4133-ba7a-46c8f150de7d" containerName="maas-api" containerID="cri-o://f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257" gracePeriod=30
Jul 15 19:43:11.006130 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.006109    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:43:11.141391 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.141332    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc4rg\" (UniqueName: \"kubernetes.io/projected/020579c6-57a5-4133-ba7a-46c8f150de7d-kube-api-access-sc4rg\") pod \"020579c6-57a5-4133-ba7a-46c8f150de7d\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") "
Jul 15 19:43:11.141391 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.141386    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/020579c6-57a5-4133-ba7a-46c8f150de7d-openshift-service-ca\") pod \"020579c6-57a5-4133-ba7a-46c8f150de7d\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") "
Jul 15 19:43:11.141609 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.141408    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/020579c6-57a5-4133-ba7a-46c8f150de7d-maas-api-tls\") pod \"020579c6-57a5-4133-ba7a-46c8f150de7d\" (UID: \"020579c6-57a5-4133-ba7a-46c8f150de7d\") "
Jul 15 19:43:11.141763 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.141736    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/020579c6-57a5-4133-ba7a-46c8f150de7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "020579c6-57a5-4133-ba7a-46c8f150de7d" (UID: "020579c6-57a5-4133-ba7a-46c8f150de7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:43:11.143615 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.143586    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020579c6-57a5-4133-ba7a-46c8f150de7d-kube-api-access-sc4rg" (OuterVolumeSpecName: "kube-api-access-sc4rg") pod "020579c6-57a5-4133-ba7a-46c8f150de7d" (UID: "020579c6-57a5-4133-ba7a-46c8f150de7d"). InnerVolumeSpecName "kube-api-access-sc4rg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:43:11.143615 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.143605    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/020579c6-57a5-4133-ba7a-46c8f150de7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "020579c6-57a5-4133-ba7a-46c8f150de7d" (UID: "020579c6-57a5-4133-ba7a-46c8f150de7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:43:11.242796 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.242763    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc4rg\" (UniqueName: \"kubernetes.io/projected/020579c6-57a5-4133-ba7a-46c8f150de7d-kube-api-access-sc4rg\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:43:11.242796 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.242793    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/020579c6-57a5-4133-ba7a-46c8f150de7d-openshift-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:43:11.242796 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.242805    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/020579c6-57a5-4133-ba7a-46c8f150de7d-maas-api-tls\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:43:11.299619 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.299595    2562 generic.go:356] "Generic (PLEG): container finished" podID="020579c6-57a5-4133-ba7a-46c8f150de7d" containerID="f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257" exitCode=0
Jul 15 19:43:11.299719 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.299644    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"
Jul 15 19:43:11.299719 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.299656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq" event={"ID":"020579c6-57a5-4133-ba7a-46c8f150de7d","Type":"ContainerDied","Data":"f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257"}
Jul 15 19:43:11.299719 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.299712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq" event={"ID":"020579c6-57a5-4133-ba7a-46c8f150de7d","Type":"ContainerDied","Data":"e5a811f3072a1c07cace001960b5d863ba73e33f37044fb538807792d3a445cc"}
Jul 15 19:43:11.299877 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.299744    2562 scope.go:117] "RemoveContainer" containerID="f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257"
Jul 15 19:43:11.308385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.308368    2562 scope.go:117] "RemoveContainer" containerID="f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257"
Jul 15 19:43:11.308647 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:43:11.308626    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257\": container with ID starting with f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257 not found: ID does not exist" containerID="f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257"
Jul 15 19:43:11.308722 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.308660    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257"} err="failed to get container status \"f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257\": rpc error: code = NotFound desc = could not find container \"f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257\": container with ID starting with f76eff52d18ae29e113faca26bec72b8b1379da20c4bfffbc9878c2c4ca52257 not found: ID does not exist"
Jul 15 19:43:11.320359 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.320337    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"]
Jul 15 19:43:11.326171 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:11.326153    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-daf69041-77884f97dd-tqtkq"]
Jul 15 19:43:12.563835 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:12.563801    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="020579c6-57a5-4133-ba7a-46c8f150de7d" path="/var/lib/kubelet/pods/020579c6-57a5-4133-ba7a-46c8f150de7d/volumes"
Jul 15 19:43:13.729866 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:13.729831    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:43:23.523745 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.523716    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"]
Jul 15 19:43:23.524183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.524028    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020579c6-57a5-4133-ba7a-46c8f150de7d" containerName="maas-api"
Jul 15 19:43:23.524183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.524038    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="020579c6-57a5-4133-ba7a-46c8f150de7d" containerName="maas-api"
Jul 15 19:43:23.524183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.524050    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f52208a7-141f-4d4c-8ab0-c21b9e52dc80" containerName="revoke-keys"
Jul 15 19:43:23.524183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.524056    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f52208a7-141f-4d4c-8ab0-c21b9e52dc80" containerName="revoke-keys"
Jul 15 19:43:23.524183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.524114    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="020579c6-57a5-4133-ba7a-46c8f150de7d" containerName="maas-api"
Jul 15 19:43:23.524183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.524120    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c010e4d0-dbcf-4007-83c4-8be07aca156e" containerName="revoke-keys"
Jul 15 19:43:23.524183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.524127    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f52208a7-141f-4d4c-8ab0-c21b9e52dc80" containerName="revoke-keys"
Jul 15 19:43:23.528370 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.528342    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:23.531024 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.531000    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-5827a521-serving-cert\""
Jul 15 19:43:23.531257 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.531240    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:43:23.531368 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.531240    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5qhz\""
Jul 15 19:43:23.532084 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.532064    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 19:43:23.537329 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.537016    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"]
Jul 15 19:43:23.636964 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.636938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tgxf\" (UniqueName: \"kubernetes.io/projected/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-kube-api-access-7tgxf\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:23.637076 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.636980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-openshift-service-ca\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:23.637076 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.637014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-maas-api-tls\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:23.737817 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.737791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tgxf\" (UniqueName: \"kubernetes.io/projected/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-kube-api-access-7tgxf\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:23.737930 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.737820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-openshift-service-ca\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:23.737930 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.737843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-maas-api-tls\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:23.738031 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:43:23.737939    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-serving-cert: secret "maas-api-e2e-migrate-5827a521-serving-cert" not found
Jul 15 19:43:23.738031 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:43:23.738007    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-maas-api-tls podName:df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c nodeName:}" failed. No retries permitted until 2026-07-15 19:43:24.23798863 +0000 UTC m=+1696.235966984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-maas-api-tls") pod "maas-api-e2e-migrate-5827a521-647c9fb849-8wngh" (UID: "df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c") : secret "maas-api-e2e-migrate-5827a521-serving-cert" not found
Jul 15 19:43:23.738459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.738442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-openshift-service-ca\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:23.746878 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:23.746860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tgxf\" (UniqueName: \"kubernetes.io/projected/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-kube-api-access-7tgxf\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:24.242033 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:24.242008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-maas-api-tls\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:24.244352 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:24.244335    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-maas-api-tls\") pod \"maas-api-e2e-migrate-5827a521-647c9fb849-8wngh\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:24.441096 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:24.441070    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:24.565139 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:24.565116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"]
Jul 15 19:43:24.568050 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:43:24.568021    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf38d3d0_ad3a_4c82_90a8_4ac82fbb7b8c.slice/crio-64b99403230da7ff304cbd4f5a89c02d2acfb70acd7114e6ffadeaf5116f85c2 WatchSource:0}: Error finding container 64b99403230da7ff304cbd4f5a89c02d2acfb70acd7114e6ffadeaf5116f85c2: Status 404 returned error can't find the container with id 64b99403230da7ff304cbd4f5a89c02d2acfb70acd7114e6ffadeaf5116f85c2
Jul 15 19:43:25.366732 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:25.366663    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh" event={"ID":"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c","Type":"ContainerStarted","Data":"632e98662cdb7297c44638a9128736555450e33807caaad172ffa31ced913c20"}
Jul 15 19:43:25.366732 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:25.366720    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh" event={"ID":"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c","Type":"ContainerStarted","Data":"64b99403230da7ff304cbd4f5a89c02d2acfb70acd7114e6ffadeaf5116f85c2"}
Jul 15 19:43:25.366905 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:25.366756    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:25.383979 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:25.383932    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh" podStartSLOduration=1.931523798 podStartE2EDuration="2.383917668s" totalImagesPullingTime="452.39387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:43:25.382397837 +0000 UTC m=+1697.380376209" watchObservedRunningTime="2026-07-15 19:43:25.383917668 +0000 UTC m=+1697.381896067"
Jul 15 19:43:27.032144 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:27.032108    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:43:27.938147 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:27.938118    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"]
Jul 15 19:43:27.941526 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:27.941511    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"
Jul 15 19:43:27.944008 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:27.943988    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:43:27.948559 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:27.948356    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"]
Jul 15 19:43:28.071662 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:28.071638    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc996b-5831-45cf-aae5-b83bcd7a5f78-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5827a521-8txc7\" (UID: \"79bc996b-5831-45cf-aae5-b83bcd7a5f78\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"
Jul 15 19:43:28.172953 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:28.172925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc996b-5831-45cf-aae5-b83bcd7a5f78-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5827a521-8txc7\" (UID: \"79bc996b-5831-45cf-aae5-b83bcd7a5f78\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"
Jul 15 19:43:28.173480 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:28.173462    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc996b-5831-45cf-aae5-b83bcd7a5f78-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5827a521-8txc7\" (UID: \"79bc996b-5831-45cf-aae5-b83bcd7a5f78\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"
Jul 15 19:43:28.252023 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:28.251997    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"
Jul 15 19:43:28.382972 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:28.379484    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"]
Jul 15 19:43:28.384705 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:43:28.384672    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bc996b_5831_45cf_aae5_b83bcd7a5f78.slice/crio-a161caffc7ed323823f044847e2dace33e5bbc26bf55899bfb1bc3c28f04aac9 WatchSource:0}: Error finding container a161caffc7ed323823f044847e2dace33e5bbc26bf55899bfb1bc3c28f04aac9: Status 404 returned error can't find the container with id a161caffc7ed323823f044847e2dace33e5bbc26bf55899bfb1bc3c28f04aac9
Jul 15 19:43:29.392535 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:29.392469    2562 generic.go:356] "Generic (PLEG): container finished" podID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerID="2d40742e87f7fcddb936aff556dc0acc42f4d41142974def9dbe0215d333afd4" exitCode=7
Jul 15 19:43:29.392918 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:29.392547    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7" event={"ID":"79bc996b-5831-45cf-aae5-b83bcd7a5f78","Type":"ContainerDied","Data":"2d40742e87f7fcddb936aff556dc0acc42f4d41142974def9dbe0215d333afd4"}
Jul 15 19:43:29.392918 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:29.392612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7" event={"ID":"79bc996b-5831-45cf-aae5-b83bcd7a5f78","Type":"ContainerStarted","Data":"a161caffc7ed323823f044847e2dace33e5bbc26bf55899bfb1bc3c28f04aac9"}
Jul 15 19:43:29.392918 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:29.392794    2562 scope.go:117] "RemoveContainer" containerID="2d40742e87f7fcddb936aff556dc0acc42f4d41142974def9dbe0215d333afd4"
Jul 15 19:43:30.398648 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:30.398596    2562 generic.go:356] "Generic (PLEG): container finished" podID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerID="7fb5ed8bee9ad895bbb87068ab0d98f0895072ffe9b817ca82269be6f2f898b3" exitCode=7
Jul 15 19:43:30.399009 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:30.398660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7" event={"ID":"79bc996b-5831-45cf-aae5-b83bcd7a5f78","Type":"ContainerDied","Data":"7fb5ed8bee9ad895bbb87068ab0d98f0895072ffe9b817ca82269be6f2f898b3"}
Jul 15 19:43:30.399009 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:30.398713    2562 scope.go:117] "RemoveContainer" containerID="2d40742e87f7fcddb936aff556dc0acc42f4d41142974def9dbe0215d333afd4"
Jul 15 19:43:30.399009 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:30.398879    2562 scope.go:117] "RemoveContainer" containerID="7fb5ed8bee9ad895bbb87068ab0d98f0895072ffe9b817ca82269be6f2f898b3"
Jul 15 19:43:30.399166 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:43:30.399050    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-5827a521-8txc7_odh-ai-gateway-infra(79bc996b-5831-45cf-aae5-b83bcd7a5f78)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78"
Jul 15 19:43:31.376082 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:31.376027    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:43:31.405692 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:31.405669    2562 scope.go:117] "RemoveContainer" containerID="7fb5ed8bee9ad895bbb87068ab0d98f0895072ffe9b817ca82269be6f2f898b3"
Jul 15 19:43:31.406005 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:43:31.405850    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-5827a521-8txc7_odh-ai-gateway-infra(79bc996b-5831-45cf-aae5-b83bcd7a5f78)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78"
Jul 15 19:43:46.558990 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:46.558965    2562 scope.go:117] "RemoveContainer" containerID="7fb5ed8bee9ad895bbb87068ab0d98f0895072ffe9b817ca82269be6f2f898b3"
Jul 15 19:43:47.483929 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:47.483856    2562 generic.go:356] "Generic (PLEG): container finished" podID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerID="c45c95d159ef743f3789de37a30e666f16320a7cf774e55838e0915a9797d3d6" exitCode=0
Jul 15 19:43:47.484062 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:47.483929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7" event={"ID":"79bc996b-5831-45cf-aae5-b83bcd7a5f78","Type":"ContainerDied","Data":"c45c95d159ef743f3789de37a30e666f16320a7cf774e55838e0915a9797d3d6"}
Jul 15 19:43:47.484062 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:47.483986    2562 scope.go:117] "RemoveContainer" containerID="7fb5ed8bee9ad895bbb87068ab0d98f0895072ffe9b817ca82269be6f2f898b3"
Jul 15 19:43:48.516068 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:48.516038    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"]
Jul 15 19:43:48.626405 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:48.626383    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"
Jul 15 19:43:48.814963 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:48.814911    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc996b-5831-45cf-aae5-b83bcd7a5f78-maas-api-service-ca\") pod \"79bc996b-5831-45cf-aae5-b83bcd7a5f78\" (UID: \"79bc996b-5831-45cf-aae5-b83bcd7a5f78\") "
Jul 15 19:43:48.815244 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:48.815224    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79bc996b-5831-45cf-aae5-b83bcd7a5f78-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79bc996b-5831-45cf-aae5-b83bcd7a5f78" (UID: "79bc996b-5831-45cf-aae5-b83bcd7a5f78"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:43:48.916334 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:48.916313    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc996b-5831-45cf-aae5-b83bcd7a5f78-maas-api-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:43:49.497568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:49.497548    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"
Jul 15 19:43:49.497684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:49.497577    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7" event={"ID":"79bc996b-5831-45cf-aae5-b83bcd7a5f78","Type":"ContainerDied","Data":"a161caffc7ed323823f044847e2dace33e5bbc26bf55899bfb1bc3c28f04aac9"}
Jul 15 19:43:49.497684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:49.497620    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a161caffc7ed323823f044847e2dace33e5bbc26bf55899bfb1bc3c28f04aac9"
Jul 15 19:43:49.527814 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:49.527788    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"]
Jul 15 19:43:49.533467 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:49.533439    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-8txc7"]
Jul 15 19:43:50.563541 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:43:50.563473    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" path="/var/lib/kubelet/pods/79bc996b-5831-45cf-aae5-b83bcd7a5f78/volumes"
Jul 15 19:44:27.983970 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.983932    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"]
Jul 15 19:44:27.984542 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.984469    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerName="revoke-keys"
Jul 15 19:44:27.984542 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.984515    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerName="revoke-keys"
Jul 15 19:44:27.984542 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.984537    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerName="revoke-keys"
Jul 15 19:44:27.984717 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.984546    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerName="revoke-keys"
Jul 15 19:44:27.984717 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.984675    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerName="revoke-keys"
Jul 15 19:44:27.984717 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.984688    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerName="revoke-keys"
Jul 15 19:44:27.987894 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.987872    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"
Jul 15 19:44:27.991060 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.991031    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:44:27.996175 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:27.996144    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"]
Jul 15 19:44:28.111722 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:28.111694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bbd0f03-f907-4745-bcf0-58813aa463a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx\" (UID: \"4bbd0f03-f907-4745-bcf0-58813aa463a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"
Jul 15 19:44:28.212649 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:28.212611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bbd0f03-f907-4745-bcf0-58813aa463a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx\" (UID: \"4bbd0f03-f907-4745-bcf0-58813aa463a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"
Jul 15 19:44:28.213204 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:28.213179    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bbd0f03-f907-4745-bcf0-58813aa463a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx\" (UID: \"4bbd0f03-f907-4745-bcf0-58813aa463a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"
Jul 15 19:44:28.300117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:28.300091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"
Jul 15 19:44:28.430087 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:28.430059    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"]
Jul 15 19:44:28.432633 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:44:28.432593    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbd0f03_f907_4745_bcf0_58813aa463a5.slice/crio-eb324b2e61baca8efaaaf854bf0224d75f0800f39371517abbdcffc1f102da52 WatchSource:0}: Error finding container eb324b2e61baca8efaaaf854bf0224d75f0800f39371517abbdcffc1f102da52: Status 404 returned error can't find the container with id eb324b2e61baca8efaaaf854bf0224d75f0800f39371517abbdcffc1f102da52
Jul 15 19:44:28.685745 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:28.685717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx" event={"ID":"4bbd0f03-f907-4745-bcf0-58813aa463a5","Type":"ContainerStarted","Data":"eb324b2e61baca8efaaaf854bf0224d75f0800f39371517abbdcffc1f102da52"}
Jul 15 19:44:29.691297 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:29.691267    2562 generic.go:356] "Generic (PLEG): container finished" podID="4bbd0f03-f907-4745-bcf0-58813aa463a5" containerID="f5f3f21f44ca5c7d4b76ac4544073d0286aed2eb9220e7551b892d354028ac8a" exitCode=0
Jul 15 19:44:29.691704 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:29.691357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx" event={"ID":"4bbd0f03-f907-4745-bcf0-58813aa463a5","Type":"ContainerDied","Data":"f5f3f21f44ca5c7d4b76ac4544073d0286aed2eb9220e7551b892d354028ac8a"}
Jul 15 19:44:30.831408 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:30.831379    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:44:30.846123 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:30.846100    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"
Jul 15 19:44:30.934531 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:30.934512    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bbd0f03-f907-4745-bcf0-58813aa463a5-maas-api-service-ca\") pod \"4bbd0f03-f907-4745-bcf0-58813aa463a5\" (UID: \"4bbd0f03-f907-4745-bcf0-58813aa463a5\") "
Jul 15 19:44:30.934810 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:30.934790    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bbd0f03-f907-4745-bcf0-58813aa463a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4bbd0f03-f907-4745-bcf0-58813aa463a5" (UID: "4bbd0f03-f907-4745-bcf0-58813aa463a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:44:31.035582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:31.035560    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bbd0f03-f907-4745-bcf0-58813aa463a5-maas-api-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:44:31.701804 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:31.701775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx" event={"ID":"4bbd0f03-f907-4745-bcf0-58813aa463a5","Type":"ContainerDied","Data":"eb324b2e61baca8efaaaf854bf0224d75f0800f39371517abbdcffc1f102da52"}
Jul 15 19:44:31.701955 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:31.701822    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb324b2e61baca8efaaaf854bf0224d75f0800f39371517abbdcffc1f102da52"
Jul 15 19:44:31.701955 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:31.701785    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx"
Jul 15 19:44:33.560025 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.559990    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"]
Jul 15 19:44:33.560422 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.560266    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh" podUID="df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c" containerName="maas-api" containerID="cri-o://632e98662cdb7297c44638a9128736555450e33807caaad172ffa31ced913c20" gracePeriod=30
Jul 15 19:44:33.712924 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.712880    2562 generic.go:356] "Generic (PLEG): container finished" podID="df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c" containerID="632e98662cdb7297c44638a9128736555450e33807caaad172ffa31ced913c20" exitCode=0
Jul 15 19:44:33.713067 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.712951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh" event={"ID":"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c","Type":"ContainerDied","Data":"632e98662cdb7297c44638a9128736555450e33807caaad172ffa31ced913c20"}
Jul 15 19:44:33.810364 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.810344    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:44:33.959653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.959597    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-maas-api-tls\") pod \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") "
Jul 15 19:44:33.959653 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.959639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tgxf\" (UniqueName: \"kubernetes.io/projected/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-kube-api-access-7tgxf\") pod \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") "
Jul 15 19:44:33.959833 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.959697    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-openshift-service-ca\") pod \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\" (UID: \"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c\") "
Jul 15 19:44:33.960075 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.960055    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c" (UID: "df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:44:33.961717 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.961695    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-kube-api-access-7tgxf" (OuterVolumeSpecName: "kube-api-access-7tgxf") pod "df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c" (UID: "df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c"). InnerVolumeSpecName "kube-api-access-7tgxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:44:33.961795 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:33.961724    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c" (UID: "df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:44:34.060176 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:34.060150    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-openshift-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:44:34.060176 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:34.060173    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-maas-api-tls\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:44:34.060296 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:34.060189    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tgxf\" (UniqueName: \"kubernetes.io/projected/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c-kube-api-access-7tgxf\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:44:34.720228 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:34.720199    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh" event={"ID":"df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c","Type":"ContainerDied","Data":"64b99403230da7ff304cbd4f5a89c02d2acfb70acd7114e6ffadeaf5116f85c2"}
Jul 15 19:44:34.720597 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:34.720243    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"
Jul 15 19:44:34.720597 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:34.720266    2562 scope.go:117] "RemoveContainer" containerID="632e98662cdb7297c44638a9128736555450e33807caaad172ffa31ced913c20"
Jul 15 19:44:34.736604 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:34.736578    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"]
Jul 15 19:44:34.740178 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:34.740155    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5827a521-647c9fb849-8wngh"]
Jul 15 19:44:36.563675 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:36.563637    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c" path="/var/lib/kubelet/pods/df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c/volumes"
Jul 15 19:44:41.231988 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.231950    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"]
Jul 15 19:44:41.232468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.232403    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c" containerName="maas-api"
Jul 15 19:44:41.232468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.232416    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c" containerName="maas-api"
Jul 15 19:44:41.232468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.232430    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerName="revoke-keys"
Jul 15 19:44:41.232468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.232436    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerName="revoke-keys"
Jul 15 19:44:41.232468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.232444    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bbd0f03-f907-4745-bcf0-58813aa463a5" containerName="revoke-keys"
Jul 15 19:44:41.232468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.232449    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bbd0f03-f907-4745-bcf0-58813aa463a5" containerName="revoke-keys"
Jul 15 19:44:41.232781 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.232530    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="df38d3d0-ad3a-4c82-90a8-4ac82fbb7b8c" containerName="maas-api"
Jul 15 19:44:41.232781 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.232540    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="79bc996b-5831-45cf-aae5-b83bcd7a5f78" containerName="revoke-keys"
Jul 15 19:44:41.232781 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.232546    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bbd0f03-f907-4745-bcf0-58813aa463a5" containerName="revoke-keys"
Jul 15 19:44:41.235378 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.235360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.237985 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.237958    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a0aec9a3-serving-cert\""
Jul 15 19:44:41.237985 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.237978    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5qhz\""
Jul 15 19:44:41.239092 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.239073    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:44:41.239203 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.239129    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 19:44:41.248723 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.248700    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"]
Jul 15 19:44:41.315308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.315275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmpdg\" (UniqueName: \"kubernetes.io/projected/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-kube-api-access-tmpdg\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.315432 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.315332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-maas-api-tls\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.315432 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.315411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-openshift-service-ca\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.416100 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.416071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-maas-api-tls\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.416217 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.416111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-openshift-service-ca\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.416217 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.416136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmpdg\" (UniqueName: \"kubernetes.io/projected/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-kube-api-access-tmpdg\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.416319 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:44:41.416224    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-serving-cert: secret "maas-api-e2e-ait-a0aec9a3-serving-cert" not found
Jul 15 19:44:41.416319 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:44:41.416291    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-maas-api-tls podName:aa18fda3-f089-4fb7-b9c1-d643e09ea8b0 nodeName:}" failed. No retries permitted until 2026-07-15 19:44:41.916271774 +0000 UTC m=+1773.914250125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-maas-api-tls") pod "maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz" (UID: "aa18fda3-f089-4fb7-b9c1-d643e09ea8b0") : secret "maas-api-e2e-ait-a0aec9a3-serving-cert" not found
Jul 15 19:44:41.416753 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.416736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-openshift-service-ca\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.430681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.430656    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmpdg\" (UniqueName: \"kubernetes.io/projected/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-kube-api-access-tmpdg\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.923212 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.923177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-maas-api-tls\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:41.925616 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:41.925587    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-maas-api-tls\") pod \"maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:42.147596 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:42.147570    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:42.275232 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:42.275209    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"]
Jul 15 19:44:42.277920 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:44:42.277894    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa18fda3_f089_4fb7_b9c1_d643e09ea8b0.slice/crio-9c6e0ba075c6d0e21a36b3b01ea1695e99491925c27eabc68ad5957c1137f7f0 WatchSource:0}: Error finding container 9c6e0ba075c6d0e21a36b3b01ea1695e99491925c27eabc68ad5957c1137f7f0: Status 404 returned error can't find the container with id 9c6e0ba075c6d0e21a36b3b01ea1695e99491925c27eabc68ad5957c1137f7f0
Jul 15 19:44:42.760468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:42.760437    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz" event={"ID":"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0","Type":"ContainerStarted","Data":"9c6e0ba075c6d0e21a36b3b01ea1695e99491925c27eabc68ad5957c1137f7f0"}
Jul 15 19:44:43.767119 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:43.767077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz" event={"ID":"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0","Type":"ContainerStarted","Data":"b2811e816798e123c5b86c63198b28da9d32457bcd9f4171457b470cbea0102a"}
Jul 15 19:44:43.767597 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:43.767141    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:43.784538 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:43.784477    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz" podStartSLOduration=2.334752112 podStartE2EDuration="2.784459017s" totalImagesPullingTime="449.706905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:44:43.783253233 +0000 UTC m=+1775.781231608" watchObservedRunningTime="2026-07-15 19:44:43.784459017 +0000 UTC m=+1775.782437392"
Jul 15 19:44:46.557217 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:46.557187    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"]
Jul 15 19:44:46.560624 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:46.560605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"
Jul 15 19:44:46.563258 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:46.563238    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:44:46.568848 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:46.568813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"]
Jul 15 19:44:46.658837 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:46.658810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf33250-c50e-4e04-b3d8-dbf1076893eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6\" (UID: \"caf33250-c50e-4e04-b3d8-dbf1076893eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"
Jul 15 19:44:46.759133 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:46.759108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf33250-c50e-4e04-b3d8-dbf1076893eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6\" (UID: \"caf33250-c50e-4e04-b3d8-dbf1076893eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"
Jul 15 19:44:46.759723 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:46.759705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf33250-c50e-4e04-b3d8-dbf1076893eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6\" (UID: \"caf33250-c50e-4e04-b3d8-dbf1076893eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"
Jul 15 19:44:46.872582 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:46.872525    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"
Jul 15 19:44:47.000385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:47.000360    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"]
Jul 15 19:44:47.002162 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:44:47.002138    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf33250_c50e_4e04_b3d8_dbf1076893eb.slice/crio-9a065de29a2286e59ab1453bac0498bbc9dfd00b6129fbe41dc277ab017e28ed WatchSource:0}: Error finding container 9a065de29a2286e59ab1453bac0498bbc9dfd00b6129fbe41dc277ab017e28ed: Status 404 returned error can't find the container with id 9a065de29a2286e59ab1453bac0498bbc9dfd00b6129fbe41dc277ab017e28ed
Jul 15 19:44:47.787908 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:47.787871    2562 generic.go:356] "Generic (PLEG): container finished" podID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerID="f15069a232313176ef7cdef9a162f6071e55cbcfb3994b27869c431ac3e73db1" exitCode=7
Jul 15 19:44:47.788256 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:47.787967    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6" event={"ID":"caf33250-c50e-4e04-b3d8-dbf1076893eb","Type":"ContainerDied","Data":"f15069a232313176ef7cdef9a162f6071e55cbcfb3994b27869c431ac3e73db1"}
Jul 15 19:44:47.788256 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:47.788039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6" event={"ID":"caf33250-c50e-4e04-b3d8-dbf1076893eb","Type":"ContainerStarted","Data":"9a065de29a2286e59ab1453bac0498bbc9dfd00b6129fbe41dc277ab017e28ed"}
Jul 15 19:44:47.788256 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:47.788134    2562 scope.go:117] "RemoveContainer" containerID="f15069a232313176ef7cdef9a162f6071e55cbcfb3994b27869c431ac3e73db1"
Jul 15 19:44:48.535043 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:48.535009    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:44:48.795277 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:48.795247    2562 generic.go:356] "Generic (PLEG): container finished" podID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerID="9dd1988f035cc84d46e507554967977032b8fe34ba63483b7fab43c1de52f494" exitCode=7
Jul 15 19:44:48.795624 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:48.795343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6" event={"ID":"caf33250-c50e-4e04-b3d8-dbf1076893eb","Type":"ContainerDied","Data":"9dd1988f035cc84d46e507554967977032b8fe34ba63483b7fab43c1de52f494"}
Jul 15 19:44:48.795624 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:48.795413    2562 scope.go:117] "RemoveContainer" containerID="f15069a232313176ef7cdef9a162f6071e55cbcfb3994b27869c431ac3e73db1"
Jul 15 19:44:48.795624 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:48.795547    2562 scope.go:117] "RemoveContainer" containerID="9dd1988f035cc84d46e507554967977032b8fe34ba63483b7fab43c1de52f494"
Jul 15 19:44:48.795793 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:44:48.795734    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6_odh-ai-gateway-infra(caf33250-c50e-4e04-b3d8-dbf1076893eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb"
Jul 15 19:44:49.777674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:49.777634    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:44:49.803241 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:44:49.803214    2562 scope.go:117] "RemoveContainer" containerID="9dd1988f035cc84d46e507554967977032b8fe34ba63483b7fab43c1de52f494"
Jul 15 19:44:49.803688 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:44:49.803463    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6_odh-ai-gateway-infra(caf33250-c50e-4e04-b3d8-dbf1076893eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb"
Jul 15 19:45:00.130378 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.130338    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7"]
Jul 15 19:45:00.135231 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.135202    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7"
Jul 15 19:45:00.136064 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.136030    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk"]
Jul 15 19:45:00.150535 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.150476    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7"]
Jul 15 19:45:00.150812 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.150795    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk"
Jul 15 19:45:00.153516 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.153085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk"]
Jul 15 19:45:00.158557 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.158538    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7"
Jul 15 19:45:00.165361 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.165340    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk"
Jul 15 19:45:00.300438 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.300317    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7"]
Jul 15 19:45:00.303061 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:45:00.303034    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4adb0fd3_dcf8_4313_b643_d6d430634abb.slice/crio-393f345d9716696d8a5e5b44177003cdb4fc40e3abe6a71fa656fa530d8cb6df WatchSource:0}: Error finding container 393f345d9716696d8a5e5b44177003cdb4fc40e3abe6a71fa656fa530d8cb6df: Status 404 returned error can't find the container with id 393f345d9716696d8a5e5b44177003cdb4fc40e3abe6a71fa656fa530d8cb6df
Jul 15 19:45:00.324989 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.324970    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk"]
Jul 15 19:45:00.327708 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:45:00.327681    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8fe6cb_2b60_47df_913f_87f608144a4d.slice/crio-55a5a6413d922a481a39bce4bbd279bc3f15d9e4c8395ca3ce5c88a2f972de6f WatchSource:0}: Error finding container 55a5a6413d922a481a39bce4bbd279bc3f15d9e4c8395ca3ce5c88a2f972de6f: Status 404 returned error can't find the container with id 55a5a6413d922a481a39bce4bbd279bc3f15d9e4c8395ca3ce5c88a2f972de6f
Jul 15 19:45:00.859118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.859053    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk" event={"ID":"1d8fe6cb-2b60-47df-913f-87f608144a4d","Type":"ContainerStarted","Data":"b523656e574a9d539e2ca247cb6975a4cef6a6d25968e3278e0d48c4050155c1"}
Jul 15 19:45:00.859118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.859110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk" event={"ID":"1d8fe6cb-2b60-47df-913f-87f608144a4d","Type":"ContainerStarted","Data":"55a5a6413d922a481a39bce4bbd279bc3f15d9e4c8395ca3ce5c88a2f972de6f"}
Jul 15 19:45:00.860519 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.860484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7" event={"ID":"4adb0fd3-dcf8-4313-b643-d6d430634abb","Type":"ContainerStarted","Data":"ce8cc5d1084d75dd98ac2fc36351e410aa77bb7b7b9e9ad0a4e859139a62ba07"}
Jul 15 19:45:00.860611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.860538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7" event={"ID":"4adb0fd3-dcf8-4313-b643-d6d430634abb","Type":"ContainerStarted","Data":"393f345d9716696d8a5e5b44177003cdb4fc40e3abe6a71fa656fa530d8cb6df"}
Jul 15 19:45:00.875876 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.875825    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk" podStartSLOduration=0.875805152 podStartE2EDuration="875.805152ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:00.874812851 +0000 UTC m=+1792.872791242" watchObservedRunningTime="2026-07-15 19:45:00.875805152 +0000 UTC m=+1792.873783528"
Jul 15 19:45:00.889203 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:00.889167    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7" podStartSLOduration=0.889154015 podStartE2EDuration="889.154015ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:00.888207404 +0000 UTC m=+1792.886185790" watchObservedRunningTime="2026-07-15 19:45:00.889154015 +0000 UTC m=+1792.887132388"
Jul 15 19:45:01.866193 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:01.866161    2562 generic.go:356] "Generic (PLEG): container finished" podID="1d8fe6cb-2b60-47df-913f-87f608144a4d" containerID="b523656e574a9d539e2ca247cb6975a4cef6a6d25968e3278e0d48c4050155c1" exitCode=0
Jul 15 19:45:01.866601 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:01.866233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk" event={"ID":"1d8fe6cb-2b60-47df-913f-87f608144a4d","Type":"ContainerDied","Data":"b523656e574a9d539e2ca247cb6975a4cef6a6d25968e3278e0d48c4050155c1"}
Jul 15 19:45:01.867606 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:01.867587    2562 generic.go:356] "Generic (PLEG): container finished" podID="4adb0fd3-dcf8-4313-b643-d6d430634abb" containerID="ce8cc5d1084d75dd98ac2fc36351e410aa77bb7b7b9e9ad0a4e859139a62ba07" exitCode=0
Jul 15 19:45:01.867701 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:01.867612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7" event={"ID":"4adb0fd3-dcf8-4313-b643-d6d430634abb","Type":"ContainerDied","Data":"ce8cc5d1084d75dd98ac2fc36351e410aa77bb7b7b9e9ad0a4e859139a62ba07"}
Jul 15 19:45:02.558993 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:02.558966    2562 scope.go:117] "RemoveContainer" containerID="9dd1988f035cc84d46e507554967977032b8fe34ba63483b7fab43c1de52f494"
Jul 15 19:45:02.874429 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:02.874402    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6" event={"ID":"caf33250-c50e-4e04-b3d8-dbf1076893eb","Type":"ContainerStarted","Data":"848a74202999a3276cc875fa28be5dffd7bb8515abdb3b0f731388b404f82897"}
Jul 15 19:45:02.890783 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:02.890737    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6" podStartSLOduration=16.890723549 podStartE2EDuration="16.890723549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:02.889442442 +0000 UTC m=+1794.887420816" watchObservedRunningTime="2026-07-15 19:45:02.890723549 +0000 UTC m=+1794.888701921"
Jul 15 19:45:03.001188 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.001163    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7"
Jul 15 19:45:03.034091 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.034070    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk"
Jul 15 19:45:03.881359 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.881300    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7"
Jul 15 19:45:03.881359 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.881340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-krxt7" event={"ID":"4adb0fd3-dcf8-4313-b643-d6d430634abb","Type":"ContainerDied","Data":"393f345d9716696d8a5e5b44177003cdb4fc40e3abe6a71fa656fa530d8cb6df"}
Jul 15 19:45:03.881840 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.881390    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="393f345d9716696d8a5e5b44177003cdb4fc40e3abe6a71fa656fa530d8cb6df"
Jul 15 19:45:03.882808 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.882787    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk"
Jul 15 19:45:03.882937 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.882817    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk" event={"ID":"1d8fe6cb-2b60-47df-913f-87f608144a4d","Type":"ContainerDied","Data":"55a5a6413d922a481a39bce4bbd279bc3f15d9e4c8395ca3ce5c88a2f972de6f"}
Jul 15 19:45:03.882937 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.882857    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55a5a6413d922a481a39bce4bbd279bc3f15d9e4c8395ca3ce5c88a2f972de6f"
Jul 15 19:45:03.884837 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.884814    2562 generic.go:356] "Generic (PLEG): container finished" podID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerID="848a74202999a3276cc875fa28be5dffd7bb8515abdb3b0f731388b404f82897" exitCode=0
Jul 15 19:45:03.884939 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.884843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6" event={"ID":"caf33250-c50e-4e04-b3d8-dbf1076893eb","Type":"ContainerDied","Data":"848a74202999a3276cc875fa28be5dffd7bb8515abdb3b0f731388b404f82897"}
Jul 15 19:45:03.884939 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.884877    2562 scope.go:117] "RemoveContainer" containerID="9dd1988f035cc84d46e507554967977032b8fe34ba63483b7fab43c1de52f494"
Jul 15 19:45:03.899692 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:03.899671    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"]
Jul 15 19:45:05.021550 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:05.021526    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"
Jul 15 19:45:05.107331 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:05.107308    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf33250-c50e-4e04-b3d8-dbf1076893eb-maas-api-service-ca\") pod \"caf33250-c50e-4e04-b3d8-dbf1076893eb\" (UID: \"caf33250-c50e-4e04-b3d8-dbf1076893eb\") "
Jul 15 19:45:05.107634 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:05.107613    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caf33250-c50e-4e04-b3d8-dbf1076893eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "caf33250-c50e-4e04-b3d8-dbf1076893eb" (UID: "caf33250-c50e-4e04-b3d8-dbf1076893eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:45:05.207850 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:05.207789    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf33250-c50e-4e04-b3d8-dbf1076893eb-maas-api-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:45:05.899795 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:05.899762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6" event={"ID":"caf33250-c50e-4e04-b3d8-dbf1076893eb","Type":"ContainerDied","Data":"9a065de29a2286e59ab1453bac0498bbc9dfd00b6129fbe41dc277ab017e28ed"}
Jul 15 19:45:05.899795 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:05.899784    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"
Jul 15 19:45:05.900005 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:05.899813    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a065de29a2286e59ab1453bac0498bbc9dfd00b6129fbe41dc277ab017e28ed"
Jul 15 19:45:05.930911 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:05.930876    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"]
Jul 15 19:45:05.936982 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:05.936957    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-p4wx6"]
Jul 15 19:45:06.566004 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:06.565972    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" path="/var/lib/kubelet/pods/caf33250-c50e-4e04-b3d8-dbf1076893eb/volumes"
Jul 15 19:45:08.585712 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:08.585687    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:45:08.587958 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:08.587938    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:45:36.599774 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.599736    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"]
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600088    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8fe6cb-2b60-47df-913f-87f608144a4d" containerName="cleanup"
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600101    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8fe6cb-2b60-47df-913f-87f608144a4d" containerName="cleanup"
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600122    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerName="revoke-keys"
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600128    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerName="revoke-keys"
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600138    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerName="revoke-keys"
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600144    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerName="revoke-keys"
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600149    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4adb0fd3-dcf8-4313-b643-d6d430634abb" containerName="cleanup"
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600153    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4adb0fd3-dcf8-4313-b643-d6d430634abb" containerName="cleanup"
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600160    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerName="revoke-keys"
Jul 15 19:45:36.600192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600165    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerName="revoke-keys"
Jul 15 19:45:36.600482 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600221    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerName="revoke-keys"
Jul 15 19:45:36.600482 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600230    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerName="revoke-keys"
Jul 15 19:45:36.600482 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600237    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4adb0fd3-dcf8-4313-b643-d6d430634abb" containerName="cleanup"
Jul 15 19:45:36.600482 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600243    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf33250-c50e-4e04-b3d8-dbf1076893eb" containerName="revoke-keys"
Jul 15 19:45:36.600482 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.600249    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d8fe6cb-2b60-47df-913f-87f608144a4d" containerName="cleanup"
Jul 15 19:45:36.603673 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.603650    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"
Jul 15 19:45:36.606260 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.606238    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:45:36.611118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.611086    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"]
Jul 15 19:45:36.706383 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.706352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5014bfd5-20bd-4cd0-9af2-e1175705f7de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5\" (UID: \"5014bfd5-20bd-4cd0-9af2-e1175705f7de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"
Jul 15 19:45:36.807280 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.807250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5014bfd5-20bd-4cd0-9af2-e1175705f7de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5\" (UID: \"5014bfd5-20bd-4cd0-9af2-e1175705f7de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"
Jul 15 19:45:36.807869 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.807847    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5014bfd5-20bd-4cd0-9af2-e1175705f7de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5\" (UID: \"5014bfd5-20bd-4cd0-9af2-e1175705f7de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"
Jul 15 19:45:36.916792 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:36.916720    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"
Jul 15 19:45:37.046933 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:37.046900    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"]
Jul 15 19:45:37.048615 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:45:37.048582    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5014bfd5_20bd_4cd0_9af2_e1175705f7de.slice/crio-d42f4e943a7a52768c96543c8feebd6756f92bf7511e34577ee6a89ebf7d1169 WatchSource:0}: Error finding container d42f4e943a7a52768c96543c8feebd6756f92bf7511e34577ee6a89ebf7d1169: Status 404 returned error can't find the container with id d42f4e943a7a52768c96543c8feebd6756f92bf7511e34577ee6a89ebf7d1169
Jul 15 19:45:37.060699 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:37.060668    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5" event={"ID":"5014bfd5-20bd-4cd0-9af2-e1175705f7de","Type":"ContainerStarted","Data":"d42f4e943a7a52768c96543c8feebd6756f92bf7511e34577ee6a89ebf7d1169"}
Jul 15 19:45:38.067187 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:38.067149    2562 generic.go:356] "Generic (PLEG): container finished" podID="5014bfd5-20bd-4cd0-9af2-e1175705f7de" containerID="decad12ad9c679b9cdcb7f1fde5064e636245295f53aa282a870ddb0de36e4b3" exitCode=0
Jul 15 19:45:38.067531 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:38.067243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5" event={"ID":"5014bfd5-20bd-4cd0-9af2-e1175705f7de","Type":"ContainerDied","Data":"decad12ad9c679b9cdcb7f1fde5064e636245295f53aa282a870ddb0de36e4b3"}
Jul 15 19:45:39.197772 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:39.197750    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"
Jul 15 19:45:39.223559 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:39.223540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5014bfd5-20bd-4cd0-9af2-e1175705f7de-maas-api-service-ca\") pod \"5014bfd5-20bd-4cd0-9af2-e1175705f7de\" (UID: \"5014bfd5-20bd-4cd0-9af2-e1175705f7de\") "
Jul 15 19:45:39.223850 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:39.223832    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5014bfd5-20bd-4cd0-9af2-e1175705f7de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5014bfd5-20bd-4cd0-9af2-e1175705f7de" (UID: "5014bfd5-20bd-4cd0-9af2-e1175705f7de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:45:39.324122 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:39.324066    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5014bfd5-20bd-4cd0-9af2-e1175705f7de-maas-api-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:45:40.078379 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:40.078349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5" event={"ID":"5014bfd5-20bd-4cd0-9af2-e1175705f7de","Type":"ContainerDied","Data":"d42f4e943a7a52768c96543c8feebd6756f92bf7511e34577ee6a89ebf7d1169"}
Jul 15 19:45:40.078528 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:40.078383    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5"
Jul 15 19:45:40.078528 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:40.078395    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d42f4e943a7a52768c96543c8feebd6756f92bf7511e34577ee6a89ebf7d1169"
Jul 15 19:45:46.976003 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:46.975957    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"]
Jul 15 19:45:46.976585 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:46.976281    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz" podUID="aa18fda3-f089-4fb7-b9c1-d643e09ea8b0" containerName="maas-api" containerID="cri-o://b2811e816798e123c5b86c63198b28da9d32457bcd9f4171457b470cbea0102a" gracePeriod=30
Jul 15 19:45:46.994007 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:46.993979    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk"]
Jul 15 19:45:47.000015 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:46.999985    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a0aec9a3-29735745-f9rwk"]
Jul 15 19:45:47.122304 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.122278    2562 generic.go:356] "Generic (PLEG): container finished" podID="aa18fda3-f089-4fb7-b9c1-d643e09ea8b0" containerID="b2811e816798e123c5b86c63198b28da9d32457bcd9f4171457b470cbea0102a" exitCode=0
Jul 15 19:45:47.122435 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.122347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz" event={"ID":"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0","Type":"ContainerDied","Data":"b2811e816798e123c5b86c63198b28da9d32457bcd9f4171457b470cbea0102a"}
Jul 15 19:45:47.220537 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.220518    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:45:47.282181 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.282153    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmpdg\" (UniqueName: \"kubernetes.io/projected/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-kube-api-access-tmpdg\") pod \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") "
Jul 15 19:45:47.282304 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.282191    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-maas-api-tls\") pod \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") "
Jul 15 19:45:47.282304 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.282242    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-openshift-service-ca\") pod \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\" (UID: \"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0\") "
Jul 15 19:45:47.282655 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.282633    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa18fda3-f089-4fb7-b9c1-d643e09ea8b0" (UID: "aa18fda3-f089-4fb7-b9c1-d643e09ea8b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:45:47.284094 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.284074    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa18fda3-f089-4fb7-b9c1-d643e09ea8b0" (UID: "aa18fda3-f089-4fb7-b9c1-d643e09ea8b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:45:47.284179 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.284161    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-kube-api-access-tmpdg" (OuterVolumeSpecName: "kube-api-access-tmpdg") pod "aa18fda3-f089-4fb7-b9c1-d643e09ea8b0" (UID: "aa18fda3-f089-4fb7-b9c1-d643e09ea8b0"). InnerVolumeSpecName "kube-api-access-tmpdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:45:47.383789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.383765    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmpdg\" (UniqueName: \"kubernetes.io/projected/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-kube-api-access-tmpdg\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:45:47.383789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.383787    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-maas-api-tls\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:45:47.383904 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:47.383796    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0-openshift-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:45:48.128857 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:48.128828    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"
Jul 15 19:45:48.129237 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:48.128864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz" event={"ID":"aa18fda3-f089-4fb7-b9c1-d643e09ea8b0","Type":"ContainerDied","Data":"9c6e0ba075c6d0e21a36b3b01ea1695e99491925c27eabc68ad5957c1137f7f0"}
Jul 15 19:45:48.129237 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:48.128940    2562 scope.go:117] "RemoveContainer" containerID="b2811e816798e123c5b86c63198b28da9d32457bcd9f4171457b470cbea0102a"
Jul 15 19:45:48.152559 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:48.152520    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"]
Jul 15 19:45:48.158121 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:48.158097    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0aec9a3-7bf856948b-xzffz"]
Jul 15 19:45:48.564690 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:48.564667    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d8fe6cb-2b60-47df-913f-87f608144a4d" path="/var/lib/kubelet/pods/1d8fe6cb-2b60-47df-913f-87f608144a4d/volumes"
Jul 15 19:45:48.565037 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:48.565022    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa18fda3-f089-4fb7-b9c1-d643e09ea8b0" path="/var/lib/kubelet/pods/aa18fda3-f089-4fb7-b9c1-d643e09ea8b0/volumes"
Jul 15 19:45:49.927440 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:49.927410    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:45:59.035001 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.034970    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"]
Jul 15 19:45:59.035437 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.035351    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5014bfd5-20bd-4cd0-9af2-e1175705f7de" containerName="revoke-keys"
Jul 15 19:45:59.035437 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.035370    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5014bfd5-20bd-4cd0-9af2-e1175705f7de" containerName="revoke-keys"
Jul 15 19:45:59.035437 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.035383    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa18fda3-f089-4fb7-b9c1-d643e09ea8b0" containerName="maas-api"
Jul 15 19:45:59.035437 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.035396    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa18fda3-f089-4fb7-b9c1-d643e09ea8b0" containerName="maas-api"
Jul 15 19:45:59.035659 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.035558    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5014bfd5-20bd-4cd0-9af2-e1175705f7de" containerName="revoke-keys"
Jul 15 19:45:59.035659 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.035569    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa18fda3-f089-4fb7-b9c1-d643e09ea8b0" containerName="maas-api"
Jul 15 19:45:59.039954 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.039917    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.042615 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.042594    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1ebae1b1-openshift-default-dockercfg-cd5cb\""
Jul 15 19:45:59.051051 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.051029    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"]
Jul 15 19:45:59.179742 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.179709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istiod-ca-cert\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.179742 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.179748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-credential-socket\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.179899 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.179768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-socket\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.179899 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.179796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-token\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.179899 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.179823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pscbn\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-kube-api-access-pscbn\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.179899 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.179865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-envoy\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.179899 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.179888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-podinfo\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.180069 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.179906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-certs\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.180069 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.179926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-data\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281013 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.280980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-envoy\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281114 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-podinfo\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281114 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-certs\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281114 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-data\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281114 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istiod-ca-cert\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281248 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-credential-socket\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281248 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-socket\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281310 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-token\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281359 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pscbn\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-kube-api-access-pscbn\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281484 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281462    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-certs\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281570 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-credential-socket\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281569    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-socket\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281679 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281628    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-data\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.281987 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.281969    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istiod-ca-cert\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.283921 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.283895    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-envoy\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.284058 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.283988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-podinfo\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.290747 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.290686    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-token\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.290896 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.290808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pscbn\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-kube-api-access-pscbn\") pod \"e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") " pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.352326 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.352301    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:45:59.490465 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:45:59.490437    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"]
Jul 15 19:45:59.492712 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:45:59.492680    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb0a47d_1fde_4455_9337_2c5c5891f21d.slice/crio-02c027caeef7094df23d8c6928fe8b25e69db0c4dadca49fa70dc0e6dd82d74b WatchSource:0}: Error finding container 02c027caeef7094df23d8c6928fe8b25e69db0c4dadca49fa70dc0e6dd82d74b: Status 404 returned error can't find the container with id 02c027caeef7094df23d8c6928fe8b25e69db0c4dadca49fa70dc0e6dd82d74b
Jul 15 19:46:00.189834 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:00.189799    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" event={"ID":"aeb0a47d-1fde-4455-9337-2c5c5891f21d","Type":"ContainerStarted","Data":"02c027caeef7094df23d8c6928fe8b25e69db0c4dadca49fa70dc0e6dd82d74b"}
Jul 15 19:46:02.243170 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:02.243138    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:46:02.243456 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:02.243202    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:46:02.243456 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:02.243232    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:46:02.638184 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:02.638098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:46:03.207147 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:03.207117    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" event={"ID":"aeb0a47d-1fde-4455-9337-2c5c5891f21d","Type":"ContainerStarted","Data":"a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840"}
Jul 15 19:46:03.228684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:03.228641    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" podStartSLOduration=1.481501062 podStartE2EDuration="4.228627483s" totalImagesPullingTime="2.747126421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:03.226739743 +0000 UTC m=+1855.224718129" watchObservedRunningTime="2026-07-15 19:46:03.228627483 +0000 UTC m=+1855.226605856"
Jul 15 19:46:03.353374 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:03.353310    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:46:03.358157 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:03.358136    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:46:04.213394 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.213365    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:46:04.284679 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.284648    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:46:04.602187 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.602150    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"]
Jul 15 19:46:04.606407 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.606387    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"
Jul 15 19:46:04.609628 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.609605    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:46:04.609736 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.609611    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:46:04.616057 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.616033    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"]
Jul 15 19:46:04.729992 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.729961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99a27ed-cdaf-4234-b958-3f31699c4e31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s\" (UID: \"a99a27ed-cdaf-4234-b958-3f31699c4e31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"
Jul 15 19:46:04.831308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.831280    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99a27ed-cdaf-4234-b958-3f31699c4e31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s\" (UID: \"a99a27ed-cdaf-4234-b958-3f31699c4e31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"
Jul 15 19:46:04.831894 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.831876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99a27ed-cdaf-4234-b958-3f31699c4e31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s\" (UID: \"a99a27ed-cdaf-4234-b958-3f31699c4e31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"
Jul 15 19:46:04.919551 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:04.919442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"
Jul 15 19:46:05.278335 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:05.278301    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"]
Jul 15 19:46:05.279400 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:46:05.279374    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99a27ed_cdaf_4234_b958_3f31699c4e31.slice/crio-67ab1b8d76d1272578073ba4a368e1ffc63d163fdfe582b98a32b065fa2127b1 WatchSource:0}: Error finding container 67ab1b8d76d1272578073ba4a368e1ffc63d163fdfe582b98a32b065fa2127b1: Status 404 returned error can't find the container with id 67ab1b8d76d1272578073ba4a368e1ffc63d163fdfe582b98a32b065fa2127b1
Jul 15 19:46:06.225086 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:06.225059    2562 generic.go:356] "Generic (PLEG): container finished" podID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerID="267abbb270ad2d1dbd23ca7d03d9625d5b45059bb930376fe1d67ff323c5e896" exitCode=7
Jul 15 19:46:06.225387 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:06.225138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s" event={"ID":"a99a27ed-cdaf-4234-b958-3f31699c4e31","Type":"ContainerDied","Data":"267abbb270ad2d1dbd23ca7d03d9625d5b45059bb930376fe1d67ff323c5e896"}
Jul 15 19:46:06.225387 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:06.225207    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s" event={"ID":"a99a27ed-cdaf-4234-b958-3f31699c4e31","Type":"ContainerStarted","Data":"67ab1b8d76d1272578073ba4a368e1ffc63d163fdfe582b98a32b065fa2127b1"}
Jul 15 19:46:06.225387 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:06.225285    2562 scope.go:117] "RemoveContainer" containerID="267abbb270ad2d1dbd23ca7d03d9625d5b45059bb930376fe1d67ff323c5e896"
Jul 15 19:46:07.232145 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:07.232116    2562 generic.go:356] "Generic (PLEG): container finished" podID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerID="88aa1cfbe6e8c250dffcb11d9c6aab06f6f5888b0c010966b481aca80acb63c7" exitCode=7
Jul 15 19:46:07.232457 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:07.232168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s" event={"ID":"a99a27ed-cdaf-4234-b958-3f31699c4e31","Type":"ContainerDied","Data":"88aa1cfbe6e8c250dffcb11d9c6aab06f6f5888b0c010966b481aca80acb63c7"}
Jul 15 19:46:07.232457 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:07.232212    2562 scope.go:117] "RemoveContainer" containerID="267abbb270ad2d1dbd23ca7d03d9625d5b45059bb930376fe1d67ff323c5e896"
Jul 15 19:46:07.232457 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:07.232416    2562 scope.go:117] "RemoveContainer" containerID="88aa1cfbe6e8c250dffcb11d9c6aab06f6f5888b0c010966b481aca80acb63c7"
Jul 15 19:46:07.232665 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:46:07.232645    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s_odh-ai-gateway-infra(a99a27ed-cdaf-4234-b958-3f31699c4e31)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31"
Jul 15 19:46:08.239200 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:08.239176    2562 scope.go:117] "RemoveContainer" containerID="88aa1cfbe6e8c250dffcb11d9c6aab06f6f5888b0c010966b481aca80acb63c7"
Jul 15 19:46:08.239603 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:46:08.239371    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s_odh-ai-gateway-infra(a99a27ed-cdaf-4234-b958-3f31699c4e31)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31"
Jul 15 19:46:10.249849 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:10.249824    2562 generic.go:356] "Generic (PLEG): container finished" podID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerID="a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840" exitCode=0
Jul 15 19:46:10.250197 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:10.249895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" event={"ID":"aeb0a47d-1fde-4455-9337-2c5c5891f21d","Type":"ContainerDied","Data":"a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840"}
Jul 15 19:46:10.250259 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:10.250217    2562 scope.go:117] "RemoveContainer" containerID="a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840"
Jul 15 19:46:10.251178 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:10.251152    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:46:10.251254 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:10.251214    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:46:10.251254 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:10.251242    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:46:11.257168 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:11.257132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" event={"ID":"aeb0a47d-1fde-4455-9337-2c5c5891f21d","Type":"ContainerStarted","Data":"499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c"}
Jul 15 19:46:11.352456 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:11.352423    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:46:11.352681 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:11.352663    2562 patch_prober.go:28] interesting pod/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 19:46:11.352728 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:11.352704    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 19:46:12.353423 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:12.353389    2562 patch_prober.go:28] interesting pod/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 19:46:12.353807 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:12.353449    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 19:46:13.352796 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:13.352757    2562 patch_prober.go:28] interesting pod/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 19:46:13.352950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:13.352821    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 19:46:14.353253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:14.353173    2562 patch_prober.go:28] interesting pod/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 19:46:14.353253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:14.353235    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 19:46:15.356784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:15.356757    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:46:15.357266 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:15.357138    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:46:15.357937 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:15.357919    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:46:18.561074 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:18.561043    2562 scope.go:117] "RemoveContainer" containerID="88aa1cfbe6e8c250dffcb11d9c6aab06f6f5888b0c010966b481aca80acb63c7"
Jul 15 19:46:19.298537 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:19.298508    2562 generic.go:356] "Generic (PLEG): container finished" podID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerID="89ca0e1b678f051122dcf0a2450a2c3d49972732b376805348e00f053bdcb2e1" exitCode=0
Jul 15 19:46:19.298537 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:19.298527    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s" event={"ID":"a99a27ed-cdaf-4234-b958-3f31699c4e31","Type":"ContainerDied","Data":"89ca0e1b678f051122dcf0a2450a2c3d49972732b376805348e00f053bdcb2e1"}
Jul 15 19:46:19.298703 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:19.298593    2562 scope.go:117] "RemoveContainer" containerID="88aa1cfbe6e8c250dffcb11d9c6aab06f6f5888b0c010966b481aca80acb63c7"
Jul 15 19:46:20.330705 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:20.330678    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"]
Jul 15 19:46:20.442554 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:20.442535    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"
Jul 15 19:46:20.569890 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:20.569831    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99a27ed-cdaf-4234-b958-3f31699c4e31-maas-api-service-ca\") pod \"a99a27ed-cdaf-4234-b958-3f31699c4e31\" (UID: \"a99a27ed-cdaf-4234-b958-3f31699c4e31\") "
Jul 15 19:46:20.570186 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:20.570164    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a99a27ed-cdaf-4234-b958-3f31699c4e31-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a99a27ed-cdaf-4234-b958-3f31699c4e31" (UID: "a99a27ed-cdaf-4234-b958-3f31699c4e31"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:46:20.670810 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:20.670784    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99a27ed-cdaf-4234-b958-3f31699c4e31-maas-api-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:46:21.312992 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:21.312967    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"
Jul 15 19:46:21.313119 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:21.313010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s" event={"ID":"a99a27ed-cdaf-4234-b958-3f31699c4e31","Type":"ContainerDied","Data":"67ab1b8d76d1272578073ba4a368e1ffc63d163fdfe582b98a32b065fa2127b1"}
Jul 15 19:46:21.313119 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:21.313069    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67ab1b8d76d1272578073ba4a368e1ffc63d163fdfe582b98a32b065fa2127b1"
Jul 15 19:46:21.342670 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:21.342642    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"]
Jul 15 19:46:21.347044 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:21.347022    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-xpv9s"]
Jul 15 19:46:22.564317 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:22.564283    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" path="/var/lib/kubelet/pods/a99a27ed-cdaf-4234-b958-3f31699c4e31/volumes"
Jul 15 19:46:54.640010 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.639969    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"]
Jul 15 19:46:54.640554 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.640305    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerName="revoke-keys"
Jul 15 19:46:54.640554 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.640316    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerName="revoke-keys"
Jul 15 19:46:54.640554 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.640343    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerName="revoke-keys"
Jul 15 19:46:54.640554 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.640348    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerName="revoke-keys"
Jul 15 19:46:54.640554 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.640408    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerName="revoke-keys"
Jul 15 19:46:54.640554 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.640416    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerName="revoke-keys"
Jul 15 19:46:54.640554 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.640423    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerName="revoke-keys"
Jul 15 19:46:54.643738 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.643716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"
Jul 15 19:46:54.646471 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.646442    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:46:54.646636 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.646483    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:46:54.650300 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.650273    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"]
Jul 15 19:46:54.740471 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.740443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab94108b-582b-4211-b4ac-4fc41e01fbba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm\" (UID: \"ab94108b-582b-4211-b4ac-4fc41e01fbba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"
Jul 15 19:46:54.841779 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.841751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab94108b-582b-4211-b4ac-4fc41e01fbba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm\" (UID: \"ab94108b-582b-4211-b4ac-4fc41e01fbba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"
Jul 15 19:46:54.842427 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.842398    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab94108b-582b-4211-b4ac-4fc41e01fbba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm\" (UID: \"ab94108b-582b-4211-b4ac-4fc41e01fbba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"
Jul 15 19:46:54.956330 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:54.956268    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"
Jul 15 19:46:55.093010 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:55.092985    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"]
Jul 15 19:46:55.094109 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:46:55.094083    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab94108b_582b_4211_b4ac_4fc41e01fbba.slice/crio-c7981afd42b764a31cfea51f00b469a55463406982494e749d6a33742a49b489 WatchSource:0}: Error finding container c7981afd42b764a31cfea51f00b469a55463406982494e749d6a33742a49b489: Status 404 returned error can't find the container with id c7981afd42b764a31cfea51f00b469a55463406982494e749d6a33742a49b489
Jul 15 19:46:55.495452 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:55.495420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm" event={"ID":"ab94108b-582b-4211-b4ac-4fc41e01fbba","Type":"ContainerStarted","Data":"e8ad5a34c128a54234f56633709ae854d40b5ee110168a3851697eccbcbb919e"}
Jul 15 19:46:55.495577 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:55.495473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm" event={"ID":"ab94108b-582b-4211-b4ac-4fc41e01fbba","Type":"ContainerStarted","Data":"c7981afd42b764a31cfea51f00b469a55463406982494e749d6a33742a49b489"}
Jul 15 19:46:55.510028 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:55.509985    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm" podStartSLOduration=1.509958101 podStartE2EDuration="1.509958101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:55.509850894 +0000 UTC m=+1907.507829283" watchObservedRunningTime="2026-07-15 19:46:55.509958101 +0000 UTC m=+1907.507936473"
Jul 15 19:46:56.503106 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:56.503069    2562 generic.go:356] "Generic (PLEG): container finished" podID="ab94108b-582b-4211-b4ac-4fc41e01fbba" containerID="e8ad5a34c128a54234f56633709ae854d40b5ee110168a3851697eccbcbb919e" exitCode=0
Jul 15 19:46:56.503470 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:56.503125    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm" event={"ID":"ab94108b-582b-4211-b4ac-4fc41e01fbba","Type":"ContainerDied","Data":"e8ad5a34c128a54234f56633709ae854d40b5ee110168a3851697eccbcbb919e"}
Jul 15 19:46:57.641121 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:57.641100    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"
Jul 15 19:46:57.764935 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:57.764882    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab94108b-582b-4211-b4ac-4fc41e01fbba-maas-api-service-ca\") pod \"ab94108b-582b-4211-b4ac-4fc41e01fbba\" (UID: \"ab94108b-582b-4211-b4ac-4fc41e01fbba\") "
Jul 15 19:46:57.765246 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:57.765226    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab94108b-582b-4211-b4ac-4fc41e01fbba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ab94108b-582b-4211-b4ac-4fc41e01fbba" (UID: "ab94108b-582b-4211-b4ac-4fc41e01fbba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:46:57.865572 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:57.865547    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab94108b-582b-4211-b4ac-4fc41e01fbba-maas-api-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:46:58.514781 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:58.514752    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm" event={"ID":"ab94108b-582b-4211-b4ac-4fc41e01fbba","Type":"ContainerDied","Data":"c7981afd42b764a31cfea51f00b469a55463406982494e749d6a33742a49b489"}
Jul 15 19:46:58.514902 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:58.514787    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm"
Jul 15 19:46:58.514902 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:46:58.514801    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7981afd42b764a31cfea51f00b469a55463406982494e749d6a33742a49b489"
Jul 15 19:47:08.028801 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:08.028766    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:47:09.867533 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:09.867486    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"]
Jul 15 19:47:09.867905 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:09.867718    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy" containerID="cri-o://499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c" gracePeriod=30
Jul 15 19:47:15.124108 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.124087    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:47:15.194644 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194622    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-certs\") pod \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") "
Jul 15 19:47:15.194760 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194668    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-socket\") pod \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") "
Jul 15 19:47:15.194760 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pscbn\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-kube-api-access-pscbn\") pod \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") "
Jul 15 19:47:15.194760 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194752    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-podinfo\") pod \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") "
Jul 15 19:47:15.194884 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194780    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-token\") pod \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") "
Jul 15 19:47:15.194884 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194815    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-data\") pod \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") "
Jul 15 19:47:15.194884 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194847    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-credential-socket\") pod \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") "
Jul 15 19:47:15.195014 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194889    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-envoy\") pod \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") "
Jul 15 19:47:15.195014 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194893    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aeb0a47d-1fde-4455-9337-2c5c5891f21d" (UID: "aeb0a47d-1fde-4455-9337-2c5c5891f21d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:47:15.195014 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.194920    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istiod-ca-cert\") pod \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\" (UID: \"aeb0a47d-1fde-4455-9337-2c5c5891f21d\") "
Jul 15 19:47:15.195156 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.195006    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aeb0a47d-1fde-4455-9337-2c5c5891f21d" (UID: "aeb0a47d-1fde-4455-9337-2c5c5891f21d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:47:15.195250 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.195232    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:47:15.195309 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.195257    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-workload-certs\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:47:15.195309 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.195290    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aeb0a47d-1fde-4455-9337-2c5c5891f21d" (UID: "aeb0a47d-1fde-4455-9337-2c5c5891f21d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:47:15.195626 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.195603    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aeb0a47d-1fde-4455-9337-2c5c5891f21d" (UID: "aeb0a47d-1fde-4455-9337-2c5c5891f21d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:47:15.195783 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.195758    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-data" (OuterVolumeSpecName: "istio-data") pod "aeb0a47d-1fde-4455-9337-2c5c5891f21d" (UID: "aeb0a47d-1fde-4455-9337-2c5c5891f21d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:47:15.197183 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.197150    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aeb0a47d-1fde-4455-9337-2c5c5891f21d" (UID: "aeb0a47d-1fde-4455-9337-2c5c5891f21d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:47:15.197272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.197240    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-token" (OuterVolumeSpecName: "istio-token") pod "aeb0a47d-1fde-4455-9337-2c5c5891f21d" (UID: "aeb0a47d-1fde-4455-9337-2c5c5891f21d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:47:15.197337 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.197272    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aeb0a47d-1fde-4455-9337-2c5c5891f21d" (UID: "aeb0a47d-1fde-4455-9337-2c5c5891f21d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:47:15.197337 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.197313    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-kube-api-access-pscbn" (OuterVolumeSpecName: "kube-api-access-pscbn") pod "aeb0a47d-1fde-4455-9337-2c5c5891f21d" (UID: "aeb0a47d-1fde-4455-9337-2c5c5891f21d"). InnerVolumeSpecName "kube-api-access-pscbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:47:15.295882 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.295861    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pscbn\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-kube-api-access-pscbn\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:47:15.295882 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.295881    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-podinfo\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:47:15.295991 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.295890    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:47:15.295991 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.295897    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-data\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:47:15.295991 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.295905    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-credential-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:47:15.295991 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.295913    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istio-envoy\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:47:15.295991 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.295920    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aeb0a47d-1fde-4455-9337-2c5c5891f21d-istiod-ca-cert\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:47:15.608684 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.608657    2562 generic.go:356] "Generic (PLEG): container finished" podID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerID="499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c" exitCode=0
Jul 15 19:47:15.608796 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.608711    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"
Jul 15 19:47:15.608845 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.608715    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" event={"ID":"aeb0a47d-1fde-4455-9337-2c5c5891f21d","Type":"ContainerDied","Data":"499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c"}
Jul 15 19:47:15.608881 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.608848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd" event={"ID":"aeb0a47d-1fde-4455-9337-2c5c5891f21d","Type":"ContainerDied","Data":"02c027caeef7094df23d8c6928fe8b25e69db0c4dadca49fa70dc0e6dd82d74b"}
Jul 15 19:47:15.608922 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.608891    2562 scope.go:117] "RemoveContainer" containerID="499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c"
Jul 15 19:47:15.623972 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.623954    2562 scope.go:117] "RemoveContainer" containerID="a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840"
Jul 15 19:47:15.632056 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.632035    2562 scope.go:117] "RemoveContainer" containerID="499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c"
Jul 15 19:47:15.632568 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:47:15.632541    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c\": container with ID starting with 499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c not found: ID does not exist" containerID="499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c"
Jul 15 19:47:15.632674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.632578    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c"} err="failed to get container status \"499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c\": rpc error: code = NotFound desc = could not find container \"499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c\": container with ID starting with 499a8d253b42a1eaebb27a8aabb5cd5a87cc4bc09c4fc7ea3fc93cdefffd421c not found: ID does not exist"
Jul 15 19:47:15.632674 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.632603    2562 scope.go:117] "RemoveContainer" containerID="a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840"
Jul 15 19:47:15.632917 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:47:15.632901    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840\": container with ID starting with a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840 not found: ID does not exist" containerID="a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840"
Jul 15 19:47:15.632971 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.632925    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840"} err="failed to get container status \"a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840\": rpc error: code = NotFound desc = could not find container \"a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840\": container with ID starting with a06b979477f0b1b9fce87d62cc7ebc95343252423f22e6b5836f6572e5172840 not found: ID does not exist"
Jul 15 19:47:15.634467 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.634448    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"]
Jul 15 19:47:15.639728 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:15.639706    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1ebae1b1-openshift-default-79c648df7f-hdhcd"]
Jul 15 19:47:16.565224 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:47:16.565191    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" path="/var/lib/kubelet/pods/aeb0a47d-1fde-4455-9337-2c5c5891f21d/volumes"
Jul 15 19:48:40.537882 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:40.537844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:48:52.630118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.630084    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:48:52.820207 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820169    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"]
Jul 15 19:48:52.820534 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820517    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy"
Jul 15 19:48:52.820534 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820535    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy"
Jul 15 19:48:52.820651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820544    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab94108b-582b-4211-b4ac-4fc41e01fbba" containerName="revoke-keys"
Jul 15 19:48:52.820651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820549    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab94108b-582b-4211-b4ac-4fc41e01fbba" containerName="revoke-keys"
Jul 15 19:48:52.820651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820564    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy"
Jul 15 19:48:52.820651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820570    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy"
Jul 15 19:48:52.820651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820578    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerName="revoke-keys"
Jul 15 19:48:52.820651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820583    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a99a27ed-cdaf-4234-b958-3f31699c4e31" containerName="revoke-keys"
Jul 15 19:48:52.820651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820643    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy"
Jul 15 19:48:52.820651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820649    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab94108b-582b-4211-b4ac-4fc41e01fbba" containerName="revoke-keys"
Jul 15 19:48:52.820651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.820656    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb0a47d-1fde-4455-9337-2c5c5891f21d" containerName="istio-proxy"
Jul 15 19:48:52.823537 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.823521    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:52.826336 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.826316    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f3e285c6-openshift-default-dockercfg-d9rx5\""
Jul 15 19:48:52.839474 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.839451    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"]
Jul 15 19:48:52.926568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.926488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9j4v\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-kube-api-access-d9j4v\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:52.926568 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.926541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-data\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:52.926738 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.926571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-token\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:52.926738 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.926597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-certs\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:52.926738 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.926670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istiod-ca-cert\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:52.926738 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.926712    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-credential-socket\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:52.926890 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.926743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-podinfo\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:52.926890 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.926760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-envoy\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:52.926890 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:52.926784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-socket\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.027574 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-data\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.027574 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027578    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-token\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.027750 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-certs\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.027750 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istiod-ca-cert\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.027750 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-credential-socket\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.027750 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-podinfo\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.027750 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-envoy\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.028001 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-socket\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.028001 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9j4v\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-kube-api-access-d9j4v\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.028001 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.027968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-data\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.028149 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.028101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-socket\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.028268 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.028240    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-credential-socket\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.028391 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.028364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-certs\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.028594 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.028575    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istiod-ca-cert\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.030074 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.030052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-envoy\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.030297 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.030277    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-podinfo\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.038418 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.038401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-token\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.038591 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.038566    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9j4v\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-kube-api-access-d9j4v\") pod \"e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") " pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.133125 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.133100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:53.267698 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.267670    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"]
Jul 15 19:48:53.268959 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:48:53.268934    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1d7eef_5f1f_468a_a008_4e3f874a1ddb.slice/crio-04333bdc13de41aa7344ffc80ae34cd13e468715bbf9a444ae6310787ca86165 WatchSource:0}: Error finding container 04333bdc13de41aa7344ffc80ae34cd13e468715bbf9a444ae6310787ca86165: Status 404 returned error can't find the container with id 04333bdc13de41aa7344ffc80ae34cd13e468715bbf9a444ae6310787ca86165
Jul 15 19:48:53.270871 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.270842    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:48:53.270945 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.270899    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:48:53.270945 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:53.270927    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:48:54.119468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:54.119417    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" event={"ID":"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb","Type":"ContainerStarted","Data":"90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6"}
Jul 15 19:48:54.119926 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:54.119538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" event={"ID":"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb","Type":"ContainerStarted","Data":"04333bdc13de41aa7344ffc80ae34cd13e468715bbf9a444ae6310787ca86165"}
Jul 15 19:48:54.133663 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:54.133631    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:54.138620 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:54.138598    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:54.143323 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:54.143278    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" podStartSLOduration=2.143261317 podStartE2EDuration="2.143261317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:48:54.140805827 +0000 UTC m=+2026.138784182" watchObservedRunningTime="2026-07-15 19:48:54.143261317 +0000 UTC m=+2026.141239690"
Jul 15 19:48:55.124555 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:55.124522    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:55.125400 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:55.125378    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:48:56.245711 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.245674    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"]
Jul 15 19:48:56.249123 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.249107    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.251651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.251630    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f3e285c6-serving-cert\""
Jul 15 19:48:56.251808 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.251659    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5qhz\""
Jul 15 19:48:56.252868 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.252852    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:48:56.252972 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.252851    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 19:48:56.257929 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.257907    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"]
Jul 15 19:48:56.352962 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.352928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4498bdce-ebaa-4ac3-9478-51af977b04bb-openshift-service-ca\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.353119 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.353031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8m89\" (UniqueName: \"kubernetes.io/projected/4498bdce-ebaa-4ac3-9478-51af977b04bb-kube-api-access-l8m89\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.353119 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.353079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4498bdce-ebaa-4ac3-9478-51af977b04bb-maas-api-tls\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.454346 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.454310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4498bdce-ebaa-4ac3-9478-51af977b04bb-openshift-service-ca\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.454530 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.454371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8m89\" (UniqueName: \"kubernetes.io/projected/4498bdce-ebaa-4ac3-9478-51af977b04bb-kube-api-access-l8m89\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.454530 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.454403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4498bdce-ebaa-4ac3-9478-51af977b04bb-maas-api-tls\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.454619 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:48:56.454530    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-serving-cert: secret "maas-api-e2e-mt-f3e285c6-serving-cert" not found
Jul 15 19:48:56.454619 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:48:56.454593    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4498bdce-ebaa-4ac3-9478-51af977b04bb-maas-api-tls podName:4498bdce-ebaa-4ac3-9478-51af977b04bb nodeName:}" failed. No retries permitted until 2026-07-15 19:48:56.954573825 +0000 UTC m=+2028.952552176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4498bdce-ebaa-4ac3-9478-51af977b04bb-maas-api-tls") pod "maas-api-e2e-mt-f3e285c6-875b646c4-wjllt" (UID: "4498bdce-ebaa-4ac3-9478-51af977b04bb") : secret "maas-api-e2e-mt-f3e285c6-serving-cert" not found
Jul 15 19:48:56.454935 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.454917    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4498bdce-ebaa-4ac3-9478-51af977b04bb-openshift-service-ca\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.465434 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.465412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8m89\" (UniqueName: \"kubernetes.io/projected/4498bdce-ebaa-4ac3-9478-51af977b04bb-kube-api-access-l8m89\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.957945 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.957913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4498bdce-ebaa-4ac3-9478-51af977b04bb-maas-api-tls\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:56.960466 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:56.960436    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4498bdce-ebaa-4ac3-9478-51af977b04bb-maas-api-tls\") pod \"maas-api-e2e-mt-f3e285c6-875b646c4-wjllt\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:57.161328 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:57.161300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:57.291045 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:57.291017    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"]
Jul 15 19:48:57.292322 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:48:57.292290    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4498bdce_ebaa_4ac3_9478_51af977b04bb.slice/crio-79f96db9b952152e9dc443c3e1c5120239cbedab3d52af8945197e861f6bed85 WatchSource:0}: Error finding container 79f96db9b952152e9dc443c3e1c5120239cbedab3d52af8945197e861f6bed85: Status 404 returned error can't find the container with id 79f96db9b952152e9dc443c3e1c5120239cbedab3d52af8945197e861f6bed85
Jul 15 19:48:57.293804 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:57.293784    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:48:58.139544 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:58.139441    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt" event={"ID":"4498bdce-ebaa-4ac3-9478-51af977b04bb","Type":"ContainerStarted","Data":"5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad"}
Jul 15 19:48:58.139544 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:58.139521    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:48:58.139544 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:58.139539    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt" event={"ID":"4498bdce-ebaa-4ac3-9478-51af977b04bb","Type":"ContainerStarted","Data":"79f96db9b952152e9dc443c3e1c5120239cbedab3d52af8945197e861f6bed85"}
Jul 15 19:48:58.159329 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:48:58.159285    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt" podStartSLOduration=1.703761152 podStartE2EDuration="2.159269805s" totalImagesPullingTime="455.508653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:48:58.15775403 +0000 UTC m=+2030.155732413" watchObservedRunningTime="2026-07-15 19:48:58.159269805 +0000 UTC m=+2030.157248219"
Jul 15 19:49:04.150429 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:04.150395    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:49:05.241560 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:05.241517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:49:07.189836 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:07.189747    2562 generic.go:356] "Generic (PLEG): container finished" podID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerID="90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6" exitCode=0
Jul 15 19:49:07.190197 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:07.189827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" event={"ID":"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb","Type":"ContainerDied","Data":"90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6"}
Jul 15 19:49:07.190197 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:07.190183    2562 scope.go:117] "RemoveContainer" containerID="90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6"
Jul 15 19:49:07.191230 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:07.191204    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:49:07.191288 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:07.191267    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:49:07.191324 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:07.191295    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:49:08.217980 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:08.217952    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" event={"ID":"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb","Type":"ContainerStarted","Data":"898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c"}
Jul 15 19:49:08.665555 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:08.665527    2562 scope.go:117] "RemoveContainer" containerID="5ff44d49e1a9edb4a06e560f6b4120890b0a1d12a9bee6656a1ac37950f1e5f5"
Jul 15 19:49:09.133462 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:09.133432    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:49:09.134462 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:09.134441    2562 patch_prober.go:28] interesting pod/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 19:49:09.134545 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:09.134500    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 19:49:10.125028 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:10.124993    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:49:10.134337 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:10.134308    2562 patch_prober.go:28] interesting pod/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 19:49:10.134446 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:10.134350    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 19:49:11.133874 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:11.133841    2562 patch_prober.go:28] interesting pod/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 19:49:11.134468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:11.133890    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 19:49:12.144690 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:12.144660    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:49:12.145588 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:12.145569    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:49:18.577291 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:18.577251    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"]
Jul 15 19:49:18.577789 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:18.577508    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt" podUID="4498bdce-ebaa-4ac3-9478-51af977b04bb" containerName="maas-api" containerID="cri-o://5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad" gracePeriod=30
Jul 15 19:49:18.835032 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:18.834971    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:49:18.937107 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:18.937082    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4498bdce-ebaa-4ac3-9478-51af977b04bb-maas-api-tls\") pod \"4498bdce-ebaa-4ac3-9478-51af977b04bb\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") "
Jul 15 19:49:18.937231 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:18.937115    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8m89\" (UniqueName: \"kubernetes.io/projected/4498bdce-ebaa-4ac3-9478-51af977b04bb-kube-api-access-l8m89\") pod \"4498bdce-ebaa-4ac3-9478-51af977b04bb\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") "
Jul 15 19:49:18.937231 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:18.937158    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4498bdce-ebaa-4ac3-9478-51af977b04bb-openshift-service-ca\") pod \"4498bdce-ebaa-4ac3-9478-51af977b04bb\" (UID: \"4498bdce-ebaa-4ac3-9478-51af977b04bb\") "
Jul 15 19:49:18.937564 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:18.937541    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4498bdce-ebaa-4ac3-9478-51af977b04bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4498bdce-ebaa-4ac3-9478-51af977b04bb" (UID: "4498bdce-ebaa-4ac3-9478-51af977b04bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:49:18.939073 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:18.939040    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4498bdce-ebaa-4ac3-9478-51af977b04bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4498bdce-ebaa-4ac3-9478-51af977b04bb" (UID: "4498bdce-ebaa-4ac3-9478-51af977b04bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:49:18.939185 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:18.939079    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4498bdce-ebaa-4ac3-9478-51af977b04bb-kube-api-access-l8m89" (OuterVolumeSpecName: "kube-api-access-l8m89") pod "4498bdce-ebaa-4ac3-9478-51af977b04bb" (UID: "4498bdce-ebaa-4ac3-9478-51af977b04bb"). InnerVolumeSpecName "kube-api-access-l8m89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:49:19.037637 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.037619    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4498bdce-ebaa-4ac3-9478-51af977b04bb-maas-api-tls\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:19.037637 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.037637    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8m89\" (UniqueName: \"kubernetes.io/projected/4498bdce-ebaa-4ac3-9478-51af977b04bb-kube-api-access-l8m89\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:19.037783 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.037646    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4498bdce-ebaa-4ac3-9478-51af977b04bb-openshift-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:19.275766 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.275740    2562 generic.go:356] "Generic (PLEG): container finished" podID="4498bdce-ebaa-4ac3-9478-51af977b04bb" containerID="5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad" exitCode=0
Jul 15 19:49:19.275879 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.275783    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"
Jul 15 19:49:19.275879 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.275828    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt" event={"ID":"4498bdce-ebaa-4ac3-9478-51af977b04bb","Type":"ContainerDied","Data":"5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad"}
Jul 15 19:49:19.275955 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.275879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt" event={"ID":"4498bdce-ebaa-4ac3-9478-51af977b04bb","Type":"ContainerDied","Data":"79f96db9b952152e9dc443c3e1c5120239cbedab3d52af8945197e861f6bed85"}
Jul 15 19:49:19.275955 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.275901    2562 scope.go:117] "RemoveContainer" containerID="5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad"
Jul 15 19:49:19.285276 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.285257    2562 scope.go:117] "RemoveContainer" containerID="5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad"
Jul 15 19:49:19.285562 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:49:19.285541    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad\": container with ID starting with 5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad not found: ID does not exist" containerID="5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad"
Jul 15 19:49:19.285638 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.285569    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad"} err="failed to get container status \"5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad\": rpc error: code = NotFound desc = could not find container \"5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad\": container with ID starting with 5f0bf3c2869d855c8ed8ca2cbdea5fe3b154539ff0b204bc17d29f48208798ad not found: ID does not exist"
Jul 15 19:49:19.298526 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.298502    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"]
Jul 15 19:49:19.302324 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:19.302304    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3e285c6-875b646c4-wjllt"]
Jul 15 19:49:20.564985 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:20.564954    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4498bdce-ebaa-4ac3-9478-51af977b04bb" path="/var/lib/kubelet/pods/4498bdce-ebaa-4ac3-9478-51af977b04bb/volumes"
Jul 15 19:49:21.535553 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:21.535517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:49:29.712950 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:29.712909    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"]
Jul 15 19:49:29.713422 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:29.713205    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy" containerID="cri-o://898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c" gracePeriod=30
Jul 15 19:49:34.974994 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:34.974972    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:49:35.058937 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.058914    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-token\") pod \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") "
Jul 15 19:49:35.059051 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.058944    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-data\") pod \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") "
Jul 15 19:49:35.059051 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.058965    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-credential-socket\") pod \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") "
Jul 15 19:49:35.059051 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059011    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-podinfo\") pod \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") "
Jul 15 19:49:35.059051 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059045    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-certs\") pod \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") "
Jul 15 19:49:35.059239 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059083    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istiod-ca-cert\") pod \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") "
Jul 15 19:49:35.059239 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-envoy\") pod \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") "
Jul 15 19:49:35.059239 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059148    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9j4v\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-kube-api-access-d9j4v\") pod \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") "
Jul 15 19:49:35.059239 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059196    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-socket\") pod \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\" (UID: \"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb\") "
Jul 15 19:49:35.059433 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059351    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" (UID: "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:49:35.059516 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059445    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-credential-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:35.059657 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059626    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" (UID: "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:49:35.059769 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059665    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" (UID: "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:49:35.059841 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059817    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" (UID: "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:49:35.059961 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.059942    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" (UID: "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:49:35.061294 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.061272    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-kube-api-access-d9j4v" (OuterVolumeSpecName: "kube-api-access-d9j4v") pod "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" (UID: "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb"). InnerVolumeSpecName "kube-api-access-d9j4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:49:35.061388 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.061372    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" (UID: "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:49:35.061451 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.061435    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" (UID: "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:49:35.061525 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.061453    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" (UID: "6d1d7eef-5f1f-468a-a008-4e3f874a1ddb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:49:35.159841 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.159820    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:35.159841 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.159840    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:35.159959 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.159849    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-data\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:35.159959 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.159857    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-podinfo\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:35.159959 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.159864    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-workload-certs\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:35.159959 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.159890    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istiod-ca-cert\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:35.159959 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.159897    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-istio-envoy\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:35.159959 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.159905    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9j4v\" (UniqueName: \"kubernetes.io/projected/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb-kube-api-access-d9j4v\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:49:35.364159 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.364091    2562 generic.go:356] "Generic (PLEG): container finished" podID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerID="898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c" exitCode=0
Jul 15 19:49:35.364159 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.364148    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"
Jul 15 19:49:35.364323 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.364179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" event={"ID":"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb","Type":"ContainerDied","Data":"898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c"}
Jul 15 19:49:35.364323 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.364242    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld" event={"ID":"6d1d7eef-5f1f-468a-a008-4e3f874a1ddb","Type":"ContainerDied","Data":"04333bdc13de41aa7344ffc80ae34cd13e468715bbf9a444ae6310787ca86165"}
Jul 15 19:49:35.364323 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.364266    2562 scope.go:117] "RemoveContainer" containerID="898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c"
Jul 15 19:49:35.374344 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.374327    2562 scope.go:117] "RemoveContainer" containerID="90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6"
Jul 15 19:49:35.382430 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.382410    2562 scope.go:117] "RemoveContainer" containerID="898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c"
Jul 15 19:49:35.382731 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:49:35.382709    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c\": container with ID starting with 898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c not found: ID does not exist" containerID="898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c"
Jul 15 19:49:35.382808 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.382738    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c"} err="failed to get container status \"898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c\": rpc error: code = NotFound desc = could not find container \"898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c\": container with ID starting with 898db19b2eb48e65f127846f016681bccf12f79a475b2713ecd2378b6aad6d4c not found: ID does not exist"
Jul 15 19:49:35.382808 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.382755    2562 scope.go:117] "RemoveContainer" containerID="90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6"
Jul 15 19:49:35.383006 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:49:35.382983    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6\": container with ID starting with 90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6 not found: ID does not exist" containerID="90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6"
Jul 15 19:49:35.383048 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.383017    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6"} err="failed to get container status \"90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6\": rpc error: code = NotFound desc = could not find container \"90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6\": container with ID starting with 90895d9af862255575b545dfba98440da7f3afefbcfbd852d322f35853f77dd6 not found: ID does not exist"
Jul 15 19:49:35.386278 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.386256    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"]
Jul 15 19:49:35.388463 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:35.388438    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f3e285c6-openshift-default-d6989c5ff-vz7ld"]
Jul 15 19:49:36.563618 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:36.563580    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" path="/var/lib/kubelet/pods/6d1d7eef-5f1f-468a-a008-4e3f874a1ddb/volumes"
Jul 15 19:49:49.354187 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354155    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"]
Jul 15 19:49:49.354693 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354542    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy"
Jul 15 19:49:49.354693 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354559    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy"
Jul 15 19:49:49.354693 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354584    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy"
Jul 15 19:49:49.354693 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354593    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy"
Jul 15 19:49:49.354693 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354605    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4498bdce-ebaa-4ac3-9478-51af977b04bb" containerName="maas-api"
Jul 15 19:49:49.354693 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354613    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4498bdce-ebaa-4ac3-9478-51af977b04bb" containerName="maas-api"
Jul 15 19:49:49.355063 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354705    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy"
Jul 15 19:49:49.355063 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354718    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4498bdce-ebaa-4ac3-9478-51af977b04bb" containerName="maas-api"
Jul 15 19:49:49.355063 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.354730    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1d7eef-5f1f-468a-a008-4e3f874a1ddb" containerName="istio-proxy"
Jul 15 19:49:49.357955 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.357934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.360803 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.360778    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-80adc0ad-openshift-default-dockercfg-lp4n8\""
Jul 15 19:49:49.373803 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.373780    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"]
Jul 15 19:49:49.459224 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.459194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-data\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.459224 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.459222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istiod-ca-cert\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.459425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.459247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-token\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.459425 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.459369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-socket\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.459531 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.459421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25wmk\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-kube-api-access-25wmk\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.459531 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.459463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-certs\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.459531 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.459513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-credential-socket\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.459637 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.459536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-podinfo\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.459637 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.459568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-envoy\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.560823 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.560795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-socket\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.560949 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.560835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25wmk\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-kube-api-access-25wmk\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.560949 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.560875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-certs\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.560949 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.560899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-credential-socket\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.560949 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.560925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-podinfo\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.561176 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.560953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-envoy\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.561176 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.561001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-data\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.561176 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.561025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istiod-ca-cert\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.561176 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.561059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-token\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.561435 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.561402    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-socket\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.561435 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.561426    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-credential-socket\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.561627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.561604    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-data\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.561735 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.561715    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-certs\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.561832 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.561812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istiod-ca-cert\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.563766 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.563737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-envoy\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.563877 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.563860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-podinfo\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.569193 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.569174    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-token\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.569304 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.569284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25wmk\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-kube-api-access-25wmk\") pod \"e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") " pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.668097 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.668046    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:49.806286 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.806262    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"]
Jul 15 19:49:49.807954 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:49:49.807914    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b75106_ce40_4d3a_a0ed_4087349e1dfe.slice/crio-8e1a1d867b3af465058e8688d58f9b5a2b6a545be380c627eb91a388de9852f4 WatchSource:0}: Error finding container 8e1a1d867b3af465058e8688d58f9b5a2b6a545be380c627eb91a388de9852f4: Status 404 returned error can't find the container with id 8e1a1d867b3af465058e8688d58f9b5a2b6a545be380c627eb91a388de9852f4
Jul 15 19:49:49.810395 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.810363    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:49:49.810521 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.810436    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:49:49.810521 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:49.810482    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:49:50.452877 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:50.452838    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" event={"ID":"63b75106-ce40-4d3a-a0ed-4087349e1dfe","Type":"ContainerStarted","Data":"7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed"}
Jul 15 19:49:50.453274 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:50.452895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" event={"ID":"63b75106-ce40-4d3a-a0ed-4087349e1dfe","Type":"ContainerStarted","Data":"8e1a1d867b3af465058e8688d58f9b5a2b6a545be380c627eb91a388de9852f4"}
Jul 15 19:49:50.472866 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:50.472810    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" podStartSLOduration=1.472779492 podStartE2EDuration="1.472779492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:49:50.471252332 +0000 UTC m=+2082.469230723" watchObservedRunningTime="2026-07-15 19:49:50.472779492 +0000 UTC m=+2082.470757866"
Jul 15 19:49:50.668748 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:50.668713    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:50.674651 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:50.674624    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:51.457871 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:51.457836    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:51.458798 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:51.458778    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:49:58.237165 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:49:58.237115    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:50:06.459632 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:06.459595    2562 patch_prober.go:28] interesting pod/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 15 19:50:06.460051 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:06.459662    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 15 19:50:06.544308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:06.544278    2562 generic.go:356] "Generic (PLEG): container finished" podID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerID="7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed" exitCode=0
Jul 15 19:50:06.544452 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:06.544353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" event={"ID":"63b75106-ce40-4d3a-a0ed-4087349e1dfe","Type":"ContainerDied","Data":"7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed"}
Jul 15 19:50:06.544772 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:06.544756    2562 scope.go:117] "RemoveContainer" containerID="7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed"
Jul 15 19:50:06.545879 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:06.545848    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:50:06.545954 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:06.545929    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:50:06.546002 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:06.545968    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:50:07.550990 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:07.550956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" event={"ID":"63b75106-ce40-4d3a-a0ed-4087349e1dfe","Type":"ContainerStarted","Data":"fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f"}
Jul 15 19:50:07.668217 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:07.668180    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:50:07.668383 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:07.668359    2562 patch_prober.go:28] interesting pod/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 15 19:50:07.668428 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:07.668406    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 15 19:50:08.629039 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:08.629008    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:50:08.630144 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:08.630125    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:50:08.669081 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:08.669059    2562 patch_prober.go:28] interesting pod/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 15 19:50:08.669173 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:08.669117    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 15 19:50:08.707590 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:08.707559    2562 scope.go:117] "RemoveContainer" containerID="c45c95d159ef743f3789de37a30e666f16320a7cf774e55838e0915a9797d3d6"
Jul 15 19:50:09.668697 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:09.668665    2562 patch_prober.go:28] interesting pod/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 15 19:50:09.669094 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:09.668728    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 15 19:50:10.668660 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:10.668626    2562 patch_prober.go:28] interesting pod/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 15 19:50:10.668836 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:10.668680    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 15 19:50:11.672245 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:11.672216    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:50:11.672637 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:11.672456    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:50:11.673546 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:11.673527    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:50:21.245475 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:21.245443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:50:47.533732 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:47.533692    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:50:51.033301 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.033259    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"]
Jul 15 19:50:51.036716 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.036695    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"
Jul 15 19:50:51.039554 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.039529    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bk6kr\""
Jul 15 19:50:51.039719 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.039614    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:50:51.044460 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.044427    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"]
Jul 15 19:50:51.137676 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.137650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/105a05b4-dc89-4012-a4d0-0b3c471f8194-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz\" (UID: \"105a05b4-dc89-4012-a4d0-0b3c471f8194\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"
Jul 15 19:50:51.238831 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.238807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/105a05b4-dc89-4012-a4d0-0b3c471f8194-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz\" (UID: \"105a05b4-dc89-4012-a4d0-0b3c471f8194\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"
Jul 15 19:50:51.239431 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.239404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/105a05b4-dc89-4012-a4d0-0b3c471f8194-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz\" (UID: \"105a05b4-dc89-4012-a4d0-0b3c471f8194\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"
Jul 15 19:50:51.349287 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.349221    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"
Jul 15 19:50:51.480542 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.480513    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"]
Jul 15 19:50:51.482015 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:50:51.481990    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105a05b4_dc89_4012_a4d0_0b3c471f8194.slice/crio-7dacf5c5d6297e4644f4b8e88f296fb1ed3399b1a224d7595f885c9787a4c625 WatchSource:0}: Error finding container 7dacf5c5d6297e4644f4b8e88f296fb1ed3399b1a224d7595f885c9787a4c625: Status 404 returned error can't find the container with id 7dacf5c5d6297e4644f4b8e88f296fb1ed3399b1a224d7595f885c9787a4c625
Jul 15 19:50:51.768978 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.768938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz" event={"ID":"105a05b4-dc89-4012-a4d0-0b3c471f8194","Type":"ContainerStarted","Data":"7abe1f455e4afc96b372ec84d07de676d62dc19d1d9a5be9fcdd54b63ce00db6"}
Jul 15 19:50:51.769130 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.769009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz" event={"ID":"105a05b4-dc89-4012-a4d0-0b3c471f8194","Type":"ContainerStarted","Data":"7dacf5c5d6297e4644f4b8e88f296fb1ed3399b1a224d7595f885c9787a4c625"}
Jul 15 19:50:51.791208 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:51.791163    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz" podStartSLOduration=0.79114637 podStartE2EDuration="791.14637ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:50:51.789767883 +0000 UTC m=+2143.787746246" watchObservedRunningTime="2026-07-15 19:50:51.79114637 +0000 UTC m=+2143.789124788"
Jul 15 19:50:52.775103 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:52.775069    2562 generic.go:356] "Generic (PLEG): container finished" podID="105a05b4-dc89-4012-a4d0-0b3c471f8194" containerID="7abe1f455e4afc96b372ec84d07de676d62dc19d1d9a5be9fcdd54b63ce00db6" exitCode=0
Jul 15 19:50:52.775559 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:52.775154    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz" event={"ID":"105a05b4-dc89-4012-a4d0-0b3c471f8194","Type":"ContainerDied","Data":"7abe1f455e4afc96b372ec84d07de676d62dc19d1d9a5be9fcdd54b63ce00db6"}
Jul 15 19:50:53.903716 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:53.903691    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"
Jul 15 19:50:54.061009 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:54.060942    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/105a05b4-dc89-4012-a4d0-0b3c471f8194-maas-api-service-ca\") pod \"105a05b4-dc89-4012-a4d0-0b3c471f8194\" (UID: \"105a05b4-dc89-4012-a4d0-0b3c471f8194\") "
Jul 15 19:50:54.061268 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:54.061245    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/105a05b4-dc89-4012-a4d0-0b3c471f8194-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "105a05b4-dc89-4012-a4d0-0b3c471f8194" (UID: "105a05b4-dc89-4012-a4d0-0b3c471f8194"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:50:54.162372 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:54.162344    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/105a05b4-dc89-4012-a4d0-0b3c471f8194-maas-api-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:50:54.786250 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:54.786217    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz" event={"ID":"105a05b4-dc89-4012-a4d0-0b3c471f8194","Type":"ContainerDied","Data":"7dacf5c5d6297e4644f4b8e88f296fb1ed3399b1a224d7595f885c9787a4c625"}
Jul 15 19:50:54.786376 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:54.786253    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz"
Jul 15 19:50:54.786376 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:50:54.786263    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dacf5c5d6297e4644f4b8e88f296fb1ed3399b1a224d7595f885c9787a4c625"
Jul 15 19:51:05.034979 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:51:05.034885    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:51:08.733749 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:51:08.733718    2562 scope.go:117] "RemoveContainer" containerID="b523656e574a9d539e2ca247cb6975a4cef6a6d25968e3278e0d48c4050155c1"
Jul 15 19:51:08.741912 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:51:08.741893    2562 scope.go:117] "RemoveContainer" containerID="848a74202999a3276cc875fa28be5dffd7bb8515abdb3b0f731388b404f82897"
Jul 15 19:51:14.130310 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:51:14.130275    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:52:06.854766 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:06.854730    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"]
Jul 15 19:52:06.855321 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:06.854968    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy" containerID="cri-o://fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f" gracePeriod=30
Jul 15 19:52:10.342359 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:10.342319    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:52:11.674905 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:11.674870    2562 patch_prober.go:28] interesting pod/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:52:11.675279 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:11.674937    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:52:12.117423 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.117402    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:52:12.163232 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163209    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-credential-socket\") pod \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") "
Jul 15 19:52:12.163339 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163246    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25wmk\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-kube-api-access-25wmk\") pod \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") "
Jul 15 19:52:12.163339 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163274    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-socket\") pod \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") "
Jul 15 19:52:12.163339 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163307    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-envoy\") pod \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") "
Jul 15 19:52:12.163468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163350    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istiod-ca-cert\") pod \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") "
Jul 15 19:52:12.163468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163393    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-podinfo\") pod \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") "
Jul 15 19:52:12.163468 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163447    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-token\") pod \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") "
Jul 15 19:52:12.163640 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163462    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63b75106-ce40-4d3a-a0ed-4087349e1dfe" (UID: "63b75106-ce40-4d3a-a0ed-4087349e1dfe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:52:12.163640 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163483    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-certs\") pod \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") "
Jul 15 19:52:12.163640 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163602    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63b75106-ce40-4d3a-a0ed-4087349e1dfe" (UID: "63b75106-ce40-4d3a-a0ed-4087349e1dfe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:52:12.163891 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163777    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-credential-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:52:12.163891 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163820    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63b75106-ce40-4d3a-a0ed-4087349e1dfe" (UID: "63b75106-ce40-4d3a-a0ed-4087349e1dfe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:52:12.163891 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163826    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:52:12.163891 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.163865    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63b75106-ce40-4d3a-a0ed-4087349e1dfe" (UID: "63b75106-ce40-4d3a-a0ed-4087349e1dfe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:52:12.165422 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.165397    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63b75106-ce40-4d3a-a0ed-4087349e1dfe" (UID: "63b75106-ce40-4d3a-a0ed-4087349e1dfe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:52:12.165714 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.165696    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-token" (OuterVolumeSpecName: "istio-token") pod "63b75106-ce40-4d3a-a0ed-4087349e1dfe" (UID: "63b75106-ce40-4d3a-a0ed-4087349e1dfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:52:12.165884 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.165858    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63b75106-ce40-4d3a-a0ed-4087349e1dfe" (UID: "63b75106-ce40-4d3a-a0ed-4087349e1dfe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:52:12.166192 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.166172    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-kube-api-access-25wmk" (OuterVolumeSpecName: "kube-api-access-25wmk") pod "63b75106-ce40-4d3a-a0ed-4087349e1dfe" (UID: "63b75106-ce40-4d3a-a0ed-4087349e1dfe"). InnerVolumeSpecName "kube-api-access-25wmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:52:12.179147 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.179127    2562 generic.go:356] "Generic (PLEG): container finished" podID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerID="fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f" exitCode=0
Jul 15 19:52:12.179235 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.179164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" event={"ID":"63b75106-ce40-4d3a-a0ed-4087349e1dfe","Type":"ContainerDied","Data":"fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f"}
Jul 15 19:52:12.179235 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.179174    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"
Jul 15 19:52:12.179235 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.179203    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7" event={"ID":"63b75106-ce40-4d3a-a0ed-4087349e1dfe","Type":"ContainerDied","Data":"8e1a1d867b3af465058e8688d58f9b5a2b6a545be380c627eb91a388de9852f4"}
Jul 15 19:52:12.179235 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.179223    2562 scope.go:117] "RemoveContainer" containerID="fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f"
Jul 15 19:52:12.187221 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.187206    2562 scope.go:117] "RemoveContainer" containerID="7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed"
Jul 15 19:52:12.194229 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.194215    2562 scope.go:117] "RemoveContainer" containerID="fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f"
Jul 15 19:52:12.194467 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:52:12.194450    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f\": container with ID starting with fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f not found: ID does not exist" containerID="fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f"
Jul 15 19:52:12.194520 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.194477    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f"} err="failed to get container status \"fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f\": rpc error: code = NotFound desc = could not find container \"fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f\": container with ID starting with fe302d5ddbb5a60831c87d63b6d09ad55739c1f9d6718ceebc9f0840376f437f not found: ID does not exist"
Jul 15 19:52:12.194520 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.194505    2562 scope.go:117] "RemoveContainer" containerID="7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed"
Jul 15 19:52:12.194729 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:52:12.194712    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed\": container with ID starting with 7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed not found: ID does not exist" containerID="7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed"
Jul 15 19:52:12.194767 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.194735    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed"} err="failed to get container status \"7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed\": rpc error: code = NotFound desc = could not find container \"7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed\": container with ID starting with 7c16e4408a556613b8be57f137d0bd955aa9aeecf08cbf8ad3f4f3bad571c8ed not found: ID does not exist"
Jul 15 19:52:12.264027 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.264008    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-data\") pod \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\" (UID: \"63b75106-ce40-4d3a-a0ed-4087349e1dfe\") "
Jul 15 19:52:12.264186 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.264174    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-workload-certs\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:52:12.264226 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.264188    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25wmk\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-kube-api-access-25wmk\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:52:12.264226 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.264198    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-envoy\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:52:12.264226 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.264206    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istiod-ca-cert\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:52:12.264226 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.264214    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-podinfo\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:52:12.264226 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.264222    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:52:12.264593 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.264576    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-data" (OuterVolumeSpecName: "istio-data") pod "63b75106-ce40-4d3a-a0ed-4087349e1dfe" (UID: "63b75106-ce40-4d3a-a0ed-4087349e1dfe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:52:12.364933 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.364901    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b75106-ce40-4d3a-a0ed-4087349e1dfe-istio-data\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:52:12.501806 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.501776    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"]
Jul 15 19:52:12.505458 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.505436    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-80adc0ad-openshift-default-654577f4cf-6g2t7"]
Jul 15 19:52:12.564438 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:12.564379    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" path="/var/lib/kubelet/pods/63b75106-ce40-4d3a-a0ed-4087349e1dfe/volumes"
Jul 15 19:52:20.034654 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:52:20.034613    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:53:02.585571 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.585540    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"]
Jul 15 19:53:02.586048 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.586033    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy"
Jul 15 19:53:02.586092 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.586051    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy"
Jul 15 19:53:02.586092 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.586065    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy"
Jul 15 19:53:02.586092 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.586073    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy"
Jul 15 19:53:02.586092 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.586086    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="105a05b4-dc89-4012-a4d0-0b3c471f8194" containerName="revoke-keys"
Jul 15 19:53:02.586255 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.586095    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="105a05b4-dc89-4012-a4d0-0b3c471f8194" containerName="revoke-keys"
Jul 15 19:53:02.586255 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.586183    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy"
Jul 15 19:53:02.586255 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.586194    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b75106-ce40-4d3a-a0ed-4087349e1dfe" containerName="istio-proxy"
Jul 15 19:53:02.586255 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.586202    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="105a05b4-dc89-4012-a4d0-0b3c471f8194" containerName="revoke-keys"
Jul 15 19:53:02.589614 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.589597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.592299 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.592276    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-da0342-openshift-default-dockercfg-n66ld\""
Jul 15 19:53:02.607895 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.607871    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"]
Jul 15 19:53:02.732108 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.732076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-data\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.732294 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.732118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-istio-token\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.732294 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.732149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-credential-socket\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.732294 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.732174    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7475a543-507c-483b-bdbc-304cafc034ca-istio-podinfo\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.732294 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.732192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-envoy\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.732294 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.732235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-socket\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.732294 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.732281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-certs\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.732643 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.732311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7475a543-507c-483b-bdbc-304cafc034ca-istiod-ca-cert\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.732643 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.732325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6s4s\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-kube-api-access-z6s4s\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833238 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-istio-token\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833383 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-credential-socket\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833383 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7475a543-507c-483b-bdbc-304cafc034ca-istio-podinfo\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833383 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-envoy\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833383 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-socket\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833383 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-certs\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833383 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7475a543-507c-483b-bdbc-304cafc034ca-istiod-ca-cert\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833383 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6s4s\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-kube-api-access-z6s4s\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833759 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-data\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833815 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833762    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-certs\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.833965 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-credential-socket\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.834093 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.833998    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-data\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.834163 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.834103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-socket\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.834163 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.834145    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7475a543-507c-483b-bdbc-304cafc034ca-istiod-ca-cert\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.835627 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.835570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-envoy\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.835935 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.835915    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7475a543-507c-483b-bdbc-304cafc034ca-istio-podinfo\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.841612 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.841588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-istio-token\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.841919 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.841902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6s4s\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-kube-api-access-z6s4s\") pod \"e2e-inf-a-da0342-openshift-default-557cc995c-n2qll\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") " pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:02.900196 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:02.900174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:03.035354 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:03.035323    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"]
Jul 15 19:53:03.036183 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:53:03.036150    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7475a543_507c_483b_bdbc_304cafc034ca.slice/crio-a9e1805c166f69f474a2ebc6739eaa3c00d409322806481e98deeda14bd9e1e9 WatchSource:0}: Error finding container a9e1805c166f69f474a2ebc6739eaa3c00d409322806481e98deeda14bd9e1e9: Status 404 returned error can't find the container with id a9e1805c166f69f474a2ebc6739eaa3c00d409322806481e98deeda14bd9e1e9
Jul 15 19:53:03.038115 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:03.038084    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:03.038212 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:03.038160    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:03.038274 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:03.038211    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:03.448723 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:03.448630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" event={"ID":"7475a543-507c-483b-bdbc-304cafc034ca","Type":"ContainerStarted","Data":"5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3"}
Jul 15 19:53:03.448723 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:03.448691    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" event={"ID":"7475a543-507c-483b-bdbc-304cafc034ca","Type":"ContainerStarted","Data":"a9e1805c166f69f474a2ebc6739eaa3c00d409322806481e98deeda14bd9e1e9"}
Jul 15 19:53:03.469723 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:03.469676    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" podStartSLOduration=1.469661857 podStartE2EDuration="1.469661857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:53:03.468393006 +0000 UTC m=+2275.466371390" watchObservedRunningTime="2026-07-15 19:53:03.469661857 +0000 UTC m=+2275.467640230"
Jul 15 19:53:03.901032 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:03.901002    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:04.905804 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:04.905775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:05.458422 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.458398    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:05.459400 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.459373    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:05.651834 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.651805    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"]
Jul 15 19:53:05.655456 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.655435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:05.658190 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.658167    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5qhz\""
Jul 15 19:53:05.658306 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.658177    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:53:05.658498 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.658477    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-da0342-serving-cert\""
Jul 15 19:53:05.658596 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.658509    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 19:53:05.668065 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.668044    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"]
Jul 15 19:53:05.758947 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.758924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba0da19-ef29-49fe-a609-c349a82f93fe-openshift-service-ca\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:05.759092 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.758957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ba0da19-ef29-49fe-a609-c349a82f93fe-maas-api-tls\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:05.759092 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.758979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8t5n\" (UniqueName: \"kubernetes.io/projected/6ba0da19-ef29-49fe-a609-c349a82f93fe-kube-api-access-q8t5n\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:05.860334 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.860308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba0da19-ef29-49fe-a609-c349a82f93fe-openshift-service-ca\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:05.860458 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.860343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ba0da19-ef29-49fe-a609-c349a82f93fe-maas-api-tls\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:05.860458 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.860360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8t5n\" (UniqueName: \"kubernetes.io/projected/6ba0da19-ef29-49fe-a609-c349a82f93fe-kube-api-access-q8t5n\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:05.860618 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:53:05.860476    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-serving-cert: secret "maas-api-e2e-inf-a-da0342-serving-cert" not found
Jul 15 19:53:05.860618 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:53:05.860573    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba0da19-ef29-49fe-a609-c349a82f93fe-maas-api-tls podName:6ba0da19-ef29-49fe-a609-c349a82f93fe nodeName:}" failed. No retries permitted until 2026-07-15 19:53:06.360552572 +0000 UTC m=+2278.358530936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ba0da19-ef29-49fe-a609-c349a82f93fe-maas-api-tls") pod "maas-api-e2e-inf-a-da0342-5884667588-d9lxr" (UID: "6ba0da19-ef29-49fe-a609-c349a82f93fe") : secret "maas-api-e2e-inf-a-da0342-serving-cert" not found
Jul 15 19:53:05.861076 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.861056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba0da19-ef29-49fe-a609-c349a82f93fe-openshift-service-ca\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:05.869077 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:05.869054    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8t5n\" (UniqueName: \"kubernetes.io/projected/6ba0da19-ef29-49fe-a609-c349a82f93fe-kube-api-access-q8t5n\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:06.365057 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:06.365031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ba0da19-ef29-49fe-a609-c349a82f93fe-maas-api-tls\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:06.367191 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:06.367174    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ba0da19-ef29-49fe-a609-c349a82f93fe-maas-api-tls\") pod \"maas-api-e2e-inf-a-da0342-5884667588-d9lxr\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:06.566507 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:06.566474    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:06.694149 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:06.694126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"]
Jul 15 19:53:06.695795 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:53:06.695767    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba0da19_ef29_49fe_a609_c349a82f93fe.slice/crio-6e3c78daae6f0462ae10dcf16c28bec870b9c56e1ff7b814888968a631a69323 WatchSource:0}: Error finding container 6e3c78daae6f0462ae10dcf16c28bec870b9c56e1ff7b814888968a631a69323: Status 404 returned error can't find the container with id 6e3c78daae6f0462ae10dcf16c28bec870b9c56e1ff7b814888968a631a69323
Jul 15 19:53:07.470707 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:07.470672    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr" event={"ID":"6ba0da19-ef29-49fe-a609-c349a82f93fe","Type":"ContainerStarted","Data":"dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18"}
Jul 15 19:53:07.471046 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:07.470727    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr" event={"ID":"6ba0da19-ef29-49fe-a609-c349a82f93fe","Type":"ContainerStarted","Data":"6e3c78daae6f0462ae10dcf16c28bec870b9c56e1ff7b814888968a631a69323"}
Jul 15 19:53:07.471046 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:07.470865    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:07.489382 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:07.489342    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr" podStartSLOduration=1.941763975 podStartE2EDuration="2.489330415s" totalImagesPullingTime="547.56644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:53:07.486892161 +0000 UTC m=+2279.484870545" watchObservedRunningTime="2026-07-15 19:53:07.489330415 +0000 UTC m=+2279.487308788"
Jul 15 19:53:08.774698 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:08.774670    2562 scope.go:117] "RemoveContainer" containerID="89ca0e1b678f051122dcf0a2450a2c3d49972732b376805348e00f053bdcb2e1"
Jul 15 19:53:10.674836 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.674803    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"]
Jul 15 19:53:10.679785 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.679762    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.682574 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.682552    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-435e1e-openshift-default-dockercfg-qb74j\""
Jul 15 19:53:10.690397 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.690377    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"]
Jul 15 19:53:10.801125 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.801080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-credential-socket\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.801304 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.801147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istiod-ca-cert\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.801304 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.801198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-socket\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.801304 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.801226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-envoy\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.801304 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.801266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-token\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.801304 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.801301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-data\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.801596 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.801328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9qlb\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-kube-api-access-r9qlb\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.801596 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.801355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-podinfo\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.801596 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.801388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-certs\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-credential-socket\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902322 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istiod-ca-cert\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902322 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902170    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-socket\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902322 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-envoy\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902487 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-token\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902487 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-data\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902487 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qlb\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-kube-api-access-r9qlb\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902487 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-podinfo\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902487 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-certs\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902759 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-credential-socket\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902759 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902525    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-socket\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902873 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-certs\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902873 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-data\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.902976 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.902888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istiod-ca-cert\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.904414 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.904391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-envoy\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.905004 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.904984    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-podinfo\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.910831 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.910807    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-token\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.910909 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.910882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9qlb\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-kube-api-access-r9qlb\") pod \"e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") " pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:10.990942 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:10.990924    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:11.119793 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:11.119760    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"]
Jul 15 19:53:11.120874 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:53:11.120851    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8700214_2274_4bf8_a3c4_ad99ddde4f30.slice/crio-772d8904c0b9ba0e3bd08eabc07d85e6d75d915f52bcfa06b11d7ae75b82bab3 WatchSource:0}: Error finding container 772d8904c0b9ba0e3bd08eabc07d85e6d75d915f52bcfa06b11d7ae75b82bab3: Status 404 returned error can't find the container with id 772d8904c0b9ba0e3bd08eabc07d85e6d75d915f52bcfa06b11d7ae75b82bab3
Jul 15 19:53:11.123269 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:11.123238    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:11.123367 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:11.123316    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:11.123367 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:11.123359    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:11.495650 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:11.495618    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" event={"ID":"b8700214-2274-4bf8-a3c4-ad99ddde4f30","Type":"ContainerStarted","Data":"3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584"}
Jul 15 19:53:11.495844 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:11.495670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" event={"ID":"b8700214-2274-4bf8-a3c4-ad99ddde4f30","Type":"ContainerStarted","Data":"772d8904c0b9ba0e3bd08eabc07d85e6d75d915f52bcfa06b11d7ae75b82bab3"}
Jul 15 19:53:11.516567 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:11.516527    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" podStartSLOduration=1.516513243 podStartE2EDuration="1.516513243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:53:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:53:11.513990324 +0000 UTC m=+2283.511968692" watchObservedRunningTime="2026-07-15 19:53:11.516513243 +0000 UTC m=+2283.514491616"
Jul 15 19:53:11.991762 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:11.991732    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:12.998676 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:12.998641    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:13.482262 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:13.482181    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:53:13.508168 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:13.508131    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:13.509154 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:13.509121    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:14.044880 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:14.044850    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:53:21.499641 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:21.499609    2562 patch_prober.go:28] interesting pod/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 19:53:21.500050 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:21.499674    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 19:53:22.552962 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:22.552930    2562 generic.go:356] "Generic (PLEG): container finished" podID="7475a543-507c-483b-bdbc-304cafc034ca" containerID="5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3" exitCode=0
Jul 15 19:53:22.553392 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:22.553002    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" event={"ID":"7475a543-507c-483b-bdbc-304cafc034ca","Type":"ContainerDied","Data":"5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3"}
Jul 15 19:53:22.553392 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:22.553382    2562 scope.go:117] "RemoveContainer" containerID="5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3"
Jul 15 19:53:22.554342 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:22.554315    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:22.554448 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:22.554415    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:22.554527 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:22.554461    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:23.559809 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:23.559773    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" event={"ID":"7475a543-507c-483b-bdbc-304cafc034ca","Type":"ContainerStarted","Data":"a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277"}
Jul 15 19:53:23.901645 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:23.901556    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:23.902001 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:23.901890    2562 patch_prober.go:28] interesting pod/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 19:53:23.902177 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:23.902143    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 19:53:24.901255 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:24.901223    2562 patch_prober.go:28] interesting pod/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 19:53:24.901819 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:24.901790    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 19:53:25.438185 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:25.438147    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:53:25.900642 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:25.900604    2562 patch_prober.go:28] interesting pod/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 19:53:25.900847 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:25.900665    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 19:53:26.901197 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:26.900753    2562 patch_prober.go:28] interesting pod/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 19:53:26.901197 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:26.900828    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 19:53:27.903822 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:27.903784    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:27.904284 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:27.904029    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:27.904697 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:27.904679    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:53:28.936784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:28.935564    2562 patch_prober.go:28] interesting pod/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:53208->10.132.0.53:15021: read: connection reset by peer" start-of-body=
Jul 15 19:53:28.936784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:28.935635    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:53208->10.132.0.53:15021: read: connection reset by peer"
Jul 15 19:53:29.591009 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:29.590978    2562 generic.go:356] "Generic (PLEG): container finished" podID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerID="3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584" exitCode=0
Jul 15 19:53:29.591166 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:29.591054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" event={"ID":"b8700214-2274-4bf8-a3c4-ad99ddde4f30","Type":"ContainerDied","Data":"3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584"}
Jul 15 19:53:29.591515 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:29.591479    2562 scope.go:117] "RemoveContainer" containerID="3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584"
Jul 15 19:53:29.592548 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:29.592520    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:29.592621 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:29.592590    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:29.592656 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:29.592624    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:53:30.597313 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:30.597282    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" event={"ID":"b8700214-2274-4bf8-a3c4-ad99ddde4f30","Type":"ContainerStarted","Data":"224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990"}
Jul 15 19:53:30.991797 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:30.991755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:30.992010 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:30.991885    2562 patch_prober.go:28] interesting pod/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 19:53:30.992010 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:30.991929    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 19:53:31.991646 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:31.991610    2562 patch_prober.go:28] interesting pod/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 19:53:31.992254 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:31.992222    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 19:53:32.991892 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:32.991849    2562 patch_prober.go:28] interesting pod/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 19:53:32.992387 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:32.991918    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 19:53:33.991574 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:33.991532    2562 patch_prober.go:28] interesting pod/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 19:53:33.991771 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:33.991608    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 19:53:34.035811 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:34.035776    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:53:34.995225 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:34.995199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:34.995553 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:34.995533    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:34.996272 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:34.996250    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:53:44.932464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:53:44.932431    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:54:00.635388 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:00.635352    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:54:16.840732 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:16.840691    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:54:23.211030 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.210984    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"]
Jul 15 19:54:23.211617 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.211213    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr" podUID="6ba0da19-ef29-49fe-a609-c349a82f93fe" containerName="maas-api" containerID="cri-o://dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18" gracePeriod=30
Jul 15 19:54:23.477020 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.476933    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr" podUID="6ba0da19-ef29-49fe-a609-c349a82f93fe" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.52:8443/health\": dial tcp 10.132.0.52:8443: connect: connection refused"
Jul 15 19:54:23.657817 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.657793    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:54:23.719978 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.719955    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ba0da19-ef29-49fe-a609-c349a82f93fe-maas-api-tls\") pod \"6ba0da19-ef29-49fe-a609-c349a82f93fe\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") "
Jul 15 19:54:23.720085 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.720000    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8t5n\" (UniqueName: \"kubernetes.io/projected/6ba0da19-ef29-49fe-a609-c349a82f93fe-kube-api-access-q8t5n\") pod \"6ba0da19-ef29-49fe-a609-c349a82f93fe\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") "
Jul 15 19:54:23.720152 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.720130    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba0da19-ef29-49fe-a609-c349a82f93fe-openshift-service-ca\") pod \"6ba0da19-ef29-49fe-a609-c349a82f93fe\" (UID: \"6ba0da19-ef29-49fe-a609-c349a82f93fe\") "
Jul 15 19:54:23.720444 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.720414    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ba0da19-ef29-49fe-a609-c349a82f93fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ba0da19-ef29-49fe-a609-c349a82f93fe" (UID: "6ba0da19-ef29-49fe-a609-c349a82f93fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:54:23.721874 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.721850    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ba0da19-ef29-49fe-a609-c349a82f93fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ba0da19-ef29-49fe-a609-c349a82f93fe" (UID: "6ba0da19-ef29-49fe-a609-c349a82f93fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:54:23.721966 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.721929    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ba0da19-ef29-49fe-a609-c349a82f93fe-kube-api-access-q8t5n" (OuterVolumeSpecName: "kube-api-access-q8t5n") pod "6ba0da19-ef29-49fe-a609-c349a82f93fe" (UID: "6ba0da19-ef29-49fe-a609-c349a82f93fe"). InnerVolumeSpecName "kube-api-access-q8t5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:54:23.821245 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.821221    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba0da19-ef29-49fe-a609-c349a82f93fe-openshift-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:23.821245 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.821242    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ba0da19-ef29-49fe-a609-c349a82f93fe-maas-api-tls\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:23.821371 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.821251    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8t5n\" (UniqueName: \"kubernetes.io/projected/6ba0da19-ef29-49fe-a609-c349a82f93fe-kube-api-access-q8t5n\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:23.868802 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.868777    2562 generic.go:356] "Generic (PLEG): container finished" podID="6ba0da19-ef29-49fe-a609-c349a82f93fe" containerID="dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18" exitCode=0
Jul 15 19:54:23.868926 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.868824    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"
Jul 15 19:54:23.868926 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.868862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr" event={"ID":"6ba0da19-ef29-49fe-a609-c349a82f93fe","Type":"ContainerDied","Data":"dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18"}
Jul 15 19:54:23.868926 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.868912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr" event={"ID":"6ba0da19-ef29-49fe-a609-c349a82f93fe","Type":"ContainerDied","Data":"6e3c78daae6f0462ae10dcf16c28bec870b9c56e1ff7b814888968a631a69323"}
Jul 15 19:54:23.869032 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.868935    2562 scope.go:117] "RemoveContainer" containerID="dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18"
Jul 15 19:54:23.878206 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.878187    2562 scope.go:117] "RemoveContainer" containerID="dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18"
Jul 15 19:54:23.878454 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:54:23.878437    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18\": container with ID starting with dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18 not found: ID does not exist" containerID="dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18"
Jul 15 19:54:23.878532 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.878463    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18"} err="failed to get container status \"dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18\": rpc error: code = NotFound desc = could not find container \"dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18\": container with ID starting with dbe6c47cdbdda35d1c57a257606f33757f8bcca60262b71b5b2aad026c1d1d18 not found: ID does not exist"
Jul 15 19:54:23.891133 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.891110    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"]
Jul 15 19:54:23.894387 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:23.894368    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da0342-5884667588-d9lxr"]
Jul 15 19:54:24.563855 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:24.563826    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ba0da19-ef29-49fe-a609-c349a82f93fe" path="/var/lib/kubelet/pods/6ba0da19-ef29-49fe-a609-c349a82f93fe/volumes"
Jul 15 19:54:32.232556 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:32.232517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:54:34.464051 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:34.464018    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"]
Jul 15 19:54:34.464525 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:34.464274    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy" containerID="cri-o://a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277" gracePeriod=30
Jul 15 19:54:39.722313 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.722290    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:54:39.848622 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848599    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-istio-token\") pod \"7475a543-507c-483b-bdbc-304cafc034ca\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") "
Jul 15 19:54:39.848774 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848630    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-credential-socket\") pod \"7475a543-507c-483b-bdbc-304cafc034ca\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") "
Jul 15 19:54:39.848774 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848671    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-socket\") pod \"7475a543-507c-483b-bdbc-304cafc034ca\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") "
Jul 15 19:54:39.848904 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848784    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7475a543-507c-483b-bdbc-304cafc034ca-istiod-ca-cert\") pod \"7475a543-507c-483b-bdbc-304cafc034ca\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") "
Jul 15 19:54:39.848904 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848818    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-certs\") pod \"7475a543-507c-483b-bdbc-304cafc034ca\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") "
Jul 15 19:54:39.848904 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848840    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7475a543-507c-483b-bdbc-304cafc034ca-istio-podinfo\") pod \"7475a543-507c-483b-bdbc-304cafc034ca\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") "
Jul 15 19:54:39.848904 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848884    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7475a543-507c-483b-bdbc-304cafc034ca" (UID: "7475a543-507c-483b-bdbc-304cafc034ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:54:39.848904 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848902    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-envoy\") pod \"7475a543-507c-483b-bdbc-304cafc034ca\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") "
Jul 15 19:54:39.849166 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848921    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7475a543-507c-483b-bdbc-304cafc034ca" (UID: "7475a543-507c-483b-bdbc-304cafc034ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:54:39.849166 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848939    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-data\") pod \"7475a543-507c-483b-bdbc-304cafc034ca\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") "
Jul 15 19:54:39.849166 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.848976    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6s4s\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-kube-api-access-z6s4s\") pod \"7475a543-507c-483b-bdbc-304cafc034ca\" (UID: \"7475a543-507c-483b-bdbc-304cafc034ca\") "
Jul 15 19:54:39.849166 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.849088    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7475a543-507c-483b-bdbc-304cafc034ca" (UID: "7475a543-507c-483b-bdbc-304cafc034ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:54:39.849373 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.849147    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7475a543-507c-483b-bdbc-304cafc034ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7475a543-507c-483b-bdbc-304cafc034ca" (UID: "7475a543-507c-483b-bdbc-304cafc034ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:54:39.849373 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.849250    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-certs\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:39.849373 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.849285    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-credential-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:39.849373 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.849302    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-workload-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:39.849782 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.849757    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "7475a543-507c-483b-bdbc-304cafc034ca" (UID: "7475a543-507c-483b-bdbc-304cafc034ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:54:39.850961 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.850932    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-kube-api-access-z6s4s" (OuterVolumeSpecName: "kube-api-access-z6s4s") pod "7475a543-507c-483b-bdbc-304cafc034ca" (UID: "7475a543-507c-483b-bdbc-304cafc034ca"). InnerVolumeSpecName "kube-api-access-z6s4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:54:39.851071 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.850953    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7475a543-507c-483b-bdbc-304cafc034ca" (UID: "7475a543-507c-483b-bdbc-304cafc034ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:54:39.851117 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.851106    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7475a543-507c-483b-bdbc-304cafc034ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7475a543-507c-483b-bdbc-304cafc034ca" (UID: "7475a543-507c-483b-bdbc-304cafc034ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:54:39.851154 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.851139    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "7475a543-507c-483b-bdbc-304cafc034ca" (UID: "7475a543-507c-483b-bdbc-304cafc034ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:54:39.949738 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.949711    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-envoy\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:39.949851 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.949735    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7475a543-507c-483b-bdbc-304cafc034ca-istio-data\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:39.949851 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.949759    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6s4s\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-kube-api-access-z6s4s\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:39.949851 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.949772    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7475a543-507c-483b-bdbc-304cafc034ca-istio-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:39.949851 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.949783    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7475a543-507c-483b-bdbc-304cafc034ca-istiod-ca-cert\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:39.949851 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.949795    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7475a543-507c-483b-bdbc-304cafc034ca-istio-podinfo\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:54:39.954065 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.954041    2562 generic.go:356] "Generic (PLEG): container finished" podID="7475a543-507c-483b-bdbc-304cafc034ca" containerID="a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277" exitCode=0
Jul 15 19:54:39.954157 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.954085    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"
Jul 15 19:54:39.954157 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.954129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" event={"ID":"7475a543-507c-483b-bdbc-304cafc034ca","Type":"ContainerDied","Data":"a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277"}
Jul 15 19:54:39.954227 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.954178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll" event={"ID":"7475a543-507c-483b-bdbc-304cafc034ca","Type":"ContainerDied","Data":"a9e1805c166f69f474a2ebc6739eaa3c00d409322806481e98deeda14bd9e1e9"}
Jul 15 19:54:39.954227 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.954204    2562 scope.go:117] "RemoveContainer" containerID="a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277"
Jul 15 19:54:39.963551 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.963531    2562 scope.go:117] "RemoveContainer" containerID="5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3"
Jul 15 19:54:39.971402 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.971383    2562 scope.go:117] "RemoveContainer" containerID="a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277"
Jul 15 19:54:39.971668 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:54:39.971650    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277\": container with ID starting with a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277 not found: ID does not exist" containerID="a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277"
Jul 15 19:54:39.971717 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.971675    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277"} err="failed to get container status \"a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277\": rpc error: code = NotFound desc = could not find container \"a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277\": container with ID starting with a41bd4dd6ab79b2c0cb60326e6824f7b330ae18e6ec988e617a372189a21e277 not found: ID does not exist"
Jul 15 19:54:39.971717 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.971693    2562 scope.go:117] "RemoveContainer" containerID="5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3"
Jul 15 19:54:39.971909 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:54:39.971894    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3\": container with ID starting with 5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3 not found: ID does not exist" containerID="5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3"
Jul 15 19:54:39.971948 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.971913    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3"} err="failed to get container status \"5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3\": rpc error: code = NotFound desc = could not find container \"5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3\": container with ID starting with 5c8d939d506bbb403f1ec1e0b7b8100ab19ee8ccbe45d718d3618cad09d99ec3 not found: ID does not exist"
Jul 15 19:54:39.975903 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.975884    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"]
Jul 15 19:54:39.980317 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:39.980298    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-da0342-openshift-default-557cc995c-n2qll"]
Jul 15 19:54:40.564207 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:40.564180    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7475a543-507c-483b-bdbc-304cafc034ca" path="/var/lib/kubelet/pods/7475a543-507c-483b-bdbc-304cafc034ca/volumes"
Jul 15 19:54:48.338111 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:48.338067    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:54:56.268858 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:56.268821    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"]
Jul 15 19:54:56.269317 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:56.269046    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy" containerID="cri-o://224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990" gracePeriod=30
Jul 15 19:54:57.207604 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.207573    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"]
Jul 15 19:54:57.207934 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.207921    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy"
Jul 15 19:54:57.207984 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.207936    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy"
Jul 15 19:54:57.207984 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.207952    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba0da19-ef29-49fe-a609-c349a82f93fe" containerName="maas-api"
Jul 15 19:54:57.207984 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.207957    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba0da19-ef29-49fe-a609-c349a82f93fe" containerName="maas-api"
Jul 15 19:54:57.207984 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.207965    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy"
Jul 15 19:54:57.207984 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.207971    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy"
Jul 15 19:54:57.208152 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.208034    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy"
Jul 15 19:54:57.208152 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.208041    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ba0da19-ef29-49fe-a609-c349a82f93fe" containerName="maas-api"
Jul 15 19:54:57.211148 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.211132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.214063 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.214039    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-06b9cb-openshift-default-dockercfg-hh5vl\""
Jul 15 19:54:57.223763 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.223744    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"]
Jul 15 19:54:57.282226 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.282202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istiod-ca-cert\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.282599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.282238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smxfm\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-kube-api-access-smxfm\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.282599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.282267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-envoy\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.282599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.282345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-certs\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.282599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.282382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-podinfo\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.282599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.282438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-credential-socket\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.282599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.282518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-socket\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.282599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.282552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-data\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.282856 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.282635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-token\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.383575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-certs\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.383575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-podinfo\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.383764 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-credential-socket\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.383764 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-socket\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.383764 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-data\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.383764 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-token\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.383764 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istiod-ca-cert\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.384015 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smxfm\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-kube-api-access-smxfm\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.384015 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-envoy\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.384015 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383972    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-certs\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.384015 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.383993    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-credential-socket\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.384284 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.384260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-socket\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.384343 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.384294    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-data\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.384521 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.384474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istiod-ca-cert\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.386189 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.386161    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-podinfo\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.386316 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.386297    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-envoy\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.393104 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.393079    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-token\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.393454 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.393438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smxfm\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-kube-api-access-smxfm\") pod \"e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") " pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.520757 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.520735    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:57.662561 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.662534    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"]
Jul 15 19:54:57.664227 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:54:57.664201    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f77ea42_5721_4ffb_9536_a3e7bf8f7c76.slice/crio-03a448de1b7b9bc94165dfcbd1f4d2baa9f051eb14b2254ab25381b29f91021f WatchSource:0}: Error finding container 03a448de1b7b9bc94165dfcbd1f4d2baa9f051eb14b2254ab25381b29f91021f: Status 404 returned error can't find the container with id 03a448de1b7b9bc94165dfcbd1f4d2baa9f051eb14b2254ab25381b29f91021f
Jul 15 19:54:57.666466 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.666430    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:54:57.666560 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.666543    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:54:57.666608 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:57.666585    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:54:58.046312 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:58.046280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" event={"ID":"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76","Type":"ContainerStarted","Data":"df19dad1353006fa67a5649148ec6149c433878891f9c69fb8990fbfe551c673"}
Jul 15 19:54:58.046476 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:58.046329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" event={"ID":"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76","Type":"ContainerStarted","Data":"03a448de1b7b9bc94165dfcbd1f4d2baa9f051eb14b2254ab25381b29f91021f"}
Jul 15 19:54:58.068158 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:58.068113    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" podStartSLOduration=1.0680989 podStartE2EDuration="1.0680989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:58.067389565 +0000 UTC m=+2390.065367945" watchObservedRunningTime="2026-07-15 19:54:58.0680989 +0000 UTC m=+2390.066077272"
Jul 15 19:54:58.521560 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:58.521531    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:58.526274 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:58.526251    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:59.051194 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:59.051163    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:54:59.051976 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:54:59.051957    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:55:00.120354 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.120317    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"]
Jul 15 19:55:00.120899 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.120880    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7475a543-507c-483b-bdbc-304cafc034ca" containerName="istio-proxy"
Jul 15 19:55:00.123992 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.123971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.127284 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.127262    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-06b9cb-serving-cert\""
Jul 15 19:55:00.127367 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.127305    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5qhz\""
Jul 15 19:55:00.128519 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.128501    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 19:55:00.128595 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.128575    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:55:00.143593 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.141291    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"]
Jul 15 19:55:00.207943 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.207920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb6af91-9932-4ac9-b573-6efec05459ee-maas-api-tls\") pod \"maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.208084 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.208061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6af91-9932-4ac9-b573-6efec05459ee-openshift-service-ca\") pod \"maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.208205 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.208183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk64l\" (UniqueName: \"kubernetes.io/projected/8eb6af91-9932-4ac9-b573-6efec05459ee-kube-api-access-vk64l\") pod \"maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.309599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.309571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb6af91-9932-4ac9-b573-6efec05459ee-maas-api-tls\") pod \"maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.309599 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.309603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6af91-9932-4ac9-b573-6efec05459ee-openshift-service-ca\") pod \"maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.309794 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.309648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk64l\" (UniqueName: \"kubernetes.io/projected/8eb6af91-9932-4ac9-b573-6efec05459ee-kube-api-access-vk64l\") pod \"maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.310281 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.310250    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6af91-9932-4ac9-b573-6efec05459ee-openshift-service-ca\") pod \"maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.311967 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.311946    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb6af91-9932-4ac9-b573-6efec05459ee-maas-api-tls\") pod \"maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.319588 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.319569    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk64l\" (UniqueName: \"kubernetes.io/projected/8eb6af91-9932-4ac9-b573-6efec05459ee-kube-api-access-vk64l\") pod \"maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.438989 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.438933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:00.773578 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.773554    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"]
Jul 15 19:55:00.775257 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:55:00.775232    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb6af91_9932_4ac9_b573_6efec05459ee.slice/crio-2dcee1b55669b8e4c930f22be7dbcaa2bf9d3f6136cd12485deecdbb50111740 WatchSource:0}: Error finding container 2dcee1b55669b8e4c930f22be7dbcaa2bf9d3f6136cd12485deecdbb50111740: Status 404 returned error can't find the container with id 2dcee1b55669b8e4c930f22be7dbcaa2bf9d3f6136cd12485deecdbb50111740
Jul 15 19:55:00.776650 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:00.776633    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:55:01.061846 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.061756    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f" event={"ID":"8eb6af91-9932-4ac9-b573-6efec05459ee","Type":"ContainerStarted","Data":"2dcee1b55669b8e4c930f22be7dbcaa2bf9d3f6136cd12485deecdbb50111740"}
Jul 15 19:55:01.541799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.541779    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:55:01.621912 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.621844    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-podinfo\") pod \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") "
Jul 15 19:55:01.621912 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.621893    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-socket\") pod \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") "
Jul 15 19:55:01.622118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.621923    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istiod-ca-cert\") pod \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") "
Jul 15 19:55:01.622118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.621946    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-token\") pod \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") "
Jul 15 19:55:01.622118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.621977    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9qlb\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-kube-api-access-r9qlb\") pod \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") "
Jul 15 19:55:01.622118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622001    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-certs\") pod \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") "
Jul 15 19:55:01.622118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622028    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-data\") pod \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") "
Jul 15 19:55:01.622118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-credential-socket\") pod \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") "
Jul 15 19:55:01.622414 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622178    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-envoy\") pod \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\" (UID: \"b8700214-2274-4bf8-a3c4-ad99ddde4f30\") "
Jul 15 19:55:01.622414 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622267    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8700214-2274-4bf8-a3c4-ad99ddde4f30" (UID: "b8700214-2274-4bf8-a3c4-ad99ddde4f30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:01.622414 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622284    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8700214-2274-4bf8-a3c4-ad99ddde4f30" (UID: "b8700214-2274-4bf8-a3c4-ad99ddde4f30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:01.622414 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622336    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8700214-2274-4bf8-a3c4-ad99ddde4f30" (UID: "b8700214-2274-4bf8-a3c4-ad99ddde4f30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:55:01.622646 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622546    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:01.622646 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622567    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istiod-ca-cert\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:01.622646 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622581    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-workload-certs\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:01.622646 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.622582    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8700214-2274-4bf8-a3c4-ad99ddde4f30" (UID: "b8700214-2274-4bf8-a3c4-ad99ddde4f30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:01.623149 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.623124    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8700214-2274-4bf8-a3c4-ad99ddde4f30" (UID: "b8700214-2274-4bf8-a3c4-ad99ddde4f30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:01.624147 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.624121    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8700214-2274-4bf8-a3c4-ad99ddde4f30" (UID: "b8700214-2274-4bf8-a3c4-ad99ddde4f30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:55:01.624252 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.624235    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-kube-api-access-r9qlb" (OuterVolumeSpecName: "kube-api-access-r9qlb") pod "b8700214-2274-4bf8-a3c4-ad99ddde4f30" (UID: "b8700214-2274-4bf8-a3c4-ad99ddde4f30"). InnerVolumeSpecName "kube-api-access-r9qlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:55:01.624406 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.624390    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8700214-2274-4bf8-a3c4-ad99ddde4f30" (UID: "b8700214-2274-4bf8-a3c4-ad99ddde4f30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:01.624449 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.624394    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8700214-2274-4bf8-a3c4-ad99ddde4f30" (UID: "b8700214-2274-4bf8-a3c4-ad99ddde4f30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:55:01.722949 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.722922    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-envoy\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:01.722949 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.722948    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-podinfo\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:01.723068 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.722960    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:01.723068 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.722971    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9qlb\" (UniqueName: \"kubernetes.io/projected/b8700214-2274-4bf8-a3c4-ad99ddde4f30-kube-api-access-r9qlb\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:01.723068 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.722984    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-istio-data\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:01.723068 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:01.722996    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8700214-2274-4bf8-a3c4-ad99ddde4f30-credential-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:02.068748 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.068707    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f" event={"ID":"8eb6af91-9932-4ac9-b573-6efec05459ee","Type":"ContainerStarted","Data":"010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c"}
Jul 15 19:55:02.068926 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.068905    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:02.070544 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.070517    2562 generic.go:356] "Generic (PLEG): container finished" podID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerID="224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990" exitCode=0
Jul 15 19:55:02.070672 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.070556    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"
Jul 15 19:55:02.070672 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.070581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" event={"ID":"b8700214-2274-4bf8-a3c4-ad99ddde4f30","Type":"ContainerDied","Data":"224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990"}
Jul 15 19:55:02.070672 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.070634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7" event={"ID":"b8700214-2274-4bf8-a3c4-ad99ddde4f30","Type":"ContainerDied","Data":"772d8904c0b9ba0e3bd08eabc07d85e6d75d915f52bcfa06b11d7ae75b82bab3"}
Jul 15 19:55:02.070672 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.070661    2562 scope.go:117] "RemoveContainer" containerID="224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990"
Jul 15 19:55:02.080294 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.080269    2562 scope.go:117] "RemoveContainer" containerID="3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584"
Jul 15 19:55:02.086459 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.086411    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f" podStartSLOduration=1.395685154 podStartE2EDuration="2.086398267s" totalImagesPullingTime="690.713113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:02.08511951 +0000 UTC m=+2394.083097902" watchObservedRunningTime="2026-07-15 19:55:02.086398267 +0000 UTC m=+2394.084376701"
Jul 15 19:55:02.089533 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.089512    2562 scope.go:117] "RemoveContainer" containerID="224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990"
Jul 15 19:55:02.089830 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:55:02.089811    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990\": container with ID starting with 224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990 not found: ID does not exist" containerID="224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990"
Jul 15 19:55:02.089913 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.089844    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990"} err="failed to get container status \"224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990\": rpc error: code = NotFound desc = could not find container \"224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990\": container with ID starting with 224d6fbeaa68e13e04b586fcdb9130e58435f63ed237f374d4a882456c564990 not found: ID does not exist"
Jul 15 19:55:02.089913 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.089867    2562 scope.go:117] "RemoveContainer" containerID="3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584"
Jul 15 19:55:02.090175 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:55:02.090155    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584\": container with ID starting with 3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584 not found: ID does not exist" containerID="3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584"
Jul 15 19:55:02.090219 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.090181    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584"} err="failed to get container status \"3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584\": rpc error: code = NotFound desc = could not find container \"3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584\": container with ID starting with 3c4654fe2c69a7d8584b11ef53933d8272be1441956db5b53ecf024bf5a7f584 not found: ID does not exist"
Jul 15 19:55:02.100061 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.100034    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"]
Jul 15 19:55:02.103322 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.103299    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-435e1e-openshift-default-84964cff97-vltm7"]
Jul 15 19:55:02.564974 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.564942    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" path="/var/lib/kubelet/pods/b8700214-2274-4bf8-a3c4-ad99ddde4f30/volumes"
Jul 15 19:55:02.636341 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:02.636312    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:55:05.310517 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.310098    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"]
Jul 15 19:55:05.310977 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.310658    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy"
Jul 15 19:55:05.310977 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.310678    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy"
Jul 15 19:55:05.310977 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.310796    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy"
Jul 15 19:55:05.310977 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.310808    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy"
Jul 15 19:55:05.321995 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.321969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.323254 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.323234    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"]
Jul 15 19:55:05.324741 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.324711    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a4ccbf-openshift-default-dockercfg-wzgv5\""
Jul 15 19:55:05.456203 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.456169    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-data\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.456361 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.456219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abf73393-0b92-40aa-9354-e55f099e1820-istiod-ca-cert\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.456361 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.456293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-certs\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.456361 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.456348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fz6s\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-kube-api-access-5fz6s\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.456465 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.456374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-credential-socket\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.456465 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.456394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-envoy\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.456465 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.456413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abf73393-0b92-40aa-9354-e55f099e1820-istio-podinfo\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.456590 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.456464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-istio-token\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.456590 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.456548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-socket\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.557464 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-credential-socket\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.557642 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-envoy\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.557642 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abf73393-0b92-40aa-9354-e55f099e1820-istio-podinfo\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.557642 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-istio-token\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.557642 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-socket\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.557863 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-data\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.557863 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abf73393-0b92-40aa-9354-e55f099e1820-istiod-ca-cert\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.557863 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-certs\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.557863 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fz6s\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-kube-api-access-5fz6s\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.558064 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.557905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-credential-socket\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.558159 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.558131    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-socket\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.558263 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.558209    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-data\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.558393 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.558351    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-certs\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.558592 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.558572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abf73393-0b92-40aa-9354-e55f099e1820-istiod-ca-cert\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.560135 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.560115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-envoy\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.560450 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.560430    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abf73393-0b92-40aa-9354-e55f099e1820-istio-podinfo\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.566135 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.566082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fz6s\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-kube-api-access-5fz6s\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.566274 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.566255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-istio-token\") pod \"e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") " pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.634487 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.634463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:05.817247 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.817222    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"]
Jul 15 19:55:05.818643 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:55:05.818616    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf73393_0b92_40aa_9354_e55f099e1820.slice/crio-5ed69ddfc86a2c7c1164524a07e9a3b43163f14962231c9e577ee3ddfe778c1f WatchSource:0}: Error finding container 5ed69ddfc86a2c7c1164524a07e9a3b43163f14962231c9e577ee3ddfe778c1f: Status 404 returned error can't find the container with id 5ed69ddfc86a2c7c1164524a07e9a3b43163f14962231c9e577ee3ddfe778c1f
Jul 15 19:55:05.820848 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.820819    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:55:05.820938 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.820883    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:55:05.820938 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:05.820913    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:55:06.121573 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:06.120195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" event={"ID":"abf73393-0b92-40aa-9354-e55f099e1820","Type":"ContainerStarted","Data":"8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c"}
Jul 15 19:55:06.121573 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:06.120309    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" event={"ID":"abf73393-0b92-40aa-9354-e55f099e1820","Type":"ContainerStarted","Data":"5ed69ddfc86a2c7c1164524a07e9a3b43163f14962231c9e577ee3ddfe778c1f"}
Jul 15 19:55:06.143154 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:06.143098    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" podStartSLOduration=1.143083609 podStartE2EDuration="1.143083609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:06.141374266 +0000 UTC m=+2398.139352639" watchObservedRunningTime="2026-07-15 19:55:06.143083609 +0000 UTC m=+2398.141061986"
Jul 15 19:55:06.635089 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:06.635063    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:06.636616 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:06.636593    2562 patch_prober.go:28] interesting pod/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 19:55:06.636734 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:06.636638    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 19:55:07.638318 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:07.638285    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:08.082767 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:08.082730    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:08.132349 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:08.132329    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:08.133206 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:08.133184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:08.661783 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:08.661754    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:55:08.663757 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:08.663738    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 19:55:11.150417 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:11.150378    2562 generic.go:356] "Generic (PLEG): container finished" podID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerID="df19dad1353006fa67a5649148ec6149c433878891f9c69fb8990fbfe551c673" exitCode=0
Jul 15 19:55:11.150895 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:11.150434    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" event={"ID":"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76","Type":"ContainerDied","Data":"df19dad1353006fa67a5649148ec6149c433878891f9c69fb8990fbfe551c673"}
Jul 15 19:55:11.150895 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:11.150840    2562 scope.go:117] "RemoveContainer" containerID="df19dad1353006fa67a5649148ec6149c433878891f9c69fb8990fbfe551c673"
Jul 15 19:55:11.152020 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:11.151982    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:55:11.152150 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:11.152080    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:55:11.152150 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:11.152130    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:55:12.157917 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:12.157885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" event={"ID":"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76","Type":"ContainerStarted","Data":"212cec2e4b6f7368d85de8af7a434528bbecd334c28bc44ed505604deee00905"}
Jul 15 19:55:12.520999 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:12.520963    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:55:12.522188 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:12.522164    2562 patch_prober.go:28] interesting pod/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 15 19:55:12.522301 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:12.522211    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 15 19:55:13.521397 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:13.521364    2562 patch_prober.go:28] interesting pod/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 15 19:55:13.521782 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:13.521427    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 15 19:55:13.936051 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:13.935966    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:55:14.051689 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:14.051663    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:55:14.522080 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:14.522039    2562 patch_prober.go:28] interesting pod/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 15 19:55:14.522575 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:14.522099    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 15 19:55:15.522016 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:15.521543    2562 patch_prober.go:28] interesting pod/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 15 19:55:15.522016 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:15.521622    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 15 19:55:16.525585 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:16.525553    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:55:16.526600 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:16.526581    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:55:22.211225 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:22.211189    2562 generic.go:356] "Generic (PLEG): container finished" podID="abf73393-0b92-40aa-9354-e55f099e1820" containerID="8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c" exitCode=0
Jul 15 19:55:22.211659 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:22.211263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" event={"ID":"abf73393-0b92-40aa-9354-e55f099e1820","Type":"ContainerDied","Data":"8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c"}
Jul 15 19:55:22.211719 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:22.211658    2562 scope.go:117] "RemoveContainer" containerID="8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c"
Jul 15 19:55:22.212663 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:22.212638    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:55:22.212744 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:22.212720    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:55:22.212799 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:22.212777    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:55:23.132539 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:23.132506    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:23.218363 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:23.218331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" event={"ID":"abf73393-0b92-40aa-9354-e55f099e1820","Type":"ContainerStarted","Data":"3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe"}
Jul 15 19:55:23.635168 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:23.635135    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:23.636053 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:23.636033    2562 patch_prober.go:28] interesting pod/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 19:55:23.636158 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:23.636086    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 19:55:24.634948 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:24.634917    2562 patch_prober.go:28] interesting pod/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 19:55:24.635334 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:24.634968    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 19:55:25.635246 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:25.635210    2562 patch_prober.go:28] interesting pod/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 19:55:25.635644 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:25.635272    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 19:55:26.635604 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:26.635571    2562 patch_prober.go:28] interesting pod/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 19:55:26.635979 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:26.635637    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 19:55:27.639220 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:27.639191    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:27.639591 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:27.639514    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:27.640278 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:27.640260    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:55:36.621679 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:36.621590    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"]
Jul 15 19:55:36.622171 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:36.621834    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f" podUID="8eb6af91-9932-4ac9-b573-6efec05459ee" containerName="maas-api" containerID="cri-o://010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c" gracePeriod=30
Jul 15 19:55:36.877018 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:36.876961    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:36.934346 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:36.934318    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk64l\" (UniqueName: \"kubernetes.io/projected/8eb6af91-9932-4ac9-b573-6efec05459ee-kube-api-access-vk64l\") pod \"8eb6af91-9932-4ac9-b573-6efec05459ee\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") "
Jul 15 19:55:36.934545 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:36.934375    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6af91-9932-4ac9-b573-6efec05459ee-openshift-service-ca\") pod \"8eb6af91-9932-4ac9-b573-6efec05459ee\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") "
Jul 15 19:55:36.934545 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:36.934479    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb6af91-9932-4ac9-b573-6efec05459ee-maas-api-tls\") pod \"8eb6af91-9932-4ac9-b573-6efec05459ee\" (UID: \"8eb6af91-9932-4ac9-b573-6efec05459ee\") "
Jul 15 19:55:36.934702 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:36.934683    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb6af91-9932-4ac9-b573-6efec05459ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8eb6af91-9932-4ac9-b573-6efec05459ee" (UID: "8eb6af91-9932-4ac9-b573-6efec05459ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:55:36.936448 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:36.936427    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb6af91-9932-4ac9-b573-6efec05459ee-kube-api-access-vk64l" (OuterVolumeSpecName: "kube-api-access-vk64l") pod "8eb6af91-9932-4ac9-b573-6efec05459ee" (UID: "8eb6af91-9932-4ac9-b573-6efec05459ee"). InnerVolumeSpecName "kube-api-access-vk64l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:55:36.936448 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:36.936441    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6af91-9932-4ac9-b573-6efec05459ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8eb6af91-9932-4ac9-b573-6efec05459ee" (UID: "8eb6af91-9932-4ac9-b573-6efec05459ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:55:37.035331 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.035300    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk64l\" (UniqueName: \"kubernetes.io/projected/8eb6af91-9932-4ac9-b573-6efec05459ee-kube-api-access-vk64l\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:37.035331 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.035324    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6af91-9932-4ac9-b573-6efec05459ee-openshift-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:37.035331 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.035335    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb6af91-9932-4ac9-b573-6efec05459ee-maas-api-tls\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:37.286761 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.286727    2562 generic.go:356] "Generic (PLEG): container finished" podID="8eb6af91-9932-4ac9-b573-6efec05459ee" containerID="010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c" exitCode=0
Jul 15 19:55:37.286926 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.286777    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"
Jul 15 19:55:37.286926 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.286776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f" event={"ID":"8eb6af91-9932-4ac9-b573-6efec05459ee","Type":"ContainerDied","Data":"010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c"}
Jul 15 19:55:37.286926 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.286905    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f" event={"ID":"8eb6af91-9932-4ac9-b573-6efec05459ee","Type":"ContainerDied","Data":"2dcee1b55669b8e4c930f22be7dbcaa2bf9d3f6136cd12485deecdbb50111740"}
Jul 15 19:55:37.287031 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.286939    2562 scope.go:117] "RemoveContainer" containerID="010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c"
Jul 15 19:55:37.296302 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.296283    2562 scope.go:117] "RemoveContainer" containerID="010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c"
Jul 15 19:55:37.296604 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:55:37.296584    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c\": container with ID starting with 010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c not found: ID does not exist" containerID="010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c"
Jul 15 19:55:37.296703 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.296613    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c"} err="failed to get container status \"010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c\": rpc error: code = NotFound desc = could not find container \"010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c\": container with ID starting with 010d4cf053d7e0589cb8cfd02f6cf54c19636cc379c595267726636b98ab853c not found: ID does not exist"
Jul 15 19:55:37.308308 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.308286    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"]
Jul 15 19:55:37.310323 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:37.310305    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-06b9cb-7d95c874cf-4sj2f"]
Jul 15 19:55:38.564196 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:38.564161    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eb6af91-9932-4ac9-b573-6efec05459ee" path="/var/lib/kubelet/pods/8eb6af91-9932-4ac9-b573-6efec05459ee/volumes"
Jul 15 19:55:42.937506 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:42.937455    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:55:47.223508 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:47.223464    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"]
Jul 15 19:55:47.223909 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:47.223671    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy" containerID="cri-o://212cec2e4b6f7368d85de8af7a434528bbecd334c28bc44ed505604deee00905" gracePeriod=30
Jul 15 19:55:52.365828 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.365789    2562 generic.go:356] "Generic (PLEG): container finished" podID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerID="212cec2e4b6f7368d85de8af7a434528bbecd334c28bc44ed505604deee00905" exitCode=0
Jul 15 19:55:52.366255 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.365857    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" event={"ID":"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76","Type":"ContainerDied","Data":"212cec2e4b6f7368d85de8af7a434528bbecd334c28bc44ed505604deee00905"}
Jul 15 19:55:52.366255 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.365918    2562 scope.go:117] "RemoveContainer" containerID="df19dad1353006fa67a5649148ec6149c433878891f9c69fb8990fbfe551c673"
Jul 15 19:55:52.483064 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.483006    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:55:52.575381 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575357    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-envoy\") pod \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") "
Jul 15 19:55:52.575515 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575389    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smxfm\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-kube-api-access-smxfm\") pod \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") "
Jul 15 19:55:52.575515 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575420    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istiod-ca-cert\") pod \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") "
Jul 15 19:55:52.575515 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575449    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-certs\") pod \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") "
Jul 15 19:55:52.575515 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-credential-socket\") pod \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") "
Jul 15 19:55:52.575515 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575486    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-socket\") pod \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") "
Jul 15 19:55:52.575784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575532    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-token\") pod \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") "
Jul 15 19:55:52.575784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575568    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-podinfo\") pod \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") "
Jul 15 19:55:52.575784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575601    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-data\") pod \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\" (UID: \"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76\") "
Jul 15 19:55:52.575784 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575725    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" (UID: "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:52.576038 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575805    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" (UID: "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:52.576038 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575867    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" (UID: "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:52.576038 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575913    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" (UID: "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:55:52.576038 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.575981    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-credential-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:52.576038 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.576002    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:52.576038 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.576016    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-workload-certs\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:52.576600 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.576570    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" (UID: "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:52.577549 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.577528    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" (UID: "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:55:52.577664 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.577622    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-kube-api-access-smxfm" (OuterVolumeSpecName: "kube-api-access-smxfm") pod "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" (UID: "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76"). InnerVolumeSpecName "kube-api-access-smxfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:55:52.577720 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.577704    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" (UID: "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:55:52.577946 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.577925    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" (UID: "9f77ea42-5721-4ffb-9536-a3e7bf8f7c76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:55:52.676720 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.676681    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-envoy\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:52.676720 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.676717    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smxfm\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-kube-api-access-smxfm\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:52.676720 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.676730    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istiod-ca-cert\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:52.676966 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.676739    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:52.676966 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.676746    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-podinfo\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:52.676966 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:52.676753    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76-istio-data\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:55:53.371639 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:53.371612    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"
Jul 15 19:55:53.371639 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:53.371621    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8" event={"ID":"9f77ea42-5721-4ffb-9536-a3e7bf8f7c76","Type":"ContainerDied","Data":"03a448de1b7b9bc94165dfcbd1f4d2baa9f051eb14b2254ab25381b29f91021f"}
Jul 15 19:55:53.372102 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:53.371682    2562 scope.go:117] "RemoveContainer" containerID="212cec2e4b6f7368d85de8af7a434528bbecd334c28bc44ed505604deee00905"
Jul 15 19:55:53.393319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:53.393295    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"]
Jul 15 19:55:53.397904 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:53.397883    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-06b9cb-openshift-default-56658bd8f9-dz8v8"]
Jul 15 19:55:54.564546 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:55:54.564513    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" path="/var/lib/kubelet/pods/9f77ea42-5721-4ffb-9536-a3e7bf8f7c76/volumes"
Jul 15 19:56:08.535336 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:08.535304    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:56:14.225070 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:14.225038    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"]
Jul 15 19:56:14.225453 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:14.225236    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy" containerID="cri-o://3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe" gracePeriod=30
Jul 15 19:56:15.169095 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169064    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"]
Jul 15 19:56:15.169450 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169431    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy"
Jul 15 19:56:15.169450 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169447    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy"
Jul 15 19:56:15.169636 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169502    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy"
Jul 15 19:56:15.169636 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169512    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8700214-2274-4bf8-a3c4-ad99ddde4f30" containerName="istio-proxy"
Jul 15 19:56:15.169636 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169529    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb6af91-9932-4ac9-b573-6efec05459ee" containerName="maas-api"
Jul 15 19:56:15.169636 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169538    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb6af91-9932-4ac9-b573-6efec05459ee" containerName="maas-api"
Jul 15 19:56:15.169636 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169621    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy"
Jul 15 19:56:15.169636 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169628    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb6af91-9932-4ac9-b573-6efec05459ee" containerName="maas-api"
Jul 15 19:56:15.169636 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.169634    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy"
Jul 15 19:56:15.174199 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.174183    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.177086 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.177067    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e8718e-openshift-default-dockercfg-hm2jb\""
Jul 15 19:56:15.186018 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.185996    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"]
Jul 15 19:56:15.266874 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.266846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-credential-socket\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.266874 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.266876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-envoy\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.267319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.266917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istiod-ca-cert\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.267319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.266958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-podinfo\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.267319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.266985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfq7x\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-kube-api-access-jfq7x\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.267319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.267021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-token\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.267319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.267067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-socket\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.267319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.267098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-data\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.267319 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.267115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-certs\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.367908 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.367876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-data\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.367908 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.367911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-certs\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368107 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.367946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-credential-socket\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368107 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.367967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-envoy\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368107 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istiod-ca-cert\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368107 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-podinfo\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368107 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfq7x\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-kube-api-access-jfq7x\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368357 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-token\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368357 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-socket\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368357 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368288    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-data\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368528 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368362    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-certs\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368739 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-socket\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368884 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368717    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-credential-socket\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.368884 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.368860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istiod-ca-cert\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.370381 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.370361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-envoy\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.370703 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.370684    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-podinfo\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.378014 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.377991    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-token\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.378014 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.378005    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfq7x\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-kube-api-access-jfq7x\") pod \"e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") " pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.484680 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.484595    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:15.621798 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.621773    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"]
Jul 15 19:56:15.623660 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:56:15.623633    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb379c9c1_9476_480e_8fc3_7be40c0b9eab.slice/crio-6e23dc4ba86a151f3ea32dc1f237709538f44645c0a6d5caa7206a3e10991f37 WatchSource:0}: Error finding container 6e23dc4ba86a151f3ea32dc1f237709538f44645c0a6d5caa7206a3e10991f37: Status 404 returned error can't find the container with id 6e23dc4ba86a151f3ea32dc1f237709538f44645c0a6d5caa7206a3e10991f37
Jul 15 19:56:15.626089 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.626063    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:15.626167 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.626123    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:15.626167 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:15.626149    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:16.485571 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:16.485536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" event={"ID":"b379c9c1-9476-480e-8fc3-7be40c0b9eab","Type":"ContainerStarted","Data":"c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d"}
Jul 15 19:56:16.485966 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:16.485589    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" event={"ID":"b379c9c1-9476-480e-8fc3-7be40c0b9eab","Type":"ContainerStarted","Data":"6e23dc4ba86a151f3ea32dc1f237709538f44645c0a6d5caa7206a3e10991f37"}
Jul 15 19:56:16.509564 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:16.509518    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" podStartSLOduration=1.50950176 podStartE2EDuration="1.50950176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:16.507342501 +0000 UTC m=+2468.505320896" watchObservedRunningTime="2026-07-15 19:56:16.50950176 +0000 UTC m=+2468.507480124"
Jul 15 19:56:17.485253 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:17.485214    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:17.490179 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:17.490154    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:17.490886 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:17.490870    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:17.491536 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:17.491518    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:19.474321 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.474299    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:56:19.503107 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.503031    2562 generic.go:356] "Generic (PLEG): container finished" podID="abf73393-0b92-40aa-9354-e55f099e1820" containerID="3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe" exitCode=0
Jul 15 19:56:19.503264 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.503149    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"
Jul 15 19:56:19.503264 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.503175    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" event={"ID":"abf73393-0b92-40aa-9354-e55f099e1820","Type":"ContainerDied","Data":"3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe"}
Jul 15 19:56:19.503264 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.503236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q" event={"ID":"abf73393-0b92-40aa-9354-e55f099e1820","Type":"ContainerDied","Data":"5ed69ddfc86a2c7c1164524a07e9a3b43163f14962231c9e577ee3ddfe778c1f"}
Jul 15 19:56:19.503427 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.503265    2562 scope.go:117] "RemoveContainer" containerID="3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe"
Jul 15 19:56:19.504395 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504278    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abf73393-0b92-40aa-9354-e55f099e1820-istiod-ca-cert\") pod \"abf73393-0b92-40aa-9354-e55f099e1820\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") "
Jul 15 19:56:19.504395 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504316    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abf73393-0b92-40aa-9354-e55f099e1820-istio-podinfo\") pod \"abf73393-0b92-40aa-9354-e55f099e1820\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") "
Jul 15 19:56:19.504395 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504353    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fz6s\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-kube-api-access-5fz6s\") pod \"abf73393-0b92-40aa-9354-e55f099e1820\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") "
Jul 15 19:56:19.504395 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-istio-token\") pod \"abf73393-0b92-40aa-9354-e55f099e1820\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") "
Jul 15 19:56:19.504677 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-envoy\") pod \"abf73393-0b92-40aa-9354-e55f099e1820\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") "
Jul 15 19:56:19.504677 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504469    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-socket\") pod \"abf73393-0b92-40aa-9354-e55f099e1820\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") "
Jul 15 19:56:19.504677 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-data\") pod \"abf73393-0b92-40aa-9354-e55f099e1820\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") "
Jul 15 19:56:19.504677 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504576    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-credential-socket\") pod \"abf73393-0b92-40aa-9354-e55f099e1820\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") "
Jul 15 19:56:19.504677 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504659    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-certs\") pod \"abf73393-0b92-40aa-9354-e55f099e1820\" (UID: \"abf73393-0b92-40aa-9354-e55f099e1820\") "
Jul 15 19:56:19.504934 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504705    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abf73393-0b92-40aa-9354-e55f099e1820-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "abf73393-0b92-40aa-9354-e55f099e1820" (UID: "abf73393-0b92-40aa-9354-e55f099e1820"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:56:19.504991 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.504950    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abf73393-0b92-40aa-9354-e55f099e1820-istiod-ca-cert\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:56:19.505057 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.505035    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "abf73393-0b92-40aa-9354-e55f099e1820" (UID: "abf73393-0b92-40aa-9354-e55f099e1820"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:56:19.505204 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.505160    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "abf73393-0b92-40aa-9354-e55f099e1820" (UID: "abf73393-0b92-40aa-9354-e55f099e1820"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:56:19.505332 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.505232    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "abf73393-0b92-40aa-9354-e55f099e1820" (UID: "abf73393-0b92-40aa-9354-e55f099e1820"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:56:19.506059 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.506034    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-data" (OuterVolumeSpecName: "istio-data") pod "abf73393-0b92-40aa-9354-e55f099e1820" (UID: "abf73393-0b92-40aa-9354-e55f099e1820"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:56:19.507180 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.507153    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-kube-api-access-5fz6s" (OuterVolumeSpecName: "kube-api-access-5fz6s") pod "abf73393-0b92-40aa-9354-e55f099e1820" (UID: "abf73393-0b92-40aa-9354-e55f099e1820"). InnerVolumeSpecName "kube-api-access-5fz6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:56:19.507180 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.507170    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/abf73393-0b92-40aa-9354-e55f099e1820-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "abf73393-0b92-40aa-9354-e55f099e1820" (UID: "abf73393-0b92-40aa-9354-e55f099e1820"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:56:19.507403 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.507375    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "abf73393-0b92-40aa-9354-e55f099e1820" (UID: "abf73393-0b92-40aa-9354-e55f099e1820"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:56:19.507403 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.507380    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-istio-token" (OuterVolumeSpecName: "istio-token") pod "abf73393-0b92-40aa-9354-e55f099e1820" (UID: "abf73393-0b92-40aa-9354-e55f099e1820"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:56:19.532367 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.532346    2562 scope.go:117] "RemoveContainer" containerID="8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c"
Jul 15 19:56:19.540471 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.540446    2562 scope.go:117] "RemoveContainer" containerID="3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe"
Jul 15 19:56:19.540754 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:56:19.540733    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe\": container with ID starting with 3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe not found: ID does not exist" containerID="3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe"
Jul 15 19:56:19.540842 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.540760    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe"} err="failed to get container status \"3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe\": rpc error: code = NotFound desc = could not find container \"3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe\": container with ID starting with 3bda272cb3c678068f2b87c319abef08ac083ca468ca7a0e3f355ed3286314fe not found: ID does not exist"
Jul 15 19:56:19.540842 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.540788    2562 scope.go:117] "RemoveContainer" containerID="8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c"
Jul 15 19:56:19.541045 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:56:19.541027    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c\": container with ID starting with 8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c not found: ID does not exist" containerID="8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c"
Jul 15 19:56:19.541087 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.541054    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c"} err="failed to get container status \"8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c\": rpc error: code = NotFound desc = could not find container \"8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c\": container with ID starting with 8cb36fcf588d8a412bf9230f224d9d398a4953fd06e7a0f1ead15cd3ed47f96c not found: ID does not exist"
Jul 15 19:56:19.605920 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.605888    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-certs\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:56:19.605920 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.605921    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abf73393-0b92-40aa-9354-e55f099e1820-istio-podinfo\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:56:19.606118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.605934    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fz6s\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-kube-api-access-5fz6s\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:56:19.606118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.605948    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abf73393-0b92-40aa-9354-e55f099e1820-istio-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:56:19.606118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.605962    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-envoy\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:56:19.606118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.605973    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-workload-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:56:19.606118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.605984    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-istio-data\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:56:19.606118 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.605997    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abf73393-0b92-40aa-9354-e55f099e1820-credential-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 19:56:19.824901 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.824871    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"]
Jul 15 19:56:19.829337 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:19.829311    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a4ccbf-openshift-default-66b7c6d8f9-6qs5q"]
Jul 15 19:56:20.564839 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:20.564807    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abf73393-0b92-40aa-9354-e55f099e1820" path="/var/lib/kubelet/pods/abf73393-0b92-40aa-9354-e55f099e1820/volumes"
Jul 15 19:56:23.579050 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.579016    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"]
Jul 15 19:56:23.579532 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.579349    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy"
Jul 15 19:56:23.579532 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.579360    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy"
Jul 15 19:56:23.579532 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.579376    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy"
Jul 15 19:56:23.579532 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.579381    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f77ea42-5721-4ffb-9536-a3e7bf8f7c76" containerName="istio-proxy"
Jul 15 19:56:23.579532 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.579437    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy"
Jul 15 19:56:23.579532 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.579447    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy"
Jul 15 19:56:23.583638 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.583619    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.586288 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.586269    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-613f78-openshift-default-dockercfg-4rzt7\""
Jul 15 19:56:23.597029 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.597008    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"]
Jul 15 19:56:23.641540 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.641486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-socket\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.641714 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.641548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-credential-socket\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.641714 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.641613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-envoy\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.641714 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.641649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-data\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.641714 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.641689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-certs\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.641714 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.641710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46736754-ea1a-4bbc-b021-3528720a3962-istio-podinfo\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.641920 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.641736    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qsl5\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-kube-api-access-5qsl5\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.641920 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.641820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-istio-token\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.641920 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.641853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46736754-ea1a-4bbc-b021-3528720a3962-istiod-ca-cert\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.742874 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.742844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-istio-token\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743060 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.742884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46736754-ea1a-4bbc-b021-3528720a3962-istiod-ca-cert\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743060 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.742922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-socket\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743060 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.742952    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-credential-socket\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743060 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.742973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-envoy\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743060 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.742992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-data\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743060 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.743023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-certs\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743060 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.743048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46736754-ea1a-4bbc-b021-3528720a3962-istio-podinfo\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743436 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.743080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qsl5\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-kube-api-access-5qsl5\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743436 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.743397    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-socket\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743595 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.743528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-data\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743638 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.743590    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-certs\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743697 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.743679    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46736754-ea1a-4bbc-b021-3528720a3962-istiod-ca-cert\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.743737 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.743684    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-credential-socket\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.745426 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.745403    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-envoy\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.745673 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.745655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46736754-ea1a-4bbc-b021-3528720a3962-istio-podinfo\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.750840 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.750821    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-istio-token\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.750932 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.750882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qsl5\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-kube-api-access-5qsl5\") pod \"e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") " pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:23.830899 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.830802    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:56:23.893960 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:23.893924    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:24.029049 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:24.029020    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"]
Jul 15 19:56:24.030467 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:56:24.030444    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46736754_ea1a_4bbc_b021_3528720a3962.slice/crio-cd325eebde9216009b7b75438c87d7513750b70611612b48cc3f5a6083ba30e6 WatchSource:0}: Error finding container cd325eebde9216009b7b75438c87d7513750b70611612b48cc3f5a6083ba30e6: Status 404 returned error can't find the container with id cd325eebde9216009b7b75438c87d7513750b70611612b48cc3f5a6083ba30e6
Jul 15 19:56:24.032516 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:24.032468    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:24.032622 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:24.032559    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:24.032622 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:24.032602    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:24.533302 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:24.533251    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" event={"ID":"46736754-ea1a-4bbc-b021-3528720a3962","Type":"ContainerStarted","Data":"3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a"}
Jul 15 19:56:24.533529 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:24.533313    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" event={"ID":"46736754-ea1a-4bbc-b021-3528720a3962","Type":"ContainerStarted","Data":"cd325eebde9216009b7b75438c87d7513750b70611612b48cc3f5a6083ba30e6"}
Jul 15 19:56:24.555570 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:24.555521    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" podStartSLOduration=1.555506399 podStartE2EDuration="1.555506399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:24.555156868 +0000 UTC m=+2476.553135259" watchObservedRunningTime="2026-07-15 19:56:24.555506399 +0000 UTC m=+2476.553484765"
Jul 15 19:56:24.894839 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:24.894732    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:25.904852 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:25.904578    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:26.522841 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.522809    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"]
Jul 15 19:56:26.523235 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.523214    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy"
Jul 15 19:56:26.523235 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.523235    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf73393-0b92-40aa-9354-e55f099e1820" containerName="istio-proxy"
Jul 15 19:56:26.527019 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.526998    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:26.529847 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.529823    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-613f78-serving-cert\""
Jul 15 19:56:26.530009 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.529990    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5qhz\""
Jul 15 19:56:26.530128 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.530110    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 19:56:26.530360 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.530347    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:56:26.542256 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.542230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"]
Jul 15 19:56:26.543863 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.543839    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:26.544740 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.544722    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:26.570090 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.570055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac091379-06d9-4ad0-9a73-d0797006b472-openshift-service-ca\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:26.570237 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.570121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac091379-06d9-4ad0-9a73-d0797006b472-maas-api-tls\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:26.570237 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.570145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg8mb\" (UniqueName: \"kubernetes.io/projected/ac091379-06d9-4ad0-9a73-d0797006b472-kube-api-access-qg8mb\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:26.671478 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.671446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac091379-06d9-4ad0-9a73-d0797006b472-openshift-service-ca\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:26.671680 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.671517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac091379-06d9-4ad0-9a73-d0797006b472-maas-api-tls\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:26.671680 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.671542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg8mb\" (UniqueName: \"kubernetes.io/projected/ac091379-06d9-4ad0-9a73-d0797006b472-kube-api-access-qg8mb\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:26.671680 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:56:26.671630    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-serving-cert: secret "maas-api-e2e-shared-b-613f78-serving-cert" not found
Jul 15 19:56:26.671848 ip-10-0-134-72 kubenswrapper[2562]: E0715 19:56:26.671714    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac091379-06d9-4ad0-9a73-d0797006b472-maas-api-tls podName:ac091379-06d9-4ad0-9a73-d0797006b472 nodeName:}" failed. No retries permitted until 2026-07-15 19:56:27.171691956 +0000 UTC m=+2479.169670318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ac091379-06d9-4ad0-9a73-d0797006b472-maas-api-tls") pod "maas-api-e2e-shared-b-613f78-769998454-6zrzc" (UID: "ac091379-06d9-4ad0-9a73-d0797006b472") : secret "maas-api-e2e-shared-b-613f78-serving-cert" not found
Jul 15 19:56:26.672402 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.672383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac091379-06d9-4ad0-9a73-d0797006b472-openshift-service-ca\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:26.692523 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:26.683783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg8mb\" (UniqueName: \"kubernetes.io/projected/ac091379-06d9-4ad0-9a73-d0797006b472-kube-api-access-qg8mb\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:27.176410 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:27.176376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac091379-06d9-4ad0-9a73-d0797006b472-maas-api-tls\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:27.178742 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:27.178713    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac091379-06d9-4ad0-9a73-d0797006b472-maas-api-tls\") pod \"maas-api-e2e-shared-b-613f78-769998454-6zrzc\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:27.439756 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:27.439657    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:27.615779 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:27.614071    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"]
Jul 15 19:56:27.617603 ip-10-0-134-72 kubenswrapper[2562]: W0715 19:56:27.617574    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac091379_06d9_4ad0_9a73_d0797006b472.slice/crio-53a2760976919a33dc100b0629b03cc9dd925e90feae7af5e68dc049789c2b4c WatchSource:0}: Error finding container 53a2760976919a33dc100b0629b03cc9dd925e90feae7af5e68dc049789c2b4c: Status 404 returned error can't find the container with id 53a2760976919a33dc100b0629b03cc9dd925e90feae7af5e68dc049789c2b4c
Jul 15 19:56:28.557185 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:28.557153    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc" event={"ID":"ac091379-06d9-4ad0-9a73-d0797006b472","Type":"ContainerStarted","Data":"53a2760976919a33dc100b0629b03cc9dd925e90feae7af5e68dc049789c2b4c"}
Jul 15 19:56:29.564923 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:29.564874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc" event={"ID":"ac091379-06d9-4ad0-9a73-d0797006b472","Type":"ContainerStarted","Data":"4f62d737776c53fed3c6e965f610567b2330f7320a22533527041d68f53250f1"}
Jul 15 19:56:29.565364 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:29.564954    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:29.582287 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:29.582226    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc" podStartSLOduration=2.461806391 podStartE2EDuration="3.582209054s" totalImagesPullingTime="1.120402663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:56:29.581990356 +0000 UTC m=+2481.579968728" watchObservedRunningTime="2026-07-15 19:56:29.582209054 +0000 UTC m=+2481.580187428"
Jul 15 19:56:31.575757 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:31.575682    2562 generic.go:356] "Generic (PLEG): container finished" podID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerID="c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d" exitCode=0
Jul 15 19:56:31.575757 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:31.575754    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" event={"ID":"b379c9c1-9476-480e-8fc3-7be40c0b9eab","Type":"ContainerDied","Data":"c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d"}
Jul 15 19:56:31.576237 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:31.576126    2562 scope.go:117] "RemoveContainer" containerID="c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d"
Jul 15 19:56:31.577138 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:31.577091    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:31.577210 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:31.577170    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:31.577246 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:31.577212    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:32.490996 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:32.490959    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:32.582030 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:32.581999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" event={"ID":"b379c9c1-9476-480e-8fc3-7be40c0b9eab","Type":"ContainerStarted","Data":"a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057"}
Jul 15 19:56:32.646294 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:32.646263    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:56:33.486477 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:33.486436    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:33.486710 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:33.486612    2562 patch_prober.go:28] interesting pod/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 19:56:33.486710 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:33.486660    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 19:56:34.485611 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:34.485567    2562 patch_prober.go:28] interesting pod/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 19:56:34.486125 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:34.485651    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 19:56:35.486080 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:35.486034    2562 patch_prober.go:28] interesting pod/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 19:56:35.486593 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:35.486103    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 19:56:35.575697 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:35.575667    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 19:56:36.496542 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:36.496480    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:36.497664 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:36.497605    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:36.505906 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:36.505889    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 19:56:40.634382 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:40.634303    2562 generic.go:356] "Generic (PLEG): container finished" podID="46736754-ea1a-4bbc-b021-3528720a3962" containerID="3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a" exitCode=0
Jul 15 19:56:40.634908 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:40.634378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" event={"ID":"46736754-ea1a-4bbc-b021-3528720a3962","Type":"ContainerDied","Data":"3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a"}
Jul 15 19:56:40.634908 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:40.634853    2562 scope.go:117] "RemoveContainer" containerID="3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a"
Jul 15 19:56:40.635903 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:40.635878    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:40.635977 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:40.635961    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:40.636028 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:40.636002    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 15 19:56:41.544064 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:41.544034    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:41.644024 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:41.643991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" event={"ID":"46736754-ea1a-4bbc-b021-3528720a3962","Type":"ContainerStarted","Data":"c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430"}
Jul 15 19:56:41.895424 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:41.895325    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:41.896685 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:41.896657    2562 patch_prober.go:28] interesting pod/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 19:56:41.896946 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:41.896901    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 19:56:42.895043 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:42.894997    2562 patch_prober.go:28] interesting pod/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 19:56:42.895558 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:42.895065    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 19:56:43.894614 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:43.894571    2562 patch_prober.go:28] interesting pod/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 19:56:43.894819 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:43.894636    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 19:56:44.894760 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:44.894721    2562 patch_prober.go:28] interesting pod/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 19:56:44.895385 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:44.895350    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 19:56:45.898352 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:45.898323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:45.898742 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:45.898688    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:45.899264 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:45.899245    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 19:56:46.635621 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:56:46.635590    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:57:04.532594 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:57:04.532512    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:57:22.142404 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:57:22.142369    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:57:40.731906 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:57:40.731865    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:57:56.236084 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:57:56.236044    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:58:15.485716 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:58:15.485676    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:58:34.033919 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:58:34.033821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:58:53.226735 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:58:53.226701    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:59:12.034173 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:59:12.034132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:59:26.330247 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:59:26.330197    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 19:59:47.735896 ip-10-0-134-72 kubenswrapper[2562]: I0715 19:59:47.735862    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:00:01.941265 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:00:01.941177    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:00:08.692086 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:00:08.692058    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 20:00:08.695750 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:00:08.695730    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dphc6_8be7a5a6-f751-4ccb-a4ca-8cf3f0d95d57/ovn-acl-logging/0.log"
Jul 15 20:00:23.129021 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:00:23.128986    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:00:42.132804 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:00:42.132755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:01:01.935979 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:01:01.935941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:01:30.639421 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:01:30.639384    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:01:45.429806 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:01:45.429760    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:02:02.437543 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:02.437501    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:02:25.831238 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:25.831203    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:02:33.465014 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:33.464973    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"]
Jul 15 20:02:33.465677 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:33.465203    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerName="istio-proxy" containerID="cri-o://a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057" gracePeriod=30
Jul 15 20:02:36.499757 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:36.499724    2562 patch_prober.go:28] interesting pod/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 20:02:36.500167 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:36.499775    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 20:02:38.717292 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.717270    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 20:02:38.819214 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819186    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfq7x\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-kube-api-access-jfq7x\") pod \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") "
Jul 15 20:02:38.819440 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819220    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-token\") pod \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") "
Jul 15 20:02:38.819440 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819244    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-socket\") pod \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") "
Jul 15 20:02:38.819595 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istiod-ca-cert\") pod \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") "
Jul 15 20:02:38.819595 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819506    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-credential-socket\") pod \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") "
Jul 15 20:02:38.819595 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819535    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-data\") pod \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") "
Jul 15 20:02:38.819595 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819571    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-podinfo\") pod \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") "
Jul 15 20:02:38.819795 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819608    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-envoy\") pod \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") "
Jul 15 20:02:38.819795 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819529    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b379c9c1-9476-480e-8fc3-7be40c0b9eab" (UID: "b379c9c1-9476-480e-8fc3-7be40c0b9eab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:38.819795 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819752    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b379c9c1-9476-480e-8fc3-7be40c0b9eab" (UID: "b379c9c1-9476-480e-8fc3-7be40c0b9eab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:38.819951 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819832    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b379c9c1-9476-480e-8fc3-7be40c0b9eab" (UID: "b379c9c1-9476-480e-8fc3-7be40c0b9eab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:02:38.820021 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.819965    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-certs\") pod \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\" (UID: \"b379c9c1-9476-480e-8fc3-7be40c0b9eab\") "
Jul 15 20:02:38.820365 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.820316    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b379c9c1-9476-480e-8fc3-7be40c0b9eab" (UID: "b379c9c1-9476-480e-8fc3-7be40c0b9eab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:38.820365 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.820325    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-data" (OuterVolumeSpecName: "istio-data") pod "b379c9c1-9476-480e-8fc3-7be40c0b9eab" (UID: "b379c9c1-9476-480e-8fc3-7be40c0b9eab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:38.820939 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.820902    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:38.820939 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.820930    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istiod-ca-cert\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:38.821102 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.820944    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-credential-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:38.821102 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.820958    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-data\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:38.821102 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.820970    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-workload-certs\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:38.821757 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.821728    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-token" (OuterVolumeSpecName: "istio-token") pod "b379c9c1-9476-480e-8fc3-7be40c0b9eab" (UID: "b379c9c1-9476-480e-8fc3-7be40c0b9eab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:02:38.821850 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.821757    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-kube-api-access-jfq7x" (OuterVolumeSpecName: "kube-api-access-jfq7x") pod "b379c9c1-9476-480e-8fc3-7be40c0b9eab" (UID: "b379c9c1-9476-480e-8fc3-7be40c0b9eab"). InnerVolumeSpecName "kube-api-access-jfq7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:02:38.822028 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.822009    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b379c9c1-9476-480e-8fc3-7be40c0b9eab" (UID: "b379c9c1-9476-480e-8fc3-7be40c0b9eab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 20:02:38.822093 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.822020    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b379c9c1-9476-480e-8fc3-7be40c0b9eab" (UID: "b379c9c1-9476-480e-8fc3-7be40c0b9eab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:02:38.921651 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.921629    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-podinfo\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:38.921651 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.921649    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-envoy\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:38.921768 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.921658    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfq7x\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-kube-api-access-jfq7x\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:38.921768 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:38.921667    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b379c9c1-9476-480e-8fc3-7be40c0b9eab-istio-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:39.481007 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.480975    2562 generic.go:356] "Generic (PLEG): container finished" podID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerID="a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057" exitCode=0
Jul 15 20:02:39.481131 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.481031    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"
Jul 15 20:02:39.481131 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.481066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" event={"ID":"b379c9c1-9476-480e-8fc3-7be40c0b9eab","Type":"ContainerDied","Data":"a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057"}
Jul 15 20:02:39.481131 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.481129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt" event={"ID":"b379c9c1-9476-480e-8fc3-7be40c0b9eab","Type":"ContainerDied","Data":"6e23dc4ba86a151f3ea32dc1f237709538f44645c0a6d5caa7206a3e10991f37"}
Jul 15 20:02:39.481240 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.481154    2562 scope.go:117] "RemoveContainer" containerID="a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057"
Jul 15 20:02:39.491089 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.491070    2562 scope.go:117] "RemoveContainer" containerID="c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d"
Jul 15 20:02:39.499262 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.499236    2562 scope.go:117] "RemoveContainer" containerID="a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057"
Jul 15 20:02:39.499558 ip-10-0-134-72 kubenswrapper[2562]: E0715 20:02:39.499537    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057\": container with ID starting with a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057 not found: ID does not exist" containerID="a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057"
Jul 15 20:02:39.499647 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.499570    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057"} err="failed to get container status \"a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057\": rpc error: code = NotFound desc = could not find container \"a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057\": container with ID starting with a889ace0544eab461446e224023b6aac2db00fe7db36c73b508e6b3bca3f7057 not found: ID does not exist"
Jul 15 20:02:39.499647 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.499599    2562 scope.go:117] "RemoveContainer" containerID="c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d"
Jul 15 20:02:39.499879 ip-10-0-134-72 kubenswrapper[2562]: E0715 20:02:39.499860    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d\": container with ID starting with c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d not found: ID does not exist" containerID="c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d"
Jul 15 20:02:39.499930 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.499885    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d"} err="failed to get container status \"c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d\": rpc error: code = NotFound desc = could not find container \"c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d\": container with ID starting with c320478a71c0dac0ac7360354b5ff8573e30e228a464cd7051dd331348c7fb8d not found: ID does not exist"
Jul 15 20:02:39.502853 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.502829    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"]
Jul 15 20:02:39.507986 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:39.507966    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e8718e-openshift-default-7b558c7d59-4xzkt"]
Jul 15 20:02:40.565597 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:40.565570    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" path="/var/lib/kubelet/pods/b379c9c1-9476-480e-8fc3-7be40c0b9eab/volumes"
Jul 15 20:02:44.353136 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.353098    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"]
Jul 15 20:02:44.353640 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.353331    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc" podUID="ac091379-06d9-4ad0-9a73-d0797006b472" containerName="maas-api" containerID="cri-o://4f62d737776c53fed3c6e965f610567b2330f7320a22533527041d68f53250f1" gracePeriod=30
Jul 15 20:02:44.511230 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.511200    2562 generic.go:356] "Generic (PLEG): container finished" podID="ac091379-06d9-4ad0-9a73-d0797006b472" containerID="4f62d737776c53fed3c6e965f610567b2330f7320a22533527041d68f53250f1" exitCode=0
Jul 15 20:02:44.511375 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.511268    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc" event={"ID":"ac091379-06d9-4ad0-9a73-d0797006b472","Type":"ContainerDied","Data":"4f62d737776c53fed3c6e965f610567b2330f7320a22533527041d68f53250f1"}
Jul 15 20:02:44.605910 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.605854    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 20:02:44.671370 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.671348    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac091379-06d9-4ad0-9a73-d0797006b472-openshift-service-ca\") pod \"ac091379-06d9-4ad0-9a73-d0797006b472\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") "
Jul 15 20:02:44.671482 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.671396    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac091379-06d9-4ad0-9a73-d0797006b472-maas-api-tls\") pod \"ac091379-06d9-4ad0-9a73-d0797006b472\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") "
Jul 15 20:02:44.671482 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.671433    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg8mb\" (UniqueName: \"kubernetes.io/projected/ac091379-06d9-4ad0-9a73-d0797006b472-kube-api-access-qg8mb\") pod \"ac091379-06d9-4ad0-9a73-d0797006b472\" (UID: \"ac091379-06d9-4ad0-9a73-d0797006b472\") "
Jul 15 20:02:44.671688 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.671669    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac091379-06d9-4ad0-9a73-d0797006b472-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac091379-06d9-4ad0-9a73-d0797006b472" (UID: "ac091379-06d9-4ad0-9a73-d0797006b472"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:02:44.673389 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.673365    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac091379-06d9-4ad0-9a73-d0797006b472-kube-api-access-qg8mb" (OuterVolumeSpecName: "kube-api-access-qg8mb") pod "ac091379-06d9-4ad0-9a73-d0797006b472" (UID: "ac091379-06d9-4ad0-9a73-d0797006b472"). InnerVolumeSpecName "kube-api-access-qg8mb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:02:44.673476 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.673393    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac091379-06d9-4ad0-9a73-d0797006b472-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac091379-06d9-4ad0-9a73-d0797006b472" (UID: "ac091379-06d9-4ad0-9a73-d0797006b472"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:02:44.772003 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.771984    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg8mb\" (UniqueName: \"kubernetes.io/projected/ac091379-06d9-4ad0-9a73-d0797006b472-kube-api-access-qg8mb\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:44.772003 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.772003    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac091379-06d9-4ad0-9a73-d0797006b472-openshift-service-ca\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:44.772129 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:44.772014    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac091379-06d9-4ad0-9a73-d0797006b472-maas-api-tls\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:02:45.519279 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:45.519250    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"
Jul 15 20:02:45.519674 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:45.519292    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc" event={"ID":"ac091379-06d9-4ad0-9a73-d0797006b472","Type":"ContainerDied","Data":"53a2760976919a33dc100b0629b03cc9dd925e90feae7af5e68dc049789c2b4c"}
Jul 15 20:02:45.519674 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:45.519363    2562 scope.go:117] "RemoveContainer" containerID="4f62d737776c53fed3c6e965f610567b2330f7320a22533527041d68f53250f1"
Jul 15 20:02:45.541167 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:45.541142    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"]
Jul 15 20:02:45.545241 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:45.545218    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-613f78-769998454-6zrzc"]
Jul 15 20:02:46.570378 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:46.570346    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac091379-06d9-4ad0-9a73-d0797006b472" path="/var/lib/kubelet/pods/ac091379-06d9-4ad0-9a73-d0797006b472/volumes"
Jul 15 20:02:47.337844 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:47.337811    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkw2d"]
Jul 15 20:02:55.730385 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:55.730342    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"]
Jul 15 20:02:55.730847 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:02:55.730597    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy" containerID="cri-o://c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430" gracePeriod=30
Jul 15 20:03:00.986585 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:00.986564    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 20:03:01.092672 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.092584    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-istio-token\") pod \"46736754-ea1a-4bbc-b021-3528720a3962\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") "
Jul 15 20:03:01.092672 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.092625    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46736754-ea1a-4bbc-b021-3528720a3962-istio-podinfo\") pod \"46736754-ea1a-4bbc-b021-3528720a3962\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") "
Jul 15 20:03:01.092672 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.092658    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46736754-ea1a-4bbc-b021-3528720a3962-istiod-ca-cert\") pod \"46736754-ea1a-4bbc-b021-3528720a3962\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") "
Jul 15 20:03:01.092908 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.092718    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-certs\") pod \"46736754-ea1a-4bbc-b021-3528720a3962\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") "
Jul 15 20:03:01.092908 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.092751    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-envoy\") pod \"46736754-ea1a-4bbc-b021-3528720a3962\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") "
Jul 15 20:03:01.092908 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.092791    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-credential-socket\") pod \"46736754-ea1a-4bbc-b021-3528720a3962\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") "
Jul 15 20:03:01.092908 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.092826    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-data\") pod \"46736754-ea1a-4bbc-b021-3528720a3962\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") "
Jul 15 20:03:01.092908 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.092854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qsl5\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-kube-api-access-5qsl5\") pod \"46736754-ea1a-4bbc-b021-3528720a3962\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") "
Jul 15 20:03:01.093142 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.092906    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-socket\") pod \"46736754-ea1a-4bbc-b021-3528720a3962\" (UID: \"46736754-ea1a-4bbc-b021-3528720a3962\") "
Jul 15 20:03:01.093142 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.093061    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "46736754-ea1a-4bbc-b021-3528720a3962" (UID: "46736754-ea1a-4bbc-b021-3528720a3962"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:03:01.093254 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.093242    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-certs\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:03:01.093308 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.093164    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46736754-ea1a-4bbc-b021-3528720a3962-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "46736754-ea1a-4bbc-b021-3528720a3962" (UID: "46736754-ea1a-4bbc-b021-3528720a3962"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:03:01.093369 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.093310    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "46736754-ea1a-4bbc-b021-3528720a3962" (UID: "46736754-ea1a-4bbc-b021-3528720a3962"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:03:01.093652 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.093620    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "46736754-ea1a-4bbc-b021-3528720a3962" (UID: "46736754-ea1a-4bbc-b021-3528720a3962"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:03:01.093892 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.093863    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-data" (OuterVolumeSpecName: "istio-data") pod "46736754-ea1a-4bbc-b021-3528720a3962" (UID: "46736754-ea1a-4bbc-b021-3528720a3962"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:03:01.094931 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.094905    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46736754-ea1a-4bbc-b021-3528720a3962-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "46736754-ea1a-4bbc-b021-3528720a3962" (UID: "46736754-ea1a-4bbc-b021-3528720a3962"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 20:03:01.095030 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.094905    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "46736754-ea1a-4bbc-b021-3528720a3962" (UID: "46736754-ea1a-4bbc-b021-3528720a3962"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:03:01.095030 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.094983    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-istio-token" (OuterVolumeSpecName: "istio-token") pod "46736754-ea1a-4bbc-b021-3528720a3962" (UID: "46736754-ea1a-4bbc-b021-3528720a3962"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:03:01.095100 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.095076    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-kube-api-access-5qsl5" (OuterVolumeSpecName: "kube-api-access-5qsl5") pod "46736754-ea1a-4bbc-b021-3528720a3962" (UID: "46736754-ea1a-4bbc-b021-3528720a3962"). InnerVolumeSpecName "kube-api-access-5qsl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:03:01.193829 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.193797    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-envoy\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:03:01.193933 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.193840    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-credential-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:03:01.193933 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.193852    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-istio-data\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:03:01.193933 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.193861    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qsl5\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-kube-api-access-5qsl5\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:03:01.193933 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.193869    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46736754-ea1a-4bbc-b021-3528720a3962-workload-socket\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:03:01.193933 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.193878    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46736754-ea1a-4bbc-b021-3528720a3962-istio-token\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:03:01.193933 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.193885    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46736754-ea1a-4bbc-b021-3528720a3962-istio-podinfo\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:03:01.193933 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.193893    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46736754-ea1a-4bbc-b021-3528720a3962-istiod-ca-cert\") on node \"ip-10-0-134-72.ec2.internal\" DevicePath \"\""
Jul 15 20:03:01.602137 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.602112    2562 generic.go:356] "Generic (PLEG): container finished" podID="46736754-ea1a-4bbc-b021-3528720a3962" containerID="c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430" exitCode=0
Jul 15 20:03:01.602293 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.602169    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"
Jul 15 20:03:01.602293 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.602184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" event={"ID":"46736754-ea1a-4bbc-b021-3528720a3962","Type":"ContainerDied","Data":"c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430"}
Jul 15 20:03:01.602293 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.602228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" event={"ID":"46736754-ea1a-4bbc-b021-3528720a3962","Type":"ContainerDied","Data":"cd325eebde9216009b7b75438c87d7513750b70611612b48cc3f5a6083ba30e6"}
Jul 15 20:03:01.602293 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.602249    2562 scope.go:117] "RemoveContainer" containerID="c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430"
Jul 15 20:03:01.616963 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.616944    2562 scope.go:117] "RemoveContainer" containerID="3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a"
Jul 15 20:03:01.625231 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.625214    2562 scope.go:117] "RemoveContainer" containerID="c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430"
Jul 15 20:03:01.625471 ip-10-0-134-72 kubenswrapper[2562]: E0715 20:03:01.625453    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430\": container with ID starting with c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430 not found: ID does not exist" containerID="c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430"
Jul 15 20:03:01.625562 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.625478    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430"} err="failed to get container status \"c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430\": rpc error: code = NotFound desc = could not find container \"c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430\": container with ID starting with c707b2e03210d9ab9002578100f992a49a07f06105494d21c0af25c3eb9b2430 not found: ID does not exist"
Jul 15 20:03:01.625562 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.625519    2562 scope.go:117] "RemoveContainer" containerID="3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a"
Jul 15 20:03:01.625825 ip-10-0-134-72 kubenswrapper[2562]: E0715 20:03:01.625798    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a\": container with ID starting with 3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a not found: ID does not exist" containerID="3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a"
Jul 15 20:03:01.625866 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.625836    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a"} err="failed to get container status \"3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a\": rpc error: code = NotFound desc = could not find container \"3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a\": container with ID starting with 3865f4e21a74cda4909ba6acc02843cec1a35167230f6eb1d8fa299fcce74b7a not found: ID does not exist"
Jul 15 20:03:01.627146 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.627126    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"]
Jul 15 20:03:01.631033 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.631008    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr"]
Jul 15 20:03:01.900356 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.900293    2562 patch_prober.go:28] interesting pod/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 20:03:01.900456 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:01.900383    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-613f78-openshift-default-f8f8b6f67-885dr" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 20:03:02.129629 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:02.129609    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-flpqq_4d0a4ec3-9548-4f61-ac18-79b1a5312cd2/manager/0.log"
Jul 15 20:03:02.563859 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:02.563831    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46736754-ea1a-4bbc-b021-3528720a3962" path="/var/lib/kubelet/pods/46736754-ea1a-4bbc-b021-3528720a3962/volumes"
Jul 15 20:03:03.055774 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:03.055752    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f46f5478c-zcs9p_d34de05b-2014-4342-b525-abf85f3e79ef/copy-manifests/0.log"
Jul 15 20:03:03.062879 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:03.062857    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f46f5478c-zcs9p_d34de05b-2014-4342-b525-abf85f3e79ef/manager/0.log"
Jul 15 20:03:03.557735 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:03.557708    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735730-q9qdb_f260cd56-6f13-459f-a984-af776e8bd2fc/cleanup/0.log"
Jul 15 20:03:03.675167 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:03.675148    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735745-krxt7_4adb0fd3-dcf8-4313-b643-d6d430634abb/cleanup/0.log"
Jul 15 20:03:03.909398 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:03.909349    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-a0aec9a3-gkvs5_5014bfd5-20bd-4cd0-9af2-e1175705f7de/revoke-keys/0.log"
Jul 15 20:03:04.025144 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:04.025116    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-daf69041-vf9jt_f52208a7-141f-4d4c-8ab0-c21b9e52dc80/revoke-keys/0.log"
Jul 15 20:03:04.366622 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:04.366601    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-1ebae1b1-9rqxm_ab94108b-582b-4211-b4ac-4fc41e01fbba/revoke-keys/0.log"
Jul 15 20:03:04.722544 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:04.722464    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-5827a521-d7tpx_4bbd0f03-f907-4745-bcf0-58813aa463a5/revoke-keys/0.log"
Jul 15 20:03:04.834998 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:04.834977    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-80adc0ad-9g9zz_105a05b4-dc89-4012-a4d0-0b3c471f8194/revoke-keys/0.log"
Jul 15 20:03:06.788110 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:06.788078    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8gmc2_a82ee433-edfe-430b-bb69-5ef9e55d4d2e/manager/0.log"
Jul 15 20:03:07.409326 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:07.409296    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dkw2d_2d591032-334a-4165-94a0-fc652f64bb14/limitador/0.log"
Jul 15 20:03:08.033795 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:08.033765    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-95klg_1249d79e-708c-4a3b-903d-d9a7212a3e76/discovery/0.log"
Jul 15 20:03:08.255754 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:08.255725    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59b767f7ff-n8wnj_5ccc4f81-db96-4ffd-8a75-03948e010221/kube-auth-proxy/0.log"
Jul 15 20:03:08.763575 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:08.763554    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b89bdf754-j46cg_b51a70e3-c9da-425a-a02a-06d875456490/router/0.log"
Jul 15 20:03:18.223358 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:18.223321    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5k58n_bc231b65-f3b6-4d93-86f3-127b91e5003b/global-pull-secret-syncer/0.log"
Jul 15 20:03:18.432541 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:18.432482    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tjhzf_938e07d9-46e2-43c5-b069-c0181a9e71a6/konnectivity-agent/0.log"
Jul 15 20:03:18.515839 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:18.515813    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-72.ec2.internal_223fad97d4fefa131d98c624d5275eb6/haproxy/0.log"
Jul 15 20:03:23.619007 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:23.618974    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8gmc2_a82ee433-edfe-430b-bb69-5ef9e55d4d2e/manager/0.log"
Jul 15 20:03:23.992592 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:23.992567    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dkw2d_2d591032-334a-4165-94a0-fc652f64bb14/limitador/0.log"
Jul 15 20:03:25.886771 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:25.886746    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-fdkmm_bca73b7e-e2ec-48fd-aaee-5fa5d2ab3280/cluster-monitoring-operator/0.log"
Jul 15 20:03:26.261728 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:26.261708    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v57kj_72ceca93-26fb-4030-a6c5-f06f11fe987e/node-exporter/0.log"
Jul 15 20:03:26.288104 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:26.288083    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v57kj_72ceca93-26fb-4030-a6c5-f06f11fe987e/kube-rbac-proxy/0.log"
Jul 15 20:03:26.308028 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:26.308001    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v57kj_72ceca93-26fb-4030-a6c5-f06f11fe987e/init-textfile/0.log"
Jul 15 20:03:27.992215 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:27.992178    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-zjhqb_6afbfb61-4e3b-4be6-af71-07deeefb81e9/networking-console-plugin/0.log"
Jul 15 20:03:28.095652 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.095616    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"]
Jul 15 20:03:28.096647 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.096620    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerName="istio-proxy"
Jul 15 20:03:28.096844 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.096831    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerName="istio-proxy"
Jul 15 20:03:28.096933 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.096923    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy"
Jul 15 20:03:28.097000 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.096992    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy"
Jul 15 20:03:28.097082 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.097072    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac091379-06d9-4ad0-9a73-d0797006b472" containerName="maas-api"
Jul 15 20:03:28.097160 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.097152    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac091379-06d9-4ad0-9a73-d0797006b472" containerName="maas-api"
Jul 15 20:03:28.097284 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.097276    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy"
Jul 15 20:03:28.097352 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.097344    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy"
Jul 15 20:03:28.097632 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.097616    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac091379-06d9-4ad0-9a73-d0797006b472" containerName="maas-api"
Jul 15 20:03:28.098132 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.098098    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerName="istio-proxy"
Jul 15 20:03:28.098257 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.098246    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy"
Jul 15 20:03:28.098346 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.098338    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b379c9c1-9476-480e-8fc3-7be40c0b9eab" containerName="istio-proxy"
Jul 15 20:03:28.098420 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.098411    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="46736754-ea1a-4bbc-b021-3528720a3962" containerName="istio-proxy"
Jul 15 20:03:28.102302 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.102279    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.104528 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.104502    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"]
Jul 15 20:03:28.105241 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.105221    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pp6mc\"/\"kube-root-ca.crt\""
Jul 15 20:03:28.106410 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.106383    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pp6mc\"/\"openshift-service-ca.crt\""
Jul 15 20:03:28.106545 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.106426    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pp6mc\"/\"default-dockercfg-z9m9k\""
Jul 15 20:03:28.192466 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.192443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-podres\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.192584 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.192471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvqz7\" (UniqueName: \"kubernetes.io/projected/7ca20b90-3398-43ef-9693-e75c1101e5a3-kube-api-access-bvqz7\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.192584 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.192515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-lib-modules\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.192584 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.192555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-sys\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.192695 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.192598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-proc\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.293786 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.293711    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-proc\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.293786 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.293767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-podres\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.293786 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.293791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvqz7\" (UniqueName: \"kubernetes.io/projected/7ca20b90-3398-43ef-9693-e75c1101e5a3-kube-api-access-bvqz7\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.293949 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.293808    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-lib-modules\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.293949 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.293838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-sys\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.293949 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.293838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-proc\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.294058 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.293976    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-sys\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.294102 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.294079    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-podres\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.294102 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.294089    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ca20b90-3398-43ef-9693-e75c1101e5a3-lib-modules\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.302219 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.302191    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvqz7\" (UniqueName: \"kubernetes.io/projected/7ca20b90-3398-43ef-9693-e75c1101e5a3-kube-api-access-bvqz7\") pod \"perf-node-gather-daemonset-84cl7\" (UID: \"7ca20b90-3398-43ef-9693-e75c1101e5a3\") " pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.413602 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.413577    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.547139 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.547117    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"]
Jul 15 20:03:28.549063 ip-10-0-134-72 kubenswrapper[2562]: W0715 20:03:28.549036    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ca20b90_3398_43ef_9693_e75c1101e5a3.slice/crio-eff9223e5615c52b5ed97d3ffd386c265faddab0a7c91be3118687abeb328fab WatchSource:0}: Error finding container eff9223e5615c52b5ed97d3ffd386c265faddab0a7c91be3118687abeb328fab: Status 404 returned error can't find the container with id eff9223e5615c52b5ed97d3ffd386c265faddab0a7c91be3118687abeb328fab
Jul 15 20:03:28.686658 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.686635    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qkjjm_060df79a-00dd-4e6d-95ee-1d308717c125/console-operator/0.log"
Jul 15 20:03:28.744631 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.744605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7" event={"ID":"7ca20b90-3398-43ef-9693-e75c1101e5a3","Type":"ContainerStarted","Data":"23cc3a4e12d677370811d1be891069f3550c9983069e7f4540cdf89de4168298"}
Jul 15 20:03:28.744728 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.744646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7" event={"ID":"7ca20b90-3398-43ef-9693-e75c1101e5a3","Type":"ContainerStarted","Data":"eff9223e5615c52b5ed97d3ffd386c265faddab0a7c91be3118687abeb328fab"}
Jul 15 20:03:28.744728 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.744713    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:28.763092 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:28.763051    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7" podStartSLOduration=0.763038947 podStartE2EDuration="763.038947ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:03:28.761334161 +0000 UTC m=+2900.759312533" watchObservedRunningTime="2026-07-15 20:03:28.763038947 +0000 UTC m=+2900.761017318"
Jul 15 20:03:29.880605 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:29.880575    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-b7rnm_90013186-895d-441d-996a-233fccde0e33/volume-data-source-validator/0.log"
Jul 15 20:03:30.877953 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:30.877921    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-92kfp_2167e746-a49c-46e0-ab9c-0df48d88bb21/dns/0.log"
Jul 15 20:03:30.903674 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:30.903650    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-92kfp_2167e746-a49c-46e0-ab9c-0df48d88bb21/kube-rbac-proxy/0.log"
Jul 15 20:03:31.080339 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:31.080313    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v7qfz_52fd42a8-1494-43e0-8693-9c73114574c5/dns-node-resolver/0.log"
Jul 15 20:03:31.616488 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:31.616461    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b67c88554-rwkts_5fb27c73-f28d-4211-9526-8b8c8f212878/registry/0.log"
Jul 15 20:03:31.646914 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:31.646892    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jndfh_795aeb1d-df26-44c4-ad4c-412575e35202/node-ca/0.log"
Jul 15 20:03:32.747639 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:32.747612    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-95klg_1249d79e-708c-4a3b-903d-d9a7212a3e76/discovery/0.log"
Jul 15 20:03:32.804742 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:32.804716    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59b767f7ff-n8wnj_5ccc4f81-db96-4ffd-8a75-03948e010221/kube-auth-proxy/0.log"
Jul 15 20:03:33.001012 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:33.000946    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b89bdf754-j46cg_b51a70e3-c9da-425a-a02a-06d875456490/router/0.log"
Jul 15 20:03:33.702558 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:33.702533    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qdgrw_98c6faa3-dd7d-4b59-85e8-4c37f32454d1/serve-healthcheck-canary/0.log"
Jul 15 20:03:34.165905 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:34.165868    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-8vnwb_b170f5ff-c899-4db4-bbb0-a4e06a1c431d/insights-operator/0.log"
Jul 15 20:03:34.267530 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:34.267482    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9l5c_3ff45dc3-6024-4360-aebe-caaa349943d0/kube-rbac-proxy/0.log"
Jul 15 20:03:34.290828 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:34.290808    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9l5c_3ff45dc3-6024-4360-aebe-caaa349943d0/exporter/0.log"
Jul 15 20:03:34.318962 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:34.318923    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9l5c_3ff45dc3-6024-4360-aebe-caaa349943d0/extractor/0.log"
Jul 15 20:03:34.760431 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:34.760408    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pp6mc/perf-node-gather-daemonset-84cl7"
Jul 15 20:03:36.736708 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:36.736682    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-flpqq_4d0a4ec3-9548-4f61-ac18-79b1a5312cd2/manager/0.log"
Jul 15 20:03:37.633512 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:37.633469    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f46f5478c-zcs9p_d34de05b-2014-4342-b525-abf85f3e79ef/manager/0.log"
Jul 15 20:03:37.659078 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:37.659058    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f46f5478c-zcs9p_d34de05b-2014-4342-b525-abf85f3e79ef/copy-manifests/0.log"
Jul 15 20:03:38.749588 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:38.749556    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-95klg_1249d79e-708c-4a3b-903d-d9a7212a3e76/discovery/0.log"
Jul 15 20:03:38.785488 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:38.785467    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59b767f7ff-n8wnj_5ccc4f81-db96-4ffd-8a75-03948e010221/kube-auth-proxy/0.log"
Jul 15 20:03:38.944037 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:38.944012    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b89bdf754-j46cg_b51a70e3-c9da-425a-a02a-06d875456490/router/0.log"
Jul 15 20:03:40.333214 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:40.333186    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-95klg_1249d79e-708c-4a3b-903d-d9a7212a3e76/discovery/0.log"
Jul 15 20:03:40.371796 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:40.371772    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59b767f7ff-n8wnj_5ccc4f81-db96-4ffd-8a75-03948e010221/kube-auth-proxy/0.log"
Jul 15 20:03:40.527703 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:40.527669    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b89bdf754-j46cg_b51a70e3-c9da-425a-a02a-06d875456490/router/0.log"
Jul 15 20:03:43.980952 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:43.980924    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-68r4s_6cb5665a-95f8-4d91-9a11-7cb8a62fff51/migrator/0.log"
Jul 15 20:03:44.011032 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:44.011006    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-68r4s_6cb5665a-95f8-4d91-9a11-7cb8a62fff51/graceful-termination/0.log"
Jul 15 20:03:44.409478 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:44.409450    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-87kpb_c22bacc0-0044-419e-bbd4-0ede3a29e34f/kube-storage-version-migrator-operator/1.log"
Jul 15 20:03:44.410249 ip-10-0-134-72 kubenswrapper[2562]: I0715 20:03:44.410230    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-87kpb_c22bacc0-0044-419e-bbd4-0ede3a29e34f/kube-storage-version-migrator-operator/0.log"