Jul 29 03:53:18.130895 ip-10-0-132-42 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 03:53:18.130905 ip-10-0-132-42 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 03:53:18.130912 ip-10-0-132-42 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 03:53:18.131158 ip-10-0-132-42 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 03:53:28.317021 ip-10-0-132-42 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 03:53:28.317040 ip-10-0-132-42 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5b67d357ecd742fd9c5a14dffcbb5218 --
Jul 29 03:55:19.309826 ip-10-0-132-42 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 03:55:19.619551 ip-10-0-132-42 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 03:55:19.619551 ip-10-0-132-42 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 03:55:19.619551 ip-10-0-132-42 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 03:55:19.619551 ip-10-0-132-42 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 03:55:19.619551 ip-10-0-132-42 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 03:55:19.620934 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.620845    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 03:55:19.625550 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625533    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 03:55:19.625550 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625551    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625555    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625558    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625562    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625565    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625567    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625572    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625575    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625579    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625582    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625595    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625598    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625601    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625604    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625607    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625609    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625611    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625614    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625617    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 03:55:19.625612 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625620    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625624    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625628    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625630    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625633    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625636    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625639    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625641    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625644    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625646    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625649    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625651    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625653    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625656    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625658    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625661    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625663    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625666    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625668    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 03:55:19.626058 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625672    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625675    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625677    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625679    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625682    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625685    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625687    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625695    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625697    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625700    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625702    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625705    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625707    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625710    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625712    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625715    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625718    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625720    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625723    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 03:55:19.626534 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625725    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625728    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625730    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625733    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625736    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625739    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625741    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625744    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625746    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625750    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625753    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625755    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625758    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625761    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625763    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625766    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625768    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625771    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625773    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 03:55:19.627001 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625777    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625779    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625781    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625784    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625787    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625790    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625792    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625796    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625798    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625801    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625804    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625806    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625808    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625811    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625813    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625816    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625818    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625821    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625824    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625826    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 03:55:19.627459 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625829    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.625831    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626530    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626538    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626541    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626544    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626548    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626551    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626554    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626556    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626559    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626562    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626564    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626567    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626570    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626573    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626576    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626578    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626583    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626586    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 03:55:19.627958 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626589    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626592    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626595    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626598    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626600    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626603    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626606    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626608    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626611    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626614    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626616    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626619    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626621    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626624    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626627    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626630    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626632    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626635    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626638    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626641    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 03:55:19.628506 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626643    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626646    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626649    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626651    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626654    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626656    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626659    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626662    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626665    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626667    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626669    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626672    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626675    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626677    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626681    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626685    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626687    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626690    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626693    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 03:55:19.628990 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626696    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626699    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626701    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626704    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626707    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626710    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626713    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626716    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626718    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626721    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626723    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626727    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626730    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626732    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626735    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626737    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626740    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626742    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626745    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 03:55:19.629439 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626748    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626751    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626754    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626756    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626759    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626762    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626764    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626767    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626770    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626774    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626777    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626780    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626782    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626785    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626788    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626790    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626794    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626797    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626799    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 03:55:19.629917 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626802    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626804    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626807    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.626810    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627662    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627669    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627672    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627675    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627678    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627681    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627684    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627687    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627690    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627692    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627696    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627700    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627702    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627705    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627708    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627710    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 03:55:19.630376 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627713    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627716    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627718    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627721    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627725    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627728    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627731    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627733    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627736    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627739    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627741    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627744    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627746    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627749    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627752    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627755    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627757    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627760    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627763    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627772    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 03:55:19.630941 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627777    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627780    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627783    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627785    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627788    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627790    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627793    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627796    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627799    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627801    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627804    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627806    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627809    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627811    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627814    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627816    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627819    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627821    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627824    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627826    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 03:55:19.631433 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627829    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627831    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627833    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627836    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627838    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627841    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627843    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627846    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627848    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627851    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627854    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627856    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627859    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627861    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627864    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627866    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627868    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627871    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627873    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627875    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 03:55:19.631952 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627878    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627881    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627883    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627887    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627889    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627891    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627894    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627896    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627898    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627901    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627903    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627905    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627908    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627910    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627912    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627915    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627919    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627922    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627925    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 03:55:19.632461 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627929    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627932    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627937    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.627940    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628008    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628015    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628022    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628026    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628030    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628033    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628037    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628041    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628045    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628047    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628052    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628055    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628058    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628060    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628063    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628066    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628069    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628072    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628076    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628079    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 03:55:19.632999 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628082    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628085    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628088    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628092    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628095    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628098    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628102    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628105    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628108    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628112    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628117    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628120    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628124    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628127    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628130    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628133    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628136    2573 flags.go:64] FLAG: --enable-server="true"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628139    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628143    2573 flags.go:64] FLAG: --event-burst="100"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628147    2573 flags.go:64] FLAG: --event-qps="50"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628149    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628152    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628156    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628160    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 03:55:19.633604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628163    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628166    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628169    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628172    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628175    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628178    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628181    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628184    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628187    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628189    2573 flags.go:64] FLAG: --feature-gates=""
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628193    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628196    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628199    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628204    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628208    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628211    2573 flags.go:64] FLAG: --help="false"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628214    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-132-42.ec2.internal"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628222    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628227    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628230    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628233    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628237    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628240    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 03:55:19.634173 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628242    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628245    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628248    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628251    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628254    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628257    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628260    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628263    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628266    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628269    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628272    2573 flags.go:64] FLAG: --lock-file=""
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628275    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628277    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628280    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628285    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628288    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628291    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628294    2573 flags.go:64] FLAG: --logging-format="text"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628296    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628300    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628302    2573 flags.go:64] FLAG: --manifest-url=""
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628305    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628310    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628313    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628317    2573 flags.go:64] FLAG: --max-pods="110"
Jul 29 03:55:19.634795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628320    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628323    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628327    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628330    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628333    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628336    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628339    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628346    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628349    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628352    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628355    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628358    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628363    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628366    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628369    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628372    2573 flags.go:64] FLAG: --port="10250"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628375    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628380    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-066feda51680a1f3d"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628383    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628387    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628389    2573 flags.go:64] FLAG: --register-node="true"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628392    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628396    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628399    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 29 03:55:19.635513 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628402    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628404    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628408    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628411    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628414    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628417    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628423    2573 flags.go:64] FLAG: --runonce="false"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628426    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628430    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628433    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628437    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628440    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628443    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628446    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628449    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628451    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628454    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628457    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628460    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628463    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628466    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628468    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628473    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628476    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628479    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 03:55:19.636106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628484    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628505    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628511    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628516    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628522    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628526    2573 flags.go:64] FLAG: --v="2"
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628530    2573 flags.go:64] FLAG: --version="false"
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628534    2573 flags.go:64] FLAG: --vmodule=""
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628538    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.628541    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628654    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628658    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628661    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628665    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628669    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628671    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628674    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628677    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628679    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628682    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628684    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628687    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 03:55:19.636782 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628689    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628692    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628694    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628697    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628699    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628702    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628705    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628707    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628709    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628712    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628714    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628717    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628723    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628726    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628728    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628731    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628733    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628736    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628738    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628741    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 03:55:19.637328 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628743    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628745    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628748    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628753    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628757    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628760    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628762    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628765    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628768    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628771    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628773    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628775    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628778    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628780    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628783    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628786    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628788    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628791    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628793    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 03:55:19.637900 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628796    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628798    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628801    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628803    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628805    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628808    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628811    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628814    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628816    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628819    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628821    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628823    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628826    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628828    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628830    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628833    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628836    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628839    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628841    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628844    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 03:55:19.638367 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628846    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628850    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628853    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628856    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628859    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628861    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628864    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628866    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628868    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628871    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628873    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628876    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628878    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628881    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628883    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628885    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628888    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628890    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628893    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 03:55:19.638879 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628896    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628898    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628902    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628905    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628908    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628910    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628913    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628916    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.628918    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.629449    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.636076    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.636092    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.636709    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.636717    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636773    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 03:55:19.639345 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636778    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636781    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636784    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636787    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636790    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636793    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636797    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636800    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636803    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636805    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636808    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636811    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636814    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636817    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636820    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636822    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636825    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636827    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636830    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636832    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 03:55:19.639754 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636834    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636837    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636840    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636842    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636845    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636847    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636849    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636852    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636856    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636859    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636862    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636865    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636867    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636870    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636872    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636874    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636877    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636879    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636882    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 03:55:19.640246 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636884    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636887    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636890    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636892    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636895    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636897    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636900    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636902    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636905    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636908    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636910    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636914    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636918    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636921    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636923    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636927    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636929    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636932    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636935    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636938    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 03:55:19.640734 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636940    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636944    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636947    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636950    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636953    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636957    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636960    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636963    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636965    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636968    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636970    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636972    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636975    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636977    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636980    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636982    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636985    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636987    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636990    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 03:55:19.641224 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636992    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636995    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.636997    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637000    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637002    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637004    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637007    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637009    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637012    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637014    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637016    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637019    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637022    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637025    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637028    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637030    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637034    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637036    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637040    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 03:55:19.641698 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637044    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.637049    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637160    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637165    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637168    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637172    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637175    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637178    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637180    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637183    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637185    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637188    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637191    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637193    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637196    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 03:55:19.642154 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637198    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637201    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637203    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637206    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637209    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637212    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637214    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637217    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637219    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637222    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637224    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637227    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637229    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637232    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637235    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637238    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637240    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637243    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637245    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637247    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 03:55:19.642535 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637251    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637255    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637258    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637261    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637263    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637266    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637268    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637271    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637273    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637276    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637278    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637281    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637283    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637285    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637288    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637290    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637293    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637296    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637299    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637302    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 03:55:19.643024 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637305    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637307    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637310    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637312    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637315    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637318    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637320    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637323    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637329    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637332    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637335    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637338    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637340    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637343    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637346    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637348    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637351    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637353    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637356    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637358    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 03:55:19.643523 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637361    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637363    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637366    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637368    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637371    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637373    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637376    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637378    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637381    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637383    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637386    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637389    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637391    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637394    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637396    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637399    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637401    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637404    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637406    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 03:55:19.644008 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637409    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637411    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637414    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637418    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637421    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637424    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:19.637427    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.637432    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.637573    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.639572    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.640619    2573 server.go:1019] "Starting client certificate rotation"
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.640717    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.641389    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 03:55:19.644468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.642659    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 03:55:19.644813 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.644123    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 03:55:19.653837 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.653815    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 29 03:55:19.657026 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.657009    2573 log.go:25] "Validated CRI v1 image API"
Jul 29 03:55:19.658404 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.658381    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 03:55:19.660388 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.660364    2573 fs.go:135] Filesystem UUIDs: map[351c56c6-ec0c-4496-966b-37174cca09b2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c46397cc-79d4-4969-af18-cc876d0ad3e5:/dev/nvme0n1p3]
Jul 29 03:55:19.660443 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.660388    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 03:55:19.664801 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.664695    2573 manager.go:216] Machine: {Timestamp:2026-07-29 03:55:19.66418709 +0000 UTC m=+0.259287799 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096475 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2384228ebe01667176bf663750f61e SystemUUID:ec238422-8ebe-0166-7176-bf663750f61e BootID:5b67d357-ecd7-42fd-9c5a-14dffcbb5218 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d5:5e:1a:ee:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d5:5e:1a:ee:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:59:b2:28:12:a4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 03:55:19.664801 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.664795    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 03:55:19.664951 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.664886    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 03:55:19.667314 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.667292    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 03:55:19.667474 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.667316    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 03:55:19.667599 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.667583    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 03:55:19.667990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.667978    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 03:55:19.668024 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.667993    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 03:55:19.668024 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.668001    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 03:55:19.668024 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.668013    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 03:55:19.669302 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.669290    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 03:55:19.673230 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.673218    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 03:55:19.673354 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.673344    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 03:55:19.673394 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.673374    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 03:55:19.673394 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.673390    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 03:55:19.673459 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.673401    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 03:55:19.673459 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.673412    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 29 03:55:19.673459 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.673427    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 03:55:19.673809 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.673798    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 03:55:19.673864 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.673816    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 03:55:19.675530 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.675485    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 03:55:19.677278 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.677263    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 03:55:19.677338 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.677293    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 03:55:19.678712 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678699    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 03:55:19.678759 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678717    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 03:55:19.678759 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678723    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 03:55:19.678759 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678728    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 03:55:19.678759 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678737    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 03:55:19.678759 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678747    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 03:55:19.678759 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678758    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 03:55:19.678917 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678763    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 03:55:19.678917 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678773    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 03:55:19.678917 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678779    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 03:55:19.678917 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678787    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 03:55:19.678917 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.678792    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 03:55:19.679352 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.679339    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 03:55:19.679352 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.679353    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 03:55:19.682829 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.682815    2573 server.go:1268] "Started kubelet"
Jul 29 03:55:19.683188 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.682931    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 03:55:19.683188 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.682912    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 03:55:19.683188 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.683072    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 03:55:19.683837 ip-10-0-132-42 systemd[1]: Started Kubernetes Kubelet.
Jul 29 03:55:19.685704 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.685679    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 03:55:19.685901 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.685873    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 03:55:19.686117 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.686091    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 03:55:19.686356 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.686334    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 03:55:19.687735 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.687715    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 03:55:19.688956 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.688923    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 03:55:19.690657 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.690634    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5s4vm"
Jul 29 03:55:19.692013 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.691345    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-42.ec2.internal.18c6a6740e254c22  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-42.ec2.internal,UID:ip-10-0-132-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-42.ec2.internal,},FirstTimestamp:2026-07-29 03:55:19.68272285 +0000 UTC m=+0.277823557,LastTimestamp:2026-07-29 03:55:19.68272285 +0000 UTC m=+0.277823557,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-42.ec2.internal,}"
Jul 29 03:55:19.692111 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.692099    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 03:55:19.692268 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.692232    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 03:55:19.692431 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.692412    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:19.692664 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.692647    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 03:55:19.692733 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.692668    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 03:55:19.692808 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.692789    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 03:55:19.692808 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.692804    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 03:55:19.693011 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.692647    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 03:55:19.693093 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.693023    2573 factory.go:55] Registering systemd factory
Jul 29 03:55:19.693093 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.693037    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 29 03:55:19.693348 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.693327    2573 factory.go:153] Registering CRI-O factory
Jul 29 03:55:19.693348 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.693342    2573 factory.go:223] Registration of the crio container factory successfully
Jul 29 03:55:19.693471 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.693392    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 03:55:19.693471 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.693410    2573 factory.go:103] Registering Raw factory
Jul 29 03:55:19.693471 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.693422    2573 manager.go:1196] Started watching for new ooms in manager
Jul 29 03:55:19.693964 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.693952    2573 manager.go:349] Starting recovery of all containers
Jul 29 03:55:19.698764 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.698742    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5s4vm"
Jul 29 03:55:19.703587 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.703418    2573 manager.go:354] Recovery completed
Jul 29 03:55:19.704448 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.704427    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 03:55:19.705148 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.705121    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 03:55:19.709450 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.709433    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 03:55:19.711272 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.711258    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 03:55:19.711325 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.711285    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 03:55:19.711325 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.711296    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientPID"
Jul 29 03:55:19.711852 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.711838    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 03:55:19.711852 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.711852    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 03:55:19.711962 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.711866    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 03:55:19.711962 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.711841    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 03:55:19.712588 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.712572    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 03:55:19.712648 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.712602    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 03:55:19.712648 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.712614    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientPID"
Jul 29 03:55:19.714149 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.714131    2573 policy_none.go:49] "None policy: Start"
Jul 29 03:55:19.714149 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.714148    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 03:55:19.714275 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.714159    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 03:55:19.716048 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.716036    2573 policy_none.go:47] "Start"
Jul 29 03:55:19.749538 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.749524    2573 manager.go:337] "Starting Device Plugin manager"
Jul 29 03:55:19.749609 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.749554    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 03:55:19.749609 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.749564    2573 server.go:87] "Starting device plugin registration server"
Jul 29 03:55:19.749825 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.749813    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 03:55:19.749858 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.749827    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 03:55:19.749950 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.749926    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 03:55:19.750029 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.750012    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 03:55:19.750029 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.750026    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 03:55:19.750575 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.750557    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 03:55:19.750640 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.750601    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:19.850759 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.850727    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 03:55:19.853068 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.852121    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 03:55:19.853068 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.852148    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 03:55:19.853068 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.852161    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientPID"
Jul 29 03:55:19.853068 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.852191    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-42.ec2.internal"
Jul 29 03:55:19.857517 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.857483    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-42.ec2.internal"
Jul 29 03:55:19.857599 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.857525    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-42.ec2.internal\": node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:19.859612 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.859592    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 03:55:19.860948 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.860931    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 03:55:19.861005 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.860981    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 03:55:19.861041 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.861005    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 03:55:19.861084 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.861046    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 03:55:19.862685 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.862669    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 03:55:19.883912 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.883856    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:19.961574 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.961545    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"]
Jul 29 03:55:19.961709 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.961640    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 03:55:19.964580 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.964562    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 03:55:19.964665 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.964593    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 03:55:19.964665 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.964603    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientPID"
Jul 29 03:55:19.967041 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.967027    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 03:55:19.967150 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.967135    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:19.967189 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.967171    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 03:55:19.967789 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.967763    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 03:55:19.967865 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.967774    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 03:55:19.967865 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.967805    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 03:55:19.967865 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.967819    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientPID"
Jul 29 03:55:19.967865 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.967823    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 03:55:19.967865 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.967838    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientPID"
Jul 29 03:55:19.970112 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.970099    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:19.970182 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.970125    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 03:55:19.970797 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.970781    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 03:55:19.970863 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.970817    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 03:55:19.970863 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.970837    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeHasSufficientPID"
Jul 29 03:55:19.983958 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.983929    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:19.993913 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.993886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4986a82ee8d2a285c70881170330a296-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal\" (UID: \"4986a82ee8d2a285c70881170330a296\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:19.993913 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.993914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4986a82ee8d2a285c70881170330a296-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal\" (UID: \"4986a82ee8d2a285c70881170330a296\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:19.994057 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:19.993930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ba036abba3605af2a4be113b0020ec88-config\") pod \"kube-apiserver-proxy-ip-10-0-132-42.ec2.internal\" (UID: \"ba036abba3605af2a4be113b0020ec88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:19.995241 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.995224    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-42.ec2.internal\" not found" node="ip-10-0-132-42.ec2.internal"
Jul 29 03:55:19.999507 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:19.999470    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-42.ec2.internal\" not found" node="ip-10-0-132-42.ec2.internal"
Jul 29 03:55:20.084843 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.084796    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:20.094139 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.094116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4986a82ee8d2a285c70881170330a296-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal\" (UID: \"4986a82ee8d2a285c70881170330a296\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:20.094204 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.094138    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4986a82ee8d2a285c70881170330a296-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal\" (UID: \"4986a82ee8d2a285c70881170330a296\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:20.094204 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.094158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4986a82ee8d2a285c70881170330a296-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal\" (UID: \"4986a82ee8d2a285c70881170330a296\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:20.094204 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.094183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ba036abba3605af2a4be113b0020ec88-config\") pod \"kube-apiserver-proxy-ip-10-0-132-42.ec2.internal\" (UID: \"ba036abba3605af2a4be113b0020ec88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:20.094291 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.094220    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ba036abba3605af2a4be113b0020ec88-config\") pod \"kube-apiserver-proxy-ip-10-0-132-42.ec2.internal\" (UID: \"ba036abba3605af2a4be113b0020ec88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:20.094291 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.094256    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4986a82ee8d2a285c70881170330a296-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal\" (UID: \"4986a82ee8d2a285c70881170330a296\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:20.185598 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.185524    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:20.286081 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.286050    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:20.297572 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.297536    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:20.303481 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.303448    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:20.386576 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.386537    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:20.487166 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.487081    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:20.588085 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.588054    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:20.642640 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.642598    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 03:55:20.643249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.642788    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 03:55:20.688153 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.688115    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:20.704147 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.704104    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 03:50:20 +0000 UTC" deadline="2028-04-03 10:11:03.53287839 +0000 UTC"
Jul 29 03:55:20.704147 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.704145    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14742h15m42.828737209s"
Jul 29 03:55:20.789137 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.789103    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:20.889370 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.889330    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:20.942003 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:20.941961    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4986a82ee8d2a285c70881170330a296.slice/crio-3b15d48fe9d9b310342cea3113f294909b76e1a8fdf47d8f983b2a883b546b54 WatchSource:0}: Error finding container 3b15d48fe9d9b310342cea3113f294909b76e1a8fdf47d8f983b2a883b546b54: Status 404 returned error can't find the container with id 3b15d48fe9d9b310342cea3113f294909b76e1a8fdf47d8f983b2a883b546b54
Jul 29 03:55:20.947656 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:20.947636    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 03:55:20.990328 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:20.990293    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:21.064267 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.064201    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 03:55:21.091725 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.091695    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:21.192875 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.192837    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-42.ec2.internal\" not found"
Jul 29 03:55:21.202601 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.202578    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 03:55:21.247706 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.247675    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 03:55:21.294533 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.294488    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:21.303312 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.303289    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 03:55:21.304123 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.304110    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal"
Jul 29 03:55:21.314261 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.314244    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 03:55:21.675004 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.674964    2573 apiserver.go:52] "Watching apiserver"
Jul 29 03:55:21.693642 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.693612    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 03:55:21.699407 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.699211    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 03:55:21.701028 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.700991    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-mntmr","kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal","openshift-dns/node-resolver-87pml","openshift-image-registry/node-ca-gngxn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal","openshift-multus/multus-bl2ck","openshift-multus/network-metrics-daemon-ljlpr","openshift-network-diagnostics/network-check-target-7kj2v","openshift-network-operator/iptables-alerter-9wnmq","kube-system/global-pull-secret-syncer-dpx6b","kube-system/konnectivity-agent-vhxjp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs","openshift-cluster-node-tuning-operator/tuned-jg8qm","openshift-multus/multus-additional-cni-plugins-cbd2t"]
Jul 29 03:55:21.704040 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.703628    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:21.704040 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.703741    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:21.706326 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.705919    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:21.708170 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.708143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.710307 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.709537    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 03:55:21.710307 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.709833    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zwbqx\""
Jul 29 03:55:21.710307 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.710132    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 03:55:21.710565 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.710410    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.712788 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.712765    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.713275 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.713093    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 03:55:21.713275 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.713171    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 03:55:21.713433 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.713317    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-25jxj\""
Jul 29 03:55:21.713499 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.713460    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 03:55:21.713749 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.713712    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 03:55:21.713982 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.713963    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lm8lv\""
Jul 29 03:55:21.714198 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.714176    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 03:55:21.715768 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.715436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.717674 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.717652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.718218 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.718200    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 03:55:21.718530 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.718509    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 03:55:21.718717 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.718700    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 03:55:21.719115 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.719095    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pv7zv\""
Jul 29 03:55:21.721604 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.721323    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.726042 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.725817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:21.726042 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.725900    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:21.729029 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.728659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:21.729029 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.728726    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:21.729337 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.729307    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 03:55:21.729634 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.729560    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 03:55:21.731447 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.731424    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.732197 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.732175    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 03:55:21.732293 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.732242    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kffgr\""
Jul 29 03:55:21.732397 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.732175    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 03:55:21.732507 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.732485    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 03:55:21.732596 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.732561    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 03:55:21.732977 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.732959    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 03:55:21.733057 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.733027    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 03:55:21.733256 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.733234    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x7ncc\""
Jul 29 03:55:21.733400 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.733374    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bgncs\""
Jul 29 03:55:21.733588 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.733521    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 03:55:21.735019 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.735001    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.735116 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.735078    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 03:55:21.735475 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.735455    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 03:55:21.738193 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.738172    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zbh6s\""
Jul 29 03:55:21.739427 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.739406    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 03:55:21.739638 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.739618    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 03:55:21.739837 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.739801    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 03:55:21.741046 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.741026    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wfc7m\""
Jul 29 03:55:21.741271 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.741253    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 03:55:21.746721 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.746697    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 03:55:21.746721 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.746714    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 03:55:21.747033 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.747012    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 03:55:21.748248 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.748218    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2xq4"
Jul 29 03:55:21.757636 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.757612    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2xq4"
Jul 29 03:55:21.794449 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.794417    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 03:55:21.803063 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-ovnkube-config\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.803063 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803073    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8a1f3c3-4a4e-44b3-946c-336baafa6363-tmp-dir\") pod \"node-resolver-87pml\" (UID: \"b8a1f3c3-4a4e-44b3-946c-336baafa6363\") " pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.803264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803100    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4nbl\" (UniqueName: \"kubernetes.io/projected/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-kube-api-access-j4nbl\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.803264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-system-cni-dir\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.803264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803142    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6acb23dc-33eb-4cf7-840d-2ca5486146c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.803264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803158    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-sys\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.803264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803177    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-var-lib-openvswitch\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.803264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-cni-bin\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.803264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803230    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-run-netns\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.803264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-conf-dir\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.803264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/925b8c1c-9453-46a3-a63e-54e0af42aaf6-host-slash\") pod \"iptables-alerter-9wnmq\" (UID: \"925b8c1c-9453-46a3-a63e-54e0af42aaf6\") " pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-registration-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-var-lib-kubelet\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-run-openvswitch\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtt5t\" (UniqueName: \"kubernetes.io/projected/53f7820e-009f-49c0-8949-15f9a5a3ffc8-kube-api-access-mtt5t\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-modprobe-d\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803402    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-slash\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-node-log\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8a1f3c3-4a4e-44b3-946c-336baafa6363-hosts-file\") pod \"node-resolver-87pml\" (UID: \"b8a1f3c3-4a4e-44b3-946c-336baafa6363\") " pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-etc-kubernetes\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4nwm\" (UniqueName: \"kubernetes.io/projected/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-kube-api-access-l4nwm\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-systemd-units\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.803757 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-ovnkube-script-lib\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70606c53-16eb-44ad-b366-bc17f813e97c-host\") pod \"node-ca-gngxn\" (UID: \"70606c53-16eb-44ad-b366-bc17f813e97c\") " pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803972    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6acb23dc-33eb-4cf7-840d-2ca5486146c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.803999    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-host\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2eb82411-29aa-4335-83be-0bd353bb1b1a-tmp\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-daemon-config\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804098    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-kubernetes\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-var-lib-kubelet\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-sysconfig\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804201    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-socket-dir-parent\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-cni-netd\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-run-multus-certs\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-socket-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6acb23dc-33eb-4cf7-840d-2ca5486146c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.804439 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-sysctl-conf\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804362    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hqvj\" (UniqueName: \"kubernetes.io/projected/2eb82411-29aa-4335-83be-0bd353bb1b1a-kube-api-access-4hqvj\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd69x\" (UniqueName: \"kubernetes.io/projected/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-kube-api-access-vd69x\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-cni-dir\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804430    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-var-lib-cni-multus\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-cnibin\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-cnibin\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804494    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-run-k8s-cni-cncf-io\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-var-lib-cni-bin\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-kubelet\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804615    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-etc-openvswitch\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-run-ovn\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70606c53-16eb-44ad-b366-bc17f813e97c-serviceca\") pod \"node-ca-gngxn\" (UID: \"70606c53-16eb-44ad-b366-bc17f813e97c\") " pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804686    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-hostroot\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.805249 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d1a3a6f-876d-4412-92f6-4e350e665858-dbus\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-os-release\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-lib-modules\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-run-netns\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-run-systemd\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-run\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-tuned\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804894    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-env-overrides\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cce1ed7d-5e38-4a28-b342-0a3b1d808f09-konnectivity-ca\") pod \"konnectivity-agent-vhxjp\" (UID: \"cce1ed7d-5e38-4a28-b342-0a3b1d808f09\") " pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-sysctl-d\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-systemd\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.804989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-ovn-node-metrics-cert\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4hms\" (UniqueName: \"kubernetes.io/projected/70606c53-16eb-44ad-b366-bc17f813e97c-kube-api-access-n4hms\") pod \"node-ca-gngxn\" (UID: \"70606c53-16eb-44ad-b366-bc17f813e97c\") " pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-cni-binary-copy\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.805891 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d1a3a6f-876d-4412-92f6-4e350e665858-kubelet-config\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhp6b\" (UniqueName: \"kubernetes.io/projected/6acb23dc-33eb-4cf7-840d-2ca5486146c4-kube-api-access-vhp6b\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805087    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-log-socket\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqgr9\" (UniqueName: \"kubernetes.io/projected/b8a1f3c3-4a4e-44b3-946c-336baafa6363-kube-api-access-sqgr9\") pod \"node-resolver-87pml\" (UID: \"b8a1f3c3-4a4e-44b3-946c-336baafa6363\") " pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-system-cni-dir\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805158    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-os-release\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/925b8c1c-9453-46a3-a63e-54e0af42aaf6-iptables-alerter-script\") pod \"iptables-alerter-9wnmq\" (UID: \"925b8c1c-9453-46a3-a63e-54e0af42aaf6\") " pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805193    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmhk\" (UniqueName: \"kubernetes.io/projected/925b8c1c-9453-46a3-a63e-54e0af42aaf6-kube-api-access-4kmhk\") pod \"iptables-alerter-9wnmq\" (UID: \"925b8c1c-9453-46a3-a63e-54e0af42aaf6\") " pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-device-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805236    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-sys-fs\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cce1ed7d-5e38-4a28-b342-0a3b1d808f09-agent-certs\") pod \"konnectivity-agent-vhxjp\" (UID: \"cce1ed7d-5e38-4a28-b342-0a3b1d808f09\") " pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:21.806745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.805270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:21.869568 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.869456    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal" event={"ID":"ba036abba3605af2a4be113b0020ec88","Type":"ContainerStarted","Data":"68b435a6bf05994676609cf46bf2b8c3fa3674852aa1f2197edf7bd9b1e53d84"}
Jul 29 03:55:21.870815 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.870788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal" event={"ID":"4986a82ee8d2a285c70881170330a296","Type":"ContainerStarted","Data":"3b15d48fe9d9b310342cea3113f294909b76e1a8fdf47d8f983b2a883b546b54"}
Jul 29 03:55:21.905941 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.905902    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-sysctl-d\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.906101 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.905955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-systemd\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.906101 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.905987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-ovn-node-metrics-cert\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.906101 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4hms\" (UniqueName: \"kubernetes.io/projected/70606c53-16eb-44ad-b366-bc17f813e97c-kube-api-access-n4hms\") pod \"node-ca-gngxn\" (UID: \"70606c53-16eb-44ad-b366-bc17f813e97c\") " pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.906250 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906101    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-sysctl-d\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.906250 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-cni-binary-copy\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.906250 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906172    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d1a3a6f-876d-4412-92f6-4e350e665858-kubelet-config\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:21.906250 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhp6b\" (UniqueName: \"kubernetes.io/projected/6acb23dc-33eb-4cf7-840d-2ca5486146c4-kube-api-access-vhp6b\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.906250 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906101    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-systemd\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.906250 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906227    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-log-socket\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.906477 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906270    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-log-socket\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.906477 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqgr9\" (UniqueName: \"kubernetes.io/projected/b8a1f3c3-4a4e-44b3-946c-336baafa6363-kube-api-access-sqgr9\") pod \"node-resolver-87pml\" (UID: \"b8a1f3c3-4a4e-44b3-946c-336baafa6363\") " pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.906477 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-system-cni-dir\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.906477 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-os-release\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.906477 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/925b8c1c-9453-46a3-a63e-54e0af42aaf6-iptables-alerter-script\") pod \"iptables-alerter-9wnmq\" (UID: \"925b8c1c-9453-46a3-a63e-54e0af42aaf6\") " pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.906794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906596    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-system-cni-dir\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.906794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906617    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmhk\" (UniqueName: \"kubernetes.io/projected/925b8c1c-9453-46a3-a63e-54e0af42aaf6-kube-api-access-4kmhk\") pod \"iptables-alerter-9wnmq\" (UID: \"925b8c1c-9453-46a3-a63e-54e0af42aaf6\") " pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.906794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-device-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.906794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906674    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 03:55:21.906794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906737    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-sys-fs\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.906794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-sys-fs\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.906794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cce1ed7d-5e38-4a28-b342-0a3b1d808f09-agent-certs\") pod \"konnectivity-agent-vhxjp\" (UID: \"cce1ed7d-5e38-4a28-b342-0a3b1d808f09\") " pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:21.906794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906840    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-ovnkube-config\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8a1f3c3-4a4e-44b3-946c-336baafa6363-tmp-dir\") pod \"node-resolver-87pml\" (UID: \"b8a1f3c3-4a4e-44b3-946c-336baafa6363\") " pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4nbl\" (UniqueName: \"kubernetes.io/projected/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-kube-api-access-j4nbl\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906876    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-cni-binary-copy\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-system-cni-dir\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906912    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6acb23dc-33eb-4cf7-840d-2ca5486146c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/925b8c1c-9453-46a3-a63e-54e0af42aaf6-iptables-alerter-script\") pod \"iptables-alerter-9wnmq\" (UID: \"925b8c1c-9453-46a3-a63e-54e0af42aaf6\") " pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-sys\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907046    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-sys\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-var-lib-openvswitch\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907082    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d1a3a6f-876d-4412-92f6-4e350e665858-kubelet-config\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907086    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-var-lib-openvswitch\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-cni-bin\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-run-netns\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.907208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-conf-dir\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907205    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/925b8c1c-9453-46a3-a63e-54e0af42aaf6-host-slash\") pod \"iptables-alerter-9wnmq\" (UID: \"925b8c1c-9453-46a3-a63e-54e0af42aaf6\") " pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-registration-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-var-lib-kubelet\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907337    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-run-openvswitch\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907391    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-device-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtt5t\" (UniqueName: \"kubernetes.io/projected/53f7820e-009f-49c0-8949-15f9a5a3ffc8-kube-api-access-mtt5t\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-modprobe-d\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-slash\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-node-log\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8a1f3c3-4a4e-44b3-946c-336baafa6363-hosts-file\") pod \"node-resolver-87pml\" (UID: \"b8a1f3c3-4a4e-44b3-946c-336baafa6363\") " pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6acb23dc-33eb-4cf7-840d-2ca5486146c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907552    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8a1f3c3-4a4e-44b3-946c-336baafa6363-tmp-dir\") pod \"node-resolver-87pml\" (UID: \"b8a1f3c3-4a4e-44b3-946c-336baafa6363\") " pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907639    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-etc-kubernetes\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907593    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-etc-kubernetes\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907698    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-ovnkube-config\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.906679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-os-release\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.907990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907723    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8a1f3c3-4a4e-44b3-946c-336baafa6363-hosts-file\") pod \"node-resolver-87pml\" (UID: \"b8a1f3c3-4a4e-44b3-946c-336baafa6363\") " pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907790    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-cni-bin\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907796    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-conf-dir\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907779    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-run-openvswitch\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907842    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/925b8c1c-9453-46a3-a63e-54e0af42aaf6-host-slash\") pod \"iptables-alerter-9wnmq\" (UID: \"925b8c1c-9453-46a3-a63e-54e0af42aaf6\") " pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-var-lib-kubelet\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4nwm\" (UniqueName: \"kubernetes.io/projected/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-kube-api-access-l4nwm\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907944    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-modprobe-d\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-systemd-units\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907957    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-slash\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.907959    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-ovnkube-script-lib\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907983    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-run-netns\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.907902    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-registration-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908002    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-node-log\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70606c53-16eb-44ad-b366-bc17f813e97c-host\") pod \"node-ca-gngxn\" (UID: \"70606c53-16eb-44ad-b366-bc17f813e97c\") " pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908034    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-system-cni-dir\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.908893 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.908043    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs podName:53f7820e-009f-49c0-8949-15f9a5a3ffc8 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:22.408018658 +0000 UTC m=+3.003119358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs") pod "network-metrics-daemon-ljlpr" (UID: "53f7820e-009f-49c0-8949-15f9a5a3ffc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908076    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70606c53-16eb-44ad-b366-bc17f813e97c-host\") pod \"node-ca-gngxn\" (UID: \"70606c53-16eb-44ad-b366-bc17f813e97c\") " pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6acb23dc-33eb-4cf7-840d-2ca5486146c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908112    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-systemd-units\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-host\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2eb82411-29aa-4335-83be-0bd353bb1b1a-tmp\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908267    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-daemon-config\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908318    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-kubernetes\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-var-lib-kubelet\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-sysconfig\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908435    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-socket-dir-parent\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-cni-netd\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908540    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-run-multus-certs\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908610    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-ovnkube-script-lib\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-socket-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.909812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6acb23dc-33eb-4cf7-840d-2ca5486146c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-sysctl-conf\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908717    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hqvj\" (UniqueName: \"kubernetes.io/projected/2eb82411-29aa-4335-83be-0bd353bb1b1a-kube-api-access-4hqvj\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-kubernetes\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908773    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-var-lib-kubelet\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908294    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-host\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd69x\" (UniqueName: \"kubernetes.io/projected/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-kube-api-access-vd69x\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908903    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-socket-dir\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-cni-dir\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908953    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-sysconfig\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-var-lib-cni-multus\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-cnibin\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908991    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-socket-dir-parent\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909019    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-cnibin\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909061    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-cni-netd\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909074    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-run-k8s-cni-cncf-io\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909121    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-var-lib-cni-bin\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.910399 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-run-k8s-cni-cncf-io\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-daemon-config\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909229    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-kubelet\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.908872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-run-multus-certs\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909316    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-sysctl-conf\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-var-lib-cni-bin\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909374    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-host-var-lib-cni-multus\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909394    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-multus-cni-dir\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-etc-openvswitch\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6acb23dc-33eb-4cf7-840d-2ca5486146c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909446    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-cnibin\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909456    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-run-ovn\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909483    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-kubelet\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909526    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.911206 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909581    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-cnibin\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909606    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-etc-openvswitch\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70606c53-16eb-44ad-b366-bc17f813e97c-serviceca\") pod \"node-ca-gngxn\" (UID: \"70606c53-16eb-44ad-b366-bc17f813e97c\") " pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909637    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-run-ovn\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.909762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-hostroot\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.911676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d1a3a6f-876d-4412-92f6-4e350e665858-dbus\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.911723    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-os-release\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.911756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-lib-modules\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.911780    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-run-netns\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.911808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-run-systemd\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.911843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.911872    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-run\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.911902    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-tuned\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.911952 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.911926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-env-overrides\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.912683 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.912471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.912683 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.912508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cce1ed7d-5e38-4a28-b342-0a3b1d808f09-konnectivity-ca\") pod \"konnectivity-agent-vhxjp\" (UID: \"cce1ed7d-5e38-4a28-b342-0a3b1d808f09\") " pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:21.913135 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.913111    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cce1ed7d-5e38-4a28-b342-0a3b1d808f09-konnectivity-ca\") pod \"konnectivity-agent-vhxjp\" (UID: \"cce1ed7d-5e38-4a28-b342-0a3b1d808f09\") " pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:21.914265 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.913459    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6acb23dc-33eb-4cf7-840d-2ca5486146c4-os-release\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.914265 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.913619    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-lib-modules\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.914265 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.913682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-host-run-netns\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.914265 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.913740    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-run-systemd\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.914265 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.913843    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:21.914265 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.913901    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret podName:1d1a3a6f-876d-4412-92f6-4e350e665858 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:22.413883979 +0000 UTC m=+3.008984681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret") pod "global-pull-secret-syncer-dpx6b" (UID: "1d1a3a6f-876d-4412-92f6-4e350e665858") : object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:21.914265 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.913965    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2eb82411-29aa-4335-83be-0bd353bb1b1a-run\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.914265 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.914009    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d1a3a6f-876d-4412-92f6-4e350e665858-dbus\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:21.914777 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.914546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cce1ed7d-5e38-4a28-b342-0a3b1d808f09-agent-certs\") pod \"konnectivity-agent-vhxjp\" (UID: \"cce1ed7d-5e38-4a28-b342-0a3b1d808f09\") " pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:21.914777 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.914643    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6acb23dc-33eb-4cf7-840d-2ca5486146c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.915030 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.915008    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70606c53-16eb-44ad-b366-bc17f813e97c-serviceca\") pod \"node-ca-gngxn\" (UID: \"70606c53-16eb-44ad-b366-bc17f813e97c\") " pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.915233 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.915213    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2eb82411-29aa-4335-83be-0bd353bb1b1a-tmp\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.915469 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.915447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-ovn-node-metrics-cert\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.915556 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.915524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-hostroot\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:21.915682 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.915659    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-env-overrides\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.915817 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.915794    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.915963 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.915947    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 03:55:21.916023 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.915972    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 03:55:21.916023 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.915986    2573 projected.go:196] Error preparing data for projected volume kube-api-access-wbq4g for pod openshift-network-diagnostics/network-check-target-7kj2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:21.916135 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:21.916049    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g podName:a1db9c4e-5c70-4d96-8488-be0da392a46f nodeName:}" failed. No retries permitted until 2026-07-29 03:55:22.416033547 +0000 UTC m=+3.011134262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wbq4g" (UniqueName: "kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g") pod "network-check-target-7kj2v" (UID: "a1db9c4e-5c70-4d96-8488-be0da392a46f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:21.917494 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.917419    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2eb82411-29aa-4335-83be-0bd353bb1b1a-etc-tuned\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.919647 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.919621    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhp6b\" (UniqueName: \"kubernetes.io/projected/6acb23dc-33eb-4cf7-840d-2ca5486146c4-kube-api-access-vhp6b\") pod \"multus-additional-cni-plugins-cbd2t\" (UID: \"6acb23dc-33eb-4cf7-840d-2ca5486146c4\") " pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:21.921126 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.921070    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4hms\" (UniqueName: \"kubernetes.io/projected/70606c53-16eb-44ad-b366-bc17f813e97c-kube-api-access-n4hms\") pod \"node-ca-gngxn\" (UID: \"70606c53-16eb-44ad-b366-bc17f813e97c\") " pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:21.922204 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.921891    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4nbl\" (UniqueName: \"kubernetes.io/projected/ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b-kube-api-access-j4nbl\") pod \"aws-ebs-csi-driver-node-dgtjs\" (UID: \"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:21.922488 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.922248    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmhk\" (UniqueName: \"kubernetes.io/projected/925b8c1c-9453-46a3-a63e-54e0af42aaf6-kube-api-access-4kmhk\") pod \"iptables-alerter-9wnmq\" (UID: \"925b8c1c-9453-46a3-a63e-54e0af42aaf6\") " pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:21.923101 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.923055    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqgr9\" (UniqueName: \"kubernetes.io/projected/b8a1f3c3-4a4e-44b3-946c-336baafa6363-kube-api-access-sqgr9\") pod \"node-resolver-87pml\" (UID: \"b8a1f3c3-4a4e-44b3-946c-336baafa6363\") " pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:21.924333 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.924308    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd69x\" (UniqueName: \"kubernetes.io/projected/19f88fe4-8b8a-4843-b7e9-78b94997b7a2-kube-api-access-vd69x\") pod \"ovnkube-node-mntmr\" (UID: \"19f88fe4-8b8a-4843-b7e9-78b94997b7a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:21.925294 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.925223    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtt5t\" (UniqueName: \"kubernetes.io/projected/53f7820e-009f-49c0-8949-15f9a5a3ffc8-kube-api-access-mtt5t\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:21.925417 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.925396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hqvj\" (UniqueName: \"kubernetes.io/projected/2eb82411-29aa-4335-83be-0bd353bb1b1a-kube-api-access-4hqvj\") pod \"tuned-jg8qm\" (UID: \"2eb82411-29aa-4335-83be-0bd353bb1b1a\") " pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:21.926243 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:21.926217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4nwm\" (UniqueName: \"kubernetes.io/projected/4ffa0a1d-f5e9-492f-883c-ddeb53126ade-kube-api-access-l4nwm\") pod \"multus-bl2ck\" (UID: \"4ffa0a1d-f5e9-492f-883c-ddeb53126ade\") " pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:22.021706 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.021673    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:22.031603 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.031579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-87pml"
Jul 29 03:55:22.049679 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.049653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gngxn"
Jul 29 03:55:22.055686 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.055665    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cbd2t"
Jul 29 03:55:22.063647 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.063624    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bl2ck"
Jul 29 03:55:22.073625 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.073600    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9wnmq"
Jul 29 03:55:22.082608 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.082587    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jg8qm"
Jul 29 03:55:22.095773 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.095733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:22.102754 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.102732    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs"
Jul 29 03:55:22.224547 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.224449    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 03:55:22.416606 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.416568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:22.416788 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.416638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:22.416788 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.416681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:22.416788 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.416746    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:22.416788 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.416769    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:22.416788 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.416784    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 03:55:22.417059 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.416799    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 03:55:22.417059 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.416814    2573 projected.go:196] Error preparing data for projected volume kube-api-access-wbq4g for pod openshift-network-diagnostics/network-check-target-7kj2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:22.417059 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.416846    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret podName:1d1a3a6f-876d-4412-92f6-4e350e665858 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:23.416814899 +0000 UTC m=+4.011915597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret") pod "global-pull-secret-syncer-dpx6b" (UID: "1d1a3a6f-876d-4412-92f6-4e350e665858") : object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:22.417059 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.416865    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs podName:53f7820e-009f-49c0-8949-15f9a5a3ffc8 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:23.416857311 +0000 UTC m=+4.011958009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs") pod "network-metrics-daemon-ljlpr" (UID: "53f7820e-009f-49c0-8949-15f9a5a3ffc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:22.417059 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.416887    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g podName:a1db9c4e-5c70-4d96-8488-be0da392a46f nodeName:}" failed. No retries permitted until 2026-07-29 03:55:23.416878203 +0000 UTC m=+4.011978900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbq4g" (UniqueName: "kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g") pod "network-check-target-7kj2v" (UID: "a1db9c4e-5c70-4d96-8488-be0da392a46f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:22.761739 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.761672    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 03:50:22 +0000 UTC" deadline="2028-03-31 10:31:19.454872298 +0000 UTC"
Jul 29 03:55:22.761739 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.761736    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14670h35m56.693141707s"
Jul 29 03:55:22.861595 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.861554    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:22.861779 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:22.861600    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:22.861779 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.861710    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:22.861912 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:22.861859    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:22.961125 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:22.961093    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925b8c1c_9453_46a3_a63e_54e0af42aaf6.slice/crio-c5148246cf7b714fffc0464b47d41e7e3a11196499a6e318ea1bcdfd014196c7 WatchSource:0}: Error finding container c5148246cf7b714fffc0464b47d41e7e3a11196499a6e318ea1bcdfd014196c7: Status 404 returned error can't find the container with id c5148246cf7b714fffc0464b47d41e7e3a11196499a6e318ea1bcdfd014196c7
Jul 29 03:55:22.961814 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:22.961790    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb82411_29aa_4335_83be_0bd353bb1b1a.slice/crio-c79553bdf08d9a1fa976d899c68edd64706cc5089608dc4133c002775920c7b1 WatchSource:0}: Error finding container c79553bdf08d9a1fa976d899c68edd64706cc5089608dc4133c002775920c7b1: Status 404 returned error can't find the container with id c79553bdf08d9a1fa976d899c68edd64706cc5089608dc4133c002775920c7b1
Jul 29 03:55:22.992880 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:22.992843    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70606c53_16eb_44ad_b366_bc17f813e97c.slice/crio-56aa598368b4157d7604357c68a3e1b71f090bdd2a9dd22d9165d4367e02fd7c WatchSource:0}: Error finding container 56aa598368b4157d7604357c68a3e1b71f090bdd2a9dd22d9165d4367e02fd7c: Status 404 returned error can't find the container with id 56aa598368b4157d7604357c68a3e1b71f090bdd2a9dd22d9165d4367e02fd7c
Jul 29 03:55:22.994955 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:22.994229    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce1ed7d_5e38_4a28_b342_0a3b1d808f09.slice/crio-eba5b519b2f2e58d61705d3c082d094a60976571fcb24635b0474c92d803ab7f WatchSource:0}: Error finding container eba5b519b2f2e58d61705d3c082d094a60976571fcb24635b0474c92d803ab7f: Status 404 returned error can't find the container with id eba5b519b2f2e58d61705d3c082d094a60976571fcb24635b0474c92d803ab7f
Jul 29 03:55:22.998360 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:22.998300    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ffa0a1d_f5e9_492f_883c_ddeb53126ade.slice/crio-2a82339dedf446e03a86d0bf198450635750e6c801163c9d292875710e31c77d WatchSource:0}: Error finding container 2a82339dedf446e03a86d0bf198450635750e6c801163c9d292875710e31c77d: Status 404 returned error can't find the container with id 2a82339dedf446e03a86d0bf198450635750e6c801163c9d292875710e31c77d
Jul 29 03:55:22.998888 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:22.998865    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f88fe4_8b8a_4843_b7e9_78b94997b7a2.slice/crio-85393f1950b638e00b886d6703ad9c43230da1e1a1b78dd10d34f779fbf64f22 WatchSource:0}: Error finding container 85393f1950b638e00b886d6703ad9c43230da1e1a1b78dd10d34f779fbf64f22: Status 404 returned error can't find the container with id 85393f1950b638e00b886d6703ad9c43230da1e1a1b78dd10d34f779fbf64f22
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.426254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:23.426520    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.426593    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:23.426604    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret podName:1d1a3a6f-876d-4412-92f6-4e350e665858 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:25.426581391 +0000 UTC m=+6.021682091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret") pod "global-pull-secret-syncer-dpx6b" (UID: "1d1a3a6f-876d-4412-92f6-4e350e665858") : object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.426653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:23.426781    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:23.426839    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs podName:53f7820e-009f-49c0-8949-15f9a5a3ffc8 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:25.426820093 +0000 UTC m=+6.021920793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs") pod "network-metrics-daemon-ljlpr" (UID: "53f7820e-009f-49c0-8949-15f9a5a3ffc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:23.426964    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:23.426980    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 03:55:23.427001 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:23.426994    2573 projected.go:196] Error preparing data for projected volume kube-api-access-wbq4g for pod openshift-network-diagnostics/network-check-target-7kj2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:23.427698 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:23.427038    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g podName:a1db9c4e-5c70-4d96-8488-be0da392a46f nodeName:}" failed. No retries permitted until 2026-07-29 03:55:25.427023601 +0000 UTC m=+6.022124301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbq4g" (UniqueName: "kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g") pod "network-check-target-7kj2v" (UID: "a1db9c4e-5c70-4d96-8488-be0da392a46f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:23.762007 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.761881    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 03:50:22 +0000 UTC" deadline="2028-02-29 18:54:47.972268214 +0000 UTC"
Jul 29 03:55:23.762007 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.761952    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13934h59m24.210320745s"
Jul 29 03:55:23.862990 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.862949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:23.863180 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:23.863116    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:23.885334 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.885290    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal" event={"ID":"ba036abba3605af2a4be113b0020ec88","Type":"ContainerStarted","Data":"360cc8cb736370aaafbc47e7023d365451552f382231ec756ef64610a593fd38"}
Jul 29 03:55:23.891745 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.891711    2573 generic.go:356] "Generic (PLEG): container finished" podID="4986a82ee8d2a285c70881170330a296" containerID="aab4f1e8b583be9b0ef3ba52ac99d635a5bf6a9216827a976d5581e92be9ac87" exitCode=0
Jul 29 03:55:23.891900 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.891798    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal" event={"ID":"4986a82ee8d2a285c70881170330a296","Type":"ContainerDied","Data":"aab4f1e8b583be9b0ef3ba52ac99d635a5bf6a9216827a976d5581e92be9ac87"}
Jul 29 03:55:23.895954 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.895839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bl2ck" event={"ID":"4ffa0a1d-f5e9-492f-883c-ddeb53126ade","Type":"ContainerStarted","Data":"2a82339dedf446e03a86d0bf198450635750e6c801163c9d292875710e31c77d"}
Jul 29 03:55:23.900037 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.899982    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-42.ec2.internal" podStartSLOduration=1.899962602 podStartE2EDuration="1.899962602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:23.899193775 +0000 UTC m=+4.494294497" watchObservedRunningTime="2026-07-29 03:55:23.899962602 +0000 UTC m=+4.495063324"
Jul 29 03:55:23.935056 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.935019    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbd2t" event={"ID":"6acb23dc-33eb-4cf7-840d-2ca5486146c4","Type":"ContainerStarted","Data":"8b54b5b67a933b4247f64cc493749706931a0ef4ddf51ce94eb5a008ddd7d923"}
Jul 29 03:55:23.959479 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.959400    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhxjp" event={"ID":"cce1ed7d-5e38-4a28-b342-0a3b1d808f09","Type":"ContainerStarted","Data":"eba5b519b2f2e58d61705d3c082d094a60976571fcb24635b0474c92d803ab7f"}
Jul 29 03:55:23.967500 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.967467    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gngxn" event={"ID":"70606c53-16eb-44ad-b366-bc17f813e97c","Type":"ContainerStarted","Data":"56aa598368b4157d7604357c68a3e1b71f090bdd2a9dd22d9165d4367e02fd7c"}
Jul 29 03:55:23.984365 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:23.984316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs" event={"ID":"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b","Type":"ContainerStarted","Data":"e89cfbd04264871bb7413b93dc3b95d7b8c2bbb0283d27d4b1070cd7bd740bf3"}
Jul 29 03:55:24.011037 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:24.010998    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9wnmq" event={"ID":"925b8c1c-9453-46a3-a63e-54e0af42aaf6","Type":"ContainerStarted","Data":"c5148246cf7b714fffc0464b47d41e7e3a11196499a6e318ea1bcdfd014196c7"}
Jul 29 03:55:24.022760 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:24.022285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" event={"ID":"19f88fe4-8b8a-4843-b7e9-78b94997b7a2","Type":"ContainerStarted","Data":"85393f1950b638e00b886d6703ad9c43230da1e1a1b78dd10d34f779fbf64f22"}
Jul 29 03:55:24.031669 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:24.031635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jg8qm" event={"ID":"2eb82411-29aa-4335-83be-0bd353bb1b1a","Type":"ContainerStarted","Data":"c79553bdf08d9a1fa976d899c68edd64706cc5089608dc4133c002775920c7b1"}
Jul 29 03:55:24.039410 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:24.039377    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-87pml" event={"ID":"b8a1f3c3-4a4e-44b3-946c-336baafa6363","Type":"ContainerStarted","Data":"55b59c818c4b221f0adf09a0638689e95acb4c7d597a3580dea6314a6a81e617"}
Jul 29 03:55:24.861545 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:24.861492    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:24.862080 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:24.861666    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:24.862080 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:24.861696    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:24.862080 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:24.861821    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:25.073445 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:25.073395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal" event={"ID":"4986a82ee8d2a285c70881170330a296","Type":"ContainerStarted","Data":"94dffe5bdb1ae3c72eee21cb28c1e065a22c705a5f442a63e34d3efc1287ce0b"}
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:25.451241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:25.451312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:25.451352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:25.451514    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:25.451608    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs podName:53f7820e-009f-49c0-8949-15f9a5a3ffc8 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:29.451586669 +0000 UTC m=+10.046687370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs") pod "network-metrics-daemon-ljlpr" (UID: "53f7820e-009f-49c0-8949-15f9a5a3ffc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:25.451958    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:25.451999    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret podName:1d1a3a6f-876d-4412-92f6-4e350e665858 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:29.451986412 +0000 UTC m=+10.047087109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret") pod "global-pull-secret-syncer-dpx6b" (UID: "1d1a3a6f-876d-4412-92f6-4e350e665858") : object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:25.452056    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:25.452066    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:25.452075    2573 projected.go:196] Error preparing data for projected volume kube-api-access-wbq4g for pod openshift-network-diagnostics/network-check-target-7kj2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:25.452142 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:25.452097    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g podName:a1db9c4e-5c70-4d96-8488-be0da392a46f nodeName:}" failed. No retries permitted until 2026-07-29 03:55:29.452090374 +0000 UTC m=+10.047191071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbq4g" (UniqueName: "kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g") pod "network-check-target-7kj2v" (UID: "a1db9c4e-5c70-4d96-8488-be0da392a46f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:25.864100 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:25.864067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:25.864672 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:25.864206    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:26.861736 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:26.861695    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:26.861929 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:26.861837    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:26.862303 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:26.862281    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:26.862425 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:26.862403    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:27.864229 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:27.863715    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:27.864229 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:27.863861    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:28.862275 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:28.862238    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:28.862470 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:28.862388    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:28.862832 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:28.862807    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:28.862973 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:28.862916    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:29.485419 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:29.485378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:29.485962 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:29.485441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:29.485962 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:29.485483    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:29.485962 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:29.485642    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:29.485962 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:29.485705    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs podName:53f7820e-009f-49c0-8949-15f9a5a3ffc8 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:37.48568564 +0000 UTC m=+18.080786337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs") pod "network-metrics-daemon-ljlpr" (UID: "53f7820e-009f-49c0-8949-15f9a5a3ffc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:29.486210 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:29.486077    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:29.486210 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:29.486121    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret podName:1d1a3a6f-876d-4412-92f6-4e350e665858 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:37.486110489 +0000 UTC m=+18.081211185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret") pod "global-pull-secret-syncer-dpx6b" (UID: "1d1a3a6f-876d-4412-92f6-4e350e665858") : object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:29.486210 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:29.486182    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 03:55:29.486210 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:29.486202    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 03:55:29.486210 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:29.486213    2573 projected.go:196] Error preparing data for projected volume kube-api-access-wbq4g for pod openshift-network-diagnostics/network-check-target-7kj2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:29.486478 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:29.486247    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g podName:a1db9c4e-5c70-4d96-8488-be0da392a46f nodeName:}" failed. No retries permitted until 2026-07-29 03:55:37.486238221 +0000 UTC m=+18.081338918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbq4g" (UniqueName: "kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g") pod "network-check-target-7kj2v" (UID: "a1db9c4e-5c70-4d96-8488-be0da392a46f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:29.865621 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:29.865583    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:29.865817 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:29.865724    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:30.861291 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:30.861255    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:30.861809 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:30.861372    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:30.861809 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:30.861596    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:30.861809 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:30.861692    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:31.862081 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:31.862047    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:31.862476 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:31.862183    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:32.861878 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:32.861851    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:32.862069 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:32.861993    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:32.862069 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:32.862010    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:32.862526 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:32.862137    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:33.861937 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:33.861903    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:33.862119 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:33.862031    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:34.861505 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:34.861452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:34.861903 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:34.861602    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:34.861903 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:34.861662    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:34.861903 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:34.861759    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:35.861752 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:35.861718    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:35.862213 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:35.861854    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:36.861698 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:36.861654    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:36.861905 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:36.861787    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:36.861905 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:36.861849    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:36.862268 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:36.861934    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:37.553653 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:37.553615    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:37.553859 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:37.553676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:37.553859 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:37.553718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:37.553859 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:37.553779    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:37.553859 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:37.553816    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:37.553859 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:37.553814    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 03:55:37.553859 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:37.553843    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 03:55:37.553859 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:37.553860    2573 projected.go:196] Error preparing data for projected volume kube-api-access-wbq4g for pod openshift-network-diagnostics/network-check-target-7kj2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:37.553859 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:37.553844    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret podName:1d1a3a6f-876d-4412-92f6-4e350e665858 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:53.553827488 +0000 UTC m=+34.148928182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret") pod "global-pull-secret-syncer-dpx6b" (UID: "1d1a3a6f-876d-4412-92f6-4e350e665858") : object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:37.554240 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:37.553891    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs podName:53f7820e-009f-49c0-8949-15f9a5a3ffc8 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:53.553872481 +0000 UTC m=+34.148973189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs") pod "network-metrics-daemon-ljlpr" (UID: "53f7820e-009f-49c0-8949-15f9a5a3ffc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:37.554240 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:37.553906    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g podName:a1db9c4e-5c70-4d96-8488-be0da392a46f nodeName:}" failed. No retries permitted until 2026-07-29 03:55:53.553897599 +0000 UTC m=+34.148998308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbq4g" (UniqueName: "kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g") pod "network-check-target-7kj2v" (UID: "a1db9c4e-5c70-4d96-8488-be0da392a46f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:37.862747 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:37.862159    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:37.862747 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:37.862295    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:38.862229 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:38.862199    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:38.862229 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:38.862211    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:38.862471 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:38.862333    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:38.862471 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:38.862410    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:39.862656 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:39.862625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:39.863021 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:39.862710    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:40.861825 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:40.861785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:40.862015 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:40.861917    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:40.862015 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:40.861978    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:40.862140 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:40.862117    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:41.861441 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:41.861407    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:41.862125 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:41.861544    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:42.862379 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:42.862140    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:42.862965 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:42.862140    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:42.862965 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:42.862384    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:42.862965 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:42.862460    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:43.114945 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.114866    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bl2ck" event={"ID":"4ffa0a1d-f5e9-492f-883c-ddeb53126ade","Type":"ContainerStarted","Data":"b6d63e179028221bacc83a7ece2f85bef8528a295a9cd9407bc092c534d8c4bf"}
Jul 29 03:55:43.116349 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.116324    2573 generic.go:356] "Generic (PLEG): container finished" podID="6acb23dc-33eb-4cf7-840d-2ca5486146c4" containerID="967ef033bc0f7ce12f86083596a1ccdc1f8dfa260c0a99b7ee1a5d2664a8889f" exitCode=0
Jul 29 03:55:43.116445 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.116403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbd2t" event={"ID":"6acb23dc-33eb-4cf7-840d-2ca5486146c4","Type":"ContainerDied","Data":"967ef033bc0f7ce12f86083596a1ccdc1f8dfa260c0a99b7ee1a5d2664a8889f"}
Jul 29 03:55:43.117908 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.117832    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhxjp" event={"ID":"cce1ed7d-5e38-4a28-b342-0a3b1d808f09","Type":"ContainerStarted","Data":"428572daefcaf0824ff72022db72b39b21830a7b495f3304ed7b3830bdf00000"}
Jul 29 03:55:43.119211 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.119192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gngxn" event={"ID":"70606c53-16eb-44ad-b366-bc17f813e97c","Type":"ContainerStarted","Data":"aa3ca573672e867fd3a81b464e6f050220fe24c521d77324af85e3d5a4ca7fcc"}
Jul 29 03:55:43.120683 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.120662    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs" event={"ID":"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b","Type":"ContainerStarted","Data":"7a27237771a5f7afbde1ed900cdfa208dd9ebb44023cfbca0bf4d1126e7be545"}
Jul 29 03:55:43.123715 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.123695    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" event={"ID":"19f88fe4-8b8a-4843-b7e9-78b94997b7a2","Type":"ContainerStarted","Data":"cd7bb7db216a267fee7662f03e26dbe256405bcd43a170f16f7dd4c318be8d8b"}
Jul 29 03:55:43.123799 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.123758    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" event={"ID":"19f88fe4-8b8a-4843-b7e9-78b94997b7a2","Type":"ContainerStarted","Data":"db0619604ca07674928696c06737c959d345c49d57f0e375c9093db1d1fd4401"}
Jul 29 03:55:43.123799 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.123794    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" event={"ID":"19f88fe4-8b8a-4843-b7e9-78b94997b7a2","Type":"ContainerStarted","Data":"d1ecef0a0c0d7460dcbb189512b9db018e3d6ba5707293bcd963a758306ad4e0"}
Jul 29 03:55:43.123883 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.123843    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" event={"ID":"19f88fe4-8b8a-4843-b7e9-78b94997b7a2","Type":"ContainerStarted","Data":"9e46584d6d61f3f1bc5aecb4ef16493f5e7197069746b11ff0156a988b64c20a"}
Jul 29 03:55:43.123883 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.123876    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" event={"ID":"19f88fe4-8b8a-4843-b7e9-78b94997b7a2","Type":"ContainerStarted","Data":"26748649a8d33f438ac3f123039d72bb5d1c1e148324b566b6f0db7c8be96697"}
Jul 29 03:55:43.123951 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.123916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" event={"ID":"19f88fe4-8b8a-4843-b7e9-78b94997b7a2","Type":"ContainerStarted","Data":"bc6f373151c13d8c8c81b553baa5c331a41f87b2821c969f2ac890085f84b9d3"}
Jul 29 03:55:43.125149 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.125129    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jg8qm" event={"ID":"2eb82411-29aa-4335-83be-0bd353bb1b1a","Type":"ContainerStarted","Data":"850ce44f3ff79abd09bd3fcb4fd363db7f83be2653adde386aba9ba8e1327acf"}
Jul 29 03:55:43.126768 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.126739    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-87pml" event={"ID":"b8a1f3c3-4a4e-44b3-946c-336baafa6363","Type":"ContainerStarted","Data":"36f868ac5fc2ffd8dd46398066ed13949bddbf7cda827aa161ef4d3bcd1d36e5"}
Jul 29 03:55:43.138505 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.138449    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-42.ec2.internal" podStartSLOduration=21.138435663 podStartE2EDuration="21.138435663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:25.09067824 +0000 UTC m=+5.685778962" watchObservedRunningTime="2026-07-29 03:55:43.138435663 +0000 UTC m=+23.733536379"
Jul 29 03:55:43.138597 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.138540    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bl2ck" podStartSLOduration=3.739385247 podStartE2EDuration="23.138533897s" totalImagesPullingTime="19.39914865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:43.138281314 +0000 UTC m=+23.733382032" watchObservedRunningTime="2026-07-29 03:55:43.138533897 +0000 UTC m=+23.733634613"
Jul 29 03:55:43.164339 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.164298    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-87pml" podStartSLOduration=3.812285494 podStartE2EDuration="23.164287232s" totalImagesPullingTime="19.352001738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:43.163691665 +0000 UTC m=+23.758792384" watchObservedRunningTime="2026-07-29 03:55:43.164287232 +0000 UTC m=+23.759387948"
Jul 29 03:55:43.178534 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.178473    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gngxn" podStartSLOduration=3.83125181 podStartE2EDuration="23.178459609s" totalImagesPullingTime="19.347207799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:43.178178368 +0000 UTC m=+23.773279085" watchObservedRunningTime="2026-07-29 03:55:43.178459609 +0000 UTC m=+23.773560329"
Jul 29 03:55:43.195025 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.194975    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jg8qm" podStartSLOduration=3.830674061 podStartE2EDuration="23.194956593s" totalImagesPullingTime="19.364282532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:43.194933142 +0000 UTC m=+23.790033862" watchObservedRunningTime="2026-07-29 03:55:43.194956593 +0000 UTC m=+23.790057323"
Jul 29 03:55:43.218305 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.218261    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vhxjp" podStartSLOduration=7.9665997950000005 podStartE2EDuration="23.218245336s" totalImagesPullingTime="15.251645541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:43.218009565 +0000 UTC m=+23.813110281" watchObservedRunningTime="2026-07-29 03:55:43.218245336 +0000 UTC m=+23.813346075"
Jul 29 03:55:43.836427 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.836399    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 03:55:43.861762 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:43.861739    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:43.861892 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:43.861866    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:44.132220 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:44.132173    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs" event={"ID":"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b","Type":"ContainerStarted","Data":"958ad33537c6c0bb5f3004f130137b659f366478410830f984b655dcc5542649"}
Jul 29 03:55:44.134297 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:44.134262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9wnmq" event={"ID":"925b8c1c-9453-46a3-a63e-54e0af42aaf6","Type":"ContainerStarted","Data":"c649073a6415d3900983e4eb80fb0290c660462a0337aacd97da52910f4f365b"}
Jul 29 03:55:44.150018 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:44.149972    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9wnmq" podStartSLOduration=4.790309506 podStartE2EDuration="24.149959516s" totalImagesPullingTime="19.35965001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:44.14930096 +0000 UTC m=+24.744401678" watchObservedRunningTime="2026-07-29 03:55:44.149959516 +0000 UTC m=+24.745060227"
Jul 29 03:55:44.760419 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:44.760311    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T03:55:43.836420745Z","UUID":"9a78466d-ee91-4659-86d3-a92bc6405419","Handler":null,"Name":"","Endpoint":""}
Jul 29 03:55:44.761903 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:44.761880    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 03:55:44.762009 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:44.761924    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 03:55:44.862215 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:44.862190    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:44.862368 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:44.862328    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:44.862441 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:44.862376    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:44.862513 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:44.862476    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:45.139537 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:45.139279    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs" event={"ID":"ae0eacde-4b92-4561-a1dc-fe1ab6b65a7b","Type":"ContainerStarted","Data":"6e3e87e6cbf2fe22731c9a91f00919f2535a624d9f4d0abd4060dc46107affb4"}
Jul 29 03:55:45.156339 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:45.156291    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dgtjs" podStartSLOduration=3.691892201 podStartE2EDuration="25.156270622s" totalImagesPullingTime="21.464378421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:45.155997393 +0000 UTC m=+25.751098110" watchObservedRunningTime="2026-07-29 03:55:45.156270622 +0000 UTC m=+25.751371344"
Jul 29 03:55:45.861308 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:45.861275    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:45.861475 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:45.861404    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:46.145964 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:46.145882    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" event={"ID":"19f88fe4-8b8a-4843-b7e9-78b94997b7a2","Type":"ContainerStarted","Data":"9b90a17d71fe08297b86f107ff67ef37335c2f9366f3ce9d16df72080dd2f644"}
Jul 29 03:55:46.861344 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:46.861308    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:46.861344 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:46.861332    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:46.861610 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:46.861433    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:46.861668 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:46.861611    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:47.435794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:47.435720    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:47.437328 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:47.436644    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:47.774327 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:47.774140    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:47.774647 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:47.774628    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vhxjp"
Jul 29 03:55:47.865048 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:47.865014    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:47.865224 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:47.865133    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:48.154330 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:48.154240    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" event={"ID":"19f88fe4-8b8a-4843-b7e9-78b94997b7a2","Type":"ContainerStarted","Data":"8125b0226088e212c7076ef93ef2c4405cde4baeceac224a3eb130f07b4e2ff8"}
Jul 29 03:55:48.154486 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:48.154472    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:48.156247 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:48.156222    2573 generic.go:356] "Generic (PLEG): container finished" podID="6acb23dc-33eb-4cf7-840d-2ca5486146c4" containerID="491fe8b32bbb94e9939b82418baa6a84daa56c93b9ca4d4d8442ad15994539a9" exitCode=0
Jul 29 03:55:48.156365 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:48.156309    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbd2t" event={"ID":"6acb23dc-33eb-4cf7-840d-2ca5486146c4","Type":"ContainerDied","Data":"491fe8b32bbb94e9939b82418baa6a84daa56c93b9ca4d4d8442ad15994539a9"}
Jul 29 03:55:48.170935 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:48.170909    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:48.179935 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:48.179895    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr" podStartSLOduration=8.768330697 podStartE2EDuration="28.179881093s" totalImagesPullingTime="19.411550396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:48.179573752 +0000 UTC m=+28.774674470" watchObservedRunningTime="2026-07-29 03:55:48.179881093 +0000 UTC m=+28.774981810"
Jul 29 03:55:48.861877 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:48.861842    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:48.862376 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:48.861958    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:48.862376 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:48.862021    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:48.862376 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:48.862139    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:49.158578 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:49.158542    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:49.158933 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:49.158898    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:49.174906 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:49.174884    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:55:49.495136 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:49.495058    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dpx6b"]
Jul 29 03:55:49.495300 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:49.495194    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:49.495362 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:49.495304    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:49.498054 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:49.497944    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ljlpr"]
Jul 29 03:55:49.498195 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:49.498094    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:49.498261 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:49.498206    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:49.498759 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:49.498732    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7kj2v"]
Jul 29 03:55:49.498898 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:49.498831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:49.498948 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:49.498929    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:50.162657 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:50.162461    2573 generic.go:356] "Generic (PLEG): container finished" podID="6acb23dc-33eb-4cf7-840d-2ca5486146c4" containerID="fbdfa0a00e0a21c24f01be681501bbe53472c90861723a1b9f15c32e4cc410d5" exitCode=0
Jul 29 03:55:50.163022 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:50.162551    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbd2t" event={"ID":"6acb23dc-33eb-4cf7-840d-2ca5486146c4","Type":"ContainerDied","Data":"fbdfa0a00e0a21c24f01be681501bbe53472c90861723a1b9f15c32e4cc410d5"}
Jul 29 03:55:50.862184 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:50.862148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:50.862335 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:50.862242    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:50.862335 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:50.862249    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:50.862335 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:50.862269    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:50.862433 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:50.862350    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:50.862433 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:50.862420    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:52.169279 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:52.169245    2573 generic.go:356] "Generic (PLEG): container finished" podID="6acb23dc-33eb-4cf7-840d-2ca5486146c4" containerID="cd16d10bb527d4522a71e8d091379e115d57ede2eb3d392900a6f60eb221d257" exitCode=0
Jul 29 03:55:52.169814 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:52.169288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbd2t" event={"ID":"6acb23dc-33eb-4cf7-840d-2ca5486146c4","Type":"ContainerDied","Data":"cd16d10bb527d4522a71e8d091379e115d57ede2eb3d392900a6f60eb221d257"}
Jul 29 03:55:52.861825 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:52.861788    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:52.862021 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:52.861926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:52.862021 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:52.861932    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:52.862021 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:52.861966    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:52.862130 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:52.862061    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:52.862165 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:52.862148    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:53.572579 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:53.572541    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:53.572588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:53.572641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:53.572721    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:53.572727    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:53.572742    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:53.572754    2573 projected.go:196] Error preparing data for projected volume kube-api-access-wbq4g for pod openshift-network-diagnostics/network-check-target-7kj2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:53.572793    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g podName:a1db9c4e-5c70-4d96-8488-be0da392a46f nodeName:}" failed. No retries permitted until 2026-07-29 03:56:25.572776783 +0000 UTC m=+66.167877478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbq4g" (UniqueName: "kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g") pod "network-check-target-7kj2v" (UID: "a1db9c4e-5c70-4d96-8488-be0da392a46f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:53.572790    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:53.572810    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret podName:1d1a3a6f-876d-4412-92f6-4e350e665858 nodeName:}" failed. No retries permitted until 2026-07-29 03:56:25.572802133 +0000 UTC m=+66.167902831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret") pod "global-pull-secret-syncer-dpx6b" (UID: "1d1a3a6f-876d-4412-92f6-4e350e665858") : object "kube-system"/"original-pull-secret" not registered
Jul 29 03:55:53.573088 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:53.572855    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs podName:53f7820e-009f-49c0-8949-15f9a5a3ffc8 nodeName:}" failed. No retries permitted until 2026-07-29 03:56:25.572838606 +0000 UTC m=+66.167939300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs") pod "network-metrics-daemon-ljlpr" (UID: "53f7820e-009f-49c0-8949-15f9a5a3ffc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 03:55:54.862245 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:54.862179    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:54.862245 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:54.862232    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:54.862788 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:54.862352    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:54.862788 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:54.862375    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dpx6b" podUID="1d1a3a6f-876d-4412-92f6-4e350e665858"
Jul 29 03:55:54.862788 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:54.862464    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljlpr" podUID="53f7820e-009f-49c0-8949-15f9a5a3ffc8"
Jul 29 03:55:54.862788 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:54.862547    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kj2v" podUID="a1db9c4e-5c70-4d96-8488-be0da392a46f"
Jul 29 03:55:55.301368 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.301344    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-42.ec2.internal" event="NodeReady"
Jul 29 03:55:55.301575 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.301472    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 03:55:55.333723 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.333689    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b766cf96c-kkdg6"]
Jul 29 03:55:55.339338 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.339308    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.341889 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.341860    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 03:55:55.342091 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.342062    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wjq2b\""
Jul 29 03:55:55.342208 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.342132    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 03:55:55.342306 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.342288    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 03:55:55.344214 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.344194    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zn688"]
Jul 29 03:55:55.347919 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.347897    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wfn94"]
Jul 29 03:55:55.348010 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.347985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zn688"
Jul 29 03:55:55.348094 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.348071    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 03:55:55.352974 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.352854    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 03:55:55.354789 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.354758    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 03:55:55.354883 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.354791    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6rjhj\""
Jul 29 03:55:55.356876 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.356851    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 03:55:55.357546 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.357521    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b766cf96c-kkdg6"]
Jul 29 03:55:55.357632 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.357597    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.358336 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.358308    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zn688"]
Jul 29 03:55:55.359917 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.359898    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 03:55:55.360016 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.359955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fhgfp\""
Jul 29 03:55:55.360016 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.360004    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 03:55:55.365042 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.364983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wfn94"]
Jul 29 03:55:55.487042 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-registry-certificates\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.487042 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487052    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-bound-sa-token\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.487295 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4431ead-a5f9-413e-ae26-fc3641c64ac2-config-volume\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.487295 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4431ead-a5f9-413e-ae26-fc3641c64ac2-tmp-dir\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.487295 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-image-registry-private-configuration\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.487295 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487199    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-installation-pull-secrets\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.487295 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487222    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.487295 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.487565 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20f69360-1b6e-4e39-87ad-b8245146642c-ca-trust-extracted\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.487565 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487379    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rncf6\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-kube-api-access-rncf6\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.487565 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn9qq\" (UniqueName: \"kubernetes.io/projected/a4431ead-a5f9-413e-ae26-fc3641c64ac2-kube-api-access-bn9qq\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.487565 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c22599f-c126-482c-96d6-5ef54026c867-cert\") pod \"ingress-canary-zn688\" (UID: \"5c22599f-c126-482c-96d6-5ef54026c867\") " pod="openshift-ingress-canary/ingress-canary-zn688"
Jul 29 03:55:55.487565 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz9n6\" (UniqueName: \"kubernetes.io/projected/5c22599f-c126-482c-96d6-5ef54026c867-kube-api-access-nz9n6\") pod \"ingress-canary-zn688\" (UID: \"5c22599f-c126-482c-96d6-5ef54026c867\") " pod="openshift-ingress-canary/ingress-canary-zn688"
Jul 29 03:55:55.487565 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.487510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-trusted-ca\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.588382 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588291    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-registry-certificates\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.588382 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-bound-sa-token\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.588382 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4431ead-a5f9-413e-ae26-fc3641c64ac2-config-volume\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4431ead-a5f9-413e-ae26-fc3641c64ac2-tmp-dir\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-image-registry-private-configuration\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-installation-pull-secrets\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588591    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588623    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20f69360-1b6e-4e39-87ad-b8245146642c-ca-trust-extracted\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588648    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rncf6\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-kube-api-access-rncf6\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn9qq\" (UniqueName: \"kubernetes.io/projected/a4431ead-a5f9-413e-ae26-fc3641c64ac2-kube-api-access-bn9qq\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c22599f-c126-482c-96d6-5ef54026c867-cert\") pod \"ingress-canary-zn688\" (UID: \"5c22599f-c126-482c-96d6-5ef54026c867\") " pod="openshift-ingress-canary/ingress-canary-zn688"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9n6\" (UniqueName: \"kubernetes.io/projected/5c22599f-c126-482c-96d6-5ef54026c867-kube-api-access-nz9n6\") pod \"ingress-canary-zn688\" (UID: \"5c22599f-c126-482c-96d6-5ef54026c867\") " pod="openshift-ingress-canary/ingress-canary-zn688"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-trusted-ca\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:55.588802    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:55.588821    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b766cf96c-kkdg6: secret "image-registry-tls" not found
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.588843    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4431ead-a5f9-413e-ae26-fc3641c64ac2-tmp-dir\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.588930 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:55.588879    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls podName:20f69360-1b6e-4e39-87ad-b8245146642c nodeName:}" failed. No retries permitted until 2026-07-29 03:55:56.088860108 +0000 UTC m=+36.683960803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls") pod "image-registry-6b766cf96c-kkdg6" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c") : secret "image-registry-tls" not found
Jul 29 03:55:55.589640 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.589142    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4431ead-a5f9-413e-ae26-fc3641c64ac2-config-volume\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.589640 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:55.589209    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 03:55:55.589640 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:55.589282    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls podName:a4431ead-a5f9-413e-ae26-fc3641c64ac2 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:56.089263011 +0000 UTC m=+36.684363710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls") pod "dns-default-wfn94" (UID: "a4431ead-a5f9-413e-ae26-fc3641c64ac2") : secret "dns-default-metrics-tls" not found
Jul 29 03:55:55.589640 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.589355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20f69360-1b6e-4e39-87ad-b8245146642c-ca-trust-extracted\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.589830 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.589666    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-trusted-ca\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.589830 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.589739    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-registry-certificates\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.593823 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.593787    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-installation-pull-secrets\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.593823 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.593795    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c22599f-c126-482c-96d6-5ef54026c867-cert\") pod \"ingress-canary-zn688\" (UID: \"5c22599f-c126-482c-96d6-5ef54026c867\") " pod="openshift-ingress-canary/ingress-canary-zn688"
Jul 29 03:55:55.596922 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.596896    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-image-registry-private-configuration\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.597365 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.597344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn9qq\" (UniqueName: \"kubernetes.io/projected/a4431ead-a5f9-413e-ae26-fc3641c64ac2-kube-api-access-bn9qq\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:55.597926 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.597905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rncf6\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-kube-api-access-rncf6\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.598076 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.598052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-bound-sa-token\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:55.598863 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.598841    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9n6\" (UniqueName: \"kubernetes.io/projected/5c22599f-c126-482c-96d6-5ef54026c867-kube-api-access-nz9n6\") pod \"ingress-canary-zn688\" (UID: \"5c22599f-c126-482c-96d6-5ef54026c867\") " pod="openshift-ingress-canary/ingress-canary-zn688"
Jul 29 03:55:55.667846 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:55.667811    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zn688"
Jul 29 03:55:56.092354 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.092154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:56.092866 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:56.092337    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 03:55:56.092866 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:56.092536    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls podName:a4431ead-a5f9-413e-ae26-fc3641c64ac2 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:57.092483603 +0000 UTC m=+37.687584297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls") pod "dns-default-wfn94" (UID: "a4431ead-a5f9-413e-ae26-fc3641c64ac2") : secret "dns-default-metrics-tls" not found
Jul 29 03:55:56.092866 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.092425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:56.092866 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:56.092641    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 03:55:56.092866 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:56.092660    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b766cf96c-kkdg6: secret "image-registry-tls" not found
Jul 29 03:55:56.092866 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:56.092720    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls podName:20f69360-1b6e-4e39-87ad-b8245146642c nodeName:}" failed. No retries permitted until 2026-07-29 03:55:57.092704444 +0000 UTC m=+37.687805141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls") pod "image-registry-6b766cf96c-kkdg6" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c") : secret "image-registry-tls" not found
Jul 29 03:55:56.173305 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.173275    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zn688"]
Jul 29 03:55:56.179674 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:55:56.179642    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c22599f_c126_482c_96d6_5ef54026c867.slice/crio-86f9a74705a981654a5fd6fe824f195a06269f0f130980f622ba91df04086e45 WatchSource:0}: Error finding container 86f9a74705a981654a5fd6fe824f195a06269f0f130980f622ba91df04086e45: Status 404 returned error can't find the container with id 86f9a74705a981654a5fd6fe824f195a06269f0f130980f622ba91df04086e45
Jul 29 03:55:56.861447 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.861364    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:55:56.861447 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.861401    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:55:56.861703 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.861364    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:55:56.865675 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.865647    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 03:55:56.865795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.865675    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 03:55:56.865795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.865742    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-whxkd\""
Jul 29 03:55:56.865795 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.865659    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 03:55:56.865973 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.865858    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 03:55:56.865973 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:56.865881    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h8jgt\""
Jul 29 03:55:57.100560 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:57.100525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:57.101045 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:57.100600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:57.101045 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:57.100681    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 03:55:57.101045 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:57.100710    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 03:55:57.101045 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:57.100721    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b766cf96c-kkdg6: secret "image-registry-tls" not found
Jul 29 03:55:57.101045 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:57.100763    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls podName:a4431ead-a5f9-413e-ae26-fc3641c64ac2 nodeName:}" failed. No retries permitted until 2026-07-29 03:55:59.100742663 +0000 UTC m=+39.695843358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls") pod "dns-default-wfn94" (UID: "a4431ead-a5f9-413e-ae26-fc3641c64ac2") : secret "dns-default-metrics-tls" not found
Jul 29 03:55:57.101045 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:57.100782    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls podName:20f69360-1b6e-4e39-87ad-b8245146642c nodeName:}" failed. No retries permitted until 2026-07-29 03:55:59.100773932 +0000 UTC m=+39.695874628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls") pod "image-registry-6b766cf96c-kkdg6" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c") : secret "image-registry-tls" not found
Jul 29 03:55:57.182286 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:57.182171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zn688" event={"ID":"5c22599f-c126-482c-96d6-5ef54026c867","Type":"ContainerStarted","Data":"86f9a74705a981654a5fd6fe824f195a06269f0f130980f622ba91df04086e45"}
Jul 29 03:55:57.185423 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:57.185378    2573 generic.go:356] "Generic (PLEG): container finished" podID="6acb23dc-33eb-4cf7-840d-2ca5486146c4" containerID="e332560d68c50f2ac0f4f8d74dcc1bfa1a2edbc563109f83483585afac65e86e" exitCode=0
Jul 29 03:55:57.185423 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:57.185420    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbd2t" event={"ID":"6acb23dc-33eb-4cf7-840d-2ca5486146c4","Type":"ContainerDied","Data":"e332560d68c50f2ac0f4f8d74dcc1bfa1a2edbc563109f83483585afac65e86e"}
Jul 29 03:55:58.192607 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:58.192563    2573 generic.go:356] "Generic (PLEG): container finished" podID="6acb23dc-33eb-4cf7-840d-2ca5486146c4" containerID="263835ab76e60464a716802283cf1f15d6ac2ef2454c258c712b52807e5900ce" exitCode=0
Jul 29 03:55:58.193061 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:58.192613    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbd2t" event={"ID":"6acb23dc-33eb-4cf7-840d-2ca5486146c4","Type":"ContainerDied","Data":"263835ab76e60464a716802283cf1f15d6ac2ef2454c258c712b52807e5900ce"}
Jul 29 03:55:59.117708 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:59.117536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:55:59.117708 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:59.117704    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 03:55:59.117906 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:59.117733    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:55:59.117906 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:59.117762    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls podName:a4431ead-a5f9-413e-ae26-fc3641c64ac2 nodeName:}" failed. No retries permitted until 2026-07-29 03:56:03.117745911 +0000 UTC m=+43.712846606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls") pod "dns-default-wfn94" (UID: "a4431ead-a5f9-413e-ae26-fc3641c64ac2") : secret "dns-default-metrics-tls" not found
Jul 29 03:55:59.117906 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:59.117804    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 03:55:59.117906 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:59.117818    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b766cf96c-kkdg6: secret "image-registry-tls" not found
Jul 29 03:55:59.117906 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:55:59.117865    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls podName:20f69360-1b6e-4e39-87ad-b8245146642c nodeName:}" failed. No retries permitted until 2026-07-29 03:56:03.117850771 +0000 UTC m=+43.712951495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls") pod "image-registry-6b766cf96c-kkdg6" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c") : secret "image-registry-tls" not found
Jul 29 03:55:59.198128 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:59.198098    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbd2t" event={"ID":"6acb23dc-33eb-4cf7-840d-2ca5486146c4","Type":"ContainerStarted","Data":"59120f48c9d7d493f21002f846fcc00ea74ccb7dfe2b48e8ace1ebcf90fbb208"}
Jul 29 03:55:59.199509 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:59.199473    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zn688" event={"ID":"5c22599f-c126-482c-96d6-5ef54026c867","Type":"ContainerStarted","Data":"68411cc829b0b78aa7ddc225e4cb9b81d4c89400c523a352b86383344dab38bd"}
Jul 29 03:55:59.221417 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:59.221195    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cbd2t" podStartSLOduration=9.445754248 podStartE2EDuration="39.22118042s" totalImagesPullingTime="29.775426172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:59.22003895 +0000 UTC m=+39.815139666" watchObservedRunningTime="2026-07-29 03:55:59.22118042 +0000 UTC m=+39.816281128"
Jul 29 03:55:59.236715 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:55:59.236671    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zn688" podStartSLOduration=1.787449879 podStartE2EDuration="4.236659398s" totalImagesPullingTime="2.449209519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:55:59.23644524 +0000 UTC m=+39.831545958" watchObservedRunningTime="2026-07-29 03:55:59.236659398 +0000 UTC m=+39.831760115"
Jul 29 03:56:03.148647 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:03.148608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:56:03.149106 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:03.148676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:56:03.149106 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:03.148773    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 03:56:03.149106 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:03.148842    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls podName:a4431ead-a5f9-413e-ae26-fc3641c64ac2 nodeName:}" failed. No retries permitted until 2026-07-29 03:56:11.148827187 +0000 UTC m=+51.743927883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls") pod "dns-default-wfn94" (UID: "a4431ead-a5f9-413e-ae26-fc3641c64ac2") : secret "dns-default-metrics-tls" not found
Jul 29 03:56:03.149106 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:03.148776    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 03:56:03.149106 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:03.148883    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b766cf96c-kkdg6: secret "image-registry-tls" not found
Jul 29 03:56:03.149106 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:03.148929    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls podName:20f69360-1b6e-4e39-87ad-b8245146642c nodeName:}" failed. No retries permitted until 2026-07-29 03:56:11.148915344 +0000 UTC m=+51.744016038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls") pod "image-registry-6b766cf96c-kkdg6" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c") : secret "image-registry-tls" not found
Jul 29 03:56:03.935715 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:03.935681    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j"]
Jul 29 03:56:03.968247 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:03.968214    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j"]
Jul 29 03:56:03.968389 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:03.968309    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j"
Jul 29 03:56:03.971193 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:03.971175    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 29 03:56:03.971193 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:03.971188    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-g8562\""
Jul 29 03:56:03.972210 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:03.972192    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 29 03:56:04.055509 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.055468    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bffcq\" (UniqueName: \"kubernetes.io/projected/f37ecde0-0a5a-491c-a06d-da0087ac4de6-kube-api-access-bffcq\") pod \"migrator-6865c9967-cdz5j\" (UID: \"f37ecde0-0a5a-491c-a06d-da0087ac4de6\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j"
Jul 29 03:56:04.156660 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.156627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bffcq\" (UniqueName: \"kubernetes.io/projected/f37ecde0-0a5a-491c-a06d-da0087ac4de6-kube-api-access-bffcq\") pod \"migrator-6865c9967-cdz5j\" (UID: \"f37ecde0-0a5a-491c-a06d-da0087ac4de6\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j"
Jul 29 03:56:04.166092 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.166059    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bffcq\" (UniqueName: \"kubernetes.io/projected/f37ecde0-0a5a-491c-a06d-da0087ac4de6-kube-api-access-bffcq\") pod \"migrator-6865c9967-cdz5j\" (UID: \"f37ecde0-0a5a-491c-a06d-da0087ac4de6\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j"
Jul 29 03:56:04.277880 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.277852    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j"
Jul 29 03:56:04.416258 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.415360    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-78cj8"]
Jul 29 03:56:04.439279 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.439242    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-78cj8"]
Jul 29 03:56:04.439411 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.439348    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.442480 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.442456    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 03:56:04.443000 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.442976    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 03:56:04.443000 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.442996    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 03:56:04.443191 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.442986    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 03:56:04.443722 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.443703    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kz6jn\""
Jul 29 03:56:04.459506 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.459470    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-data-volume\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.459625 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.459543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.459625 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.459564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-crio-socket\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.459625 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.459586    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qkfq\" (UniqueName: \"kubernetes.io/projected/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-api-access-2qkfq\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.459625 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.459615    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.459625 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.459622    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j"]
Jul 29 03:56:04.463046 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:04.463025    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37ecde0_0a5a_491c_a06d_da0087ac4de6.slice/crio-51cf2a8aa91a3059871e8588bb17c20282d4354fd6dcaf00e6f589f7795e2b64 WatchSource:0}: Error finding container 51cf2a8aa91a3059871e8588bb17c20282d4354fd6dcaf00e6f589f7795e2b64: Status 404 returned error can't find the container with id 51cf2a8aa91a3059871e8588bb17c20282d4354fd6dcaf00e6f589f7795e2b64
Jul 29 03:56:04.560158 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.560075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-data-volume\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.560158 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.560110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.560158 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.560132    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-crio-socket\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.560158 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.560153    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qkfq\" (UniqueName: \"kubernetes.io/projected/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-api-access-2qkfq\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.560468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.560185    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.560468 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:04.560221    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 03:56:04.560468 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:04.560302    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm podName:2d3116ed-c1f9-44e5-a0e1-bb04654bec8a nodeName:}" failed. No retries permitted until 2026-07-29 03:56:05.060281667 +0000 UTC m=+45.655382380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-78cj8" (UID: "2d3116ed-c1f9-44e5-a0e1-bb04654bec8a") : configmap "kube-rbac-proxy" not found
Jul 29 03:56:04.560468 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:04.560327    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:04.560468 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:04.560378    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls podName:2d3116ed-c1f9-44e5-a0e1-bb04654bec8a nodeName:}" failed. No retries permitted until 2026-07-29 03:56:05.060362279 +0000 UTC m=+45.655462975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-78cj8" (UID: "2d3116ed-c1f9-44e5-a0e1-bb04654bec8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:04.560674 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.560470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-data-volume\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.560674 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.560533    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-crio-socket\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:04.569838 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:04.569811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qkfq\" (UniqueName: \"kubernetes.io/projected/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-api-access-2qkfq\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:05.064880 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:05.064845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:05.065049 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:05.064885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:05.065049 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:05.064965    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 03:56:05.065049 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:05.064978    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:05.065049 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:05.065031    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm podName:2d3116ed-c1f9-44e5-a0e1-bb04654bec8a nodeName:}" failed. No retries permitted until 2026-07-29 03:56:06.065014476 +0000 UTC m=+46.660115171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-78cj8" (UID: "2d3116ed-c1f9-44e5-a0e1-bb04654bec8a") : configmap "kube-rbac-proxy" not found
Jul 29 03:56:05.065049 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:05.065046    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls podName:2d3116ed-c1f9-44e5-a0e1-bb04654bec8a nodeName:}" failed. No retries permitted until 2026-07-29 03:56:06.065039214 +0000 UTC m=+46.660139909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-78cj8" (UID: "2d3116ed-c1f9-44e5-a0e1-bb04654bec8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:05.215377 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:05.215224    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j" event={"ID":"f37ecde0-0a5a-491c-a06d-da0087ac4de6","Type":"ContainerStarted","Data":"51cf2a8aa91a3059871e8588bb17c20282d4354fd6dcaf00e6f589f7795e2b64"}
Jul 29 03:56:06.073922 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.073890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:06.074175 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.073932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:06.074175 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:06.074033    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 03:56:06.074175 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:06.074055    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:06.074175 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:06.074118    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm podName:2d3116ed-c1f9-44e5-a0e1-bb04654bec8a nodeName:}" failed. No retries permitted until 2026-07-29 03:56:08.074093824 +0000 UTC m=+48.669194522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-78cj8" (UID: "2d3116ed-c1f9-44e5-a0e1-bb04654bec8a") : configmap "kube-rbac-proxy" not found
Jul 29 03:56:06.074175 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:06.074139    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls podName:2d3116ed-c1f9-44e5-a0e1-bb04654bec8a nodeName:}" failed. No retries permitted until 2026-07-29 03:56:08.074129778 +0000 UTC m=+48.669230477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-78cj8" (UID: "2d3116ed-c1f9-44e5-a0e1-bb04654bec8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:06.567308 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.567279    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hcr4b"]
Jul 29 03:56:06.583373 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.583350    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hcr4b"]
Jul 29 03:56:06.583522 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.583448    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.585955 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.585932    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 29 03:56:06.586068 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.586019    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 29 03:56:06.586068 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.586059    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 29 03:56:06.586668 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.586647    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-87pml_b8a1f3c3-4a4e-44b3-946c-336baafa6363/dns-node-resolver/0.log"
Jul 29 03:56:06.587428 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.587410    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 29 03:56:06.587428 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.587420    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dgl7k\""
Jul 29 03:56:06.678872 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.678841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f718721c-bca0-441f-b0a4-1695efebe3ab-signing-key\") pod \"service-ca-658d7b7c78-hcr4b\" (UID: \"f718721c-bca0-441f-b0a4-1695efebe3ab\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.678872 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.678874    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj5rd\" (UniqueName: \"kubernetes.io/projected/f718721c-bca0-441f-b0a4-1695efebe3ab-kube-api-access-wj5rd\") pod \"service-ca-658d7b7c78-hcr4b\" (UID: \"f718721c-bca0-441f-b0a4-1695efebe3ab\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.679081 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.678951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f718721c-bca0-441f-b0a4-1695efebe3ab-signing-cabundle\") pod \"service-ca-658d7b7c78-hcr4b\" (UID: \"f718721c-bca0-441f-b0a4-1695efebe3ab\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.779630 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.779596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f718721c-bca0-441f-b0a4-1695efebe3ab-signing-cabundle\") pod \"service-ca-658d7b7c78-hcr4b\" (UID: \"f718721c-bca0-441f-b0a4-1695efebe3ab\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.779796 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.779696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f718721c-bca0-441f-b0a4-1695efebe3ab-signing-key\") pod \"service-ca-658d7b7c78-hcr4b\" (UID: \"f718721c-bca0-441f-b0a4-1695efebe3ab\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.779796 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.779717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj5rd\" (UniqueName: \"kubernetes.io/projected/f718721c-bca0-441f-b0a4-1695efebe3ab-kube-api-access-wj5rd\") pod \"service-ca-658d7b7c78-hcr4b\" (UID: \"f718721c-bca0-441f-b0a4-1695efebe3ab\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.780227 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.780205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f718721c-bca0-441f-b0a4-1695efebe3ab-signing-cabundle\") pod \"service-ca-658d7b7c78-hcr4b\" (UID: \"f718721c-bca0-441f-b0a4-1695efebe3ab\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.782468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.782440    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f718721c-bca0-441f-b0a4-1695efebe3ab-signing-key\") pod \"service-ca-658d7b7c78-hcr4b\" (UID: \"f718721c-bca0-441f-b0a4-1695efebe3ab\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.788435 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.788416    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj5rd\" (UniqueName: \"kubernetes.io/projected/f718721c-bca0-441f-b0a4-1695efebe3ab-kube-api-access-wj5rd\") pod \"service-ca-658d7b7c78-hcr4b\" (UID: \"f718721c-bca0-441f-b0a4-1695efebe3ab\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:06.892250 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:06.892178    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b"
Jul 29 03:56:07.054630 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:07.054601    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hcr4b"]
Jul 29 03:56:07.057810 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:07.057778    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf718721c_bca0_441f_b0a4_1695efebe3ab.slice/crio-c7d6bad8d75ad9912a04ff01b704a5c6abd570b0ab777c479790944707c80a37 WatchSource:0}: Error finding container c7d6bad8d75ad9912a04ff01b704a5c6abd570b0ab777c479790944707c80a37: Status 404 returned error can't find the container with id c7d6bad8d75ad9912a04ff01b704a5c6abd570b0ab777c479790944707c80a37
Jul 29 03:56:07.224677 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:07.224576    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j" event={"ID":"f37ecde0-0a5a-491c-a06d-da0087ac4de6","Type":"ContainerStarted","Data":"f74936e5c30026b9ba25a53b634f1759bb9ecd7b81f31bb99ab1480afb5d877a"}
Jul 29 03:56:07.224829 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:07.224676    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j" event={"ID":"f37ecde0-0a5a-491c-a06d-da0087ac4de6","Type":"ContainerStarted","Data":"16ee337dd33a5f159c5408d56632cba84fa431e445216ed1e79e84c87ee40d20"}
Jul 29 03:56:07.225811 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:07.225789    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b" event={"ID":"f718721c-bca0-441f-b0a4-1695efebe3ab","Type":"ContainerStarted","Data":"c7d6bad8d75ad9912a04ff01b704a5c6abd570b0ab777c479790944707c80a37"}
Jul 29 03:56:07.240960 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:07.240918    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cdz5j" podStartSLOduration=2.418784556 podStartE2EDuration="4.240905448s" totalImagesPullingTime="1.822120892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:07.240465954 +0000 UTC m=+47.835566672" watchObservedRunningTime="2026-07-29 03:56:07.240905448 +0000 UTC m=+47.836006164"
Jul 29 03:56:07.588468 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:07.588439    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gngxn_70606c53-16eb-44ad-b366-bc17f813e97c/node-ca/0.log"
Jul 29 03:56:08.090640 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:08.090602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:08.090823 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:08.090658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:08.090823 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:08.090746    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 03:56:08.090823 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:08.090781    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:08.090823 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:08.090823    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm podName:2d3116ed-c1f9-44e5-a0e1-bb04654bec8a nodeName:}" failed. No retries permitted until 2026-07-29 03:56:12.090805077 +0000 UTC m=+52.685905777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-78cj8" (UID: "2d3116ed-c1f9-44e5-a0e1-bb04654bec8a") : configmap "kube-rbac-proxy" not found
Jul 29 03:56:08.091002 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:08.090843    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls podName:2d3116ed-c1f9-44e5-a0e1-bb04654bec8a nodeName:}" failed. No retries permitted until 2026-07-29 03:56:12.090833411 +0000 UTC m=+52.685934106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-78cj8" (UID: "2d3116ed-c1f9-44e5-a0e1-bb04654bec8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:08.587415 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:08.587389    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zn688_5c22599f-c126-482c-96d6-5ef54026c867/serve-healthcheck-canary/0.log"
Jul 29 03:56:08.787472 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:08.787439    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cdz5j_f37ecde0-0a5a-491c-a06d-da0087ac4de6/migrator/0.log"
Jul 29 03:56:08.986628 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:08.986562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cdz5j_f37ecde0-0a5a-491c-a06d-da0087ac4de6/graceful-termination/0.log"
Jul 29 03:56:09.232986 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:09.232950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b" event={"ID":"f718721c-bca0-441f-b0a4-1695efebe3ab","Type":"ContainerStarted","Data":"537729c5300806b6205e83e3b1e2da94f2d0c728fb4543334a0085077dc4da65"}
Jul 29 03:56:09.249438 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:09.249342    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-hcr4b" podStartSLOduration=1.236437975 podStartE2EDuration="3.249326254s" totalImagesPullingTime="2.012888279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:09.248628843 +0000 UTC m=+49.843729560" watchObservedRunningTime="2026-07-29 03:56:09.249326254 +0000 UTC m=+49.844426988"
Jul 29 03:56:11.217429 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:11.217396    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:56:11.217913 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:11.217822    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:56:11.217980 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:11.217907    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 03:56:11.218026 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:11.217997    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls podName:a4431ead-a5f9-413e-ae26-fc3641c64ac2 nodeName:}" failed. No retries permitted until 2026-07-29 03:56:27.217975245 +0000 UTC m=+67.813075945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls") pod "dns-default-wfn94" (UID: "a4431ead-a5f9-413e-ae26-fc3641c64ac2") : secret "dns-default-metrics-tls" not found
Jul 29 03:56:11.218086 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:11.218026    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 03:56:11.218086 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:11.218049    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b766cf96c-kkdg6: secret "image-registry-tls" not found
Jul 29 03:56:11.218179 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:11.218124    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls podName:20f69360-1b6e-4e39-87ad-b8245146642c nodeName:}" failed. No retries permitted until 2026-07-29 03:56:27.21810498 +0000 UTC m=+67.813205677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls") pod "image-registry-6b766cf96c-kkdg6" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c") : secret "image-registry-tls" not found
Jul 29 03:56:12.124809 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:12.124776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:12.124809 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:12.124817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:12.125096 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:12.124960    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:12.125096 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:12.125034    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls podName:2d3116ed-c1f9-44e5-a0e1-bb04654bec8a nodeName:}" failed. No retries permitted until 2026-07-29 03:56:20.125017047 +0000 UTC m=+60.720117743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-78cj8" (UID: "2d3116ed-c1f9-44e5-a0e1-bb04654bec8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 03:56:12.125434 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:12.125409    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:20.191416 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:20.191375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:20.193829 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:20.193791    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d3116ed-c1f9-44e5-a0e1-bb04654bec8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-78cj8\" (UID: \"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a\") " pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:20.351629 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:20.351594    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kz6jn\""
Jul 29 03:56:20.359783 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:20.359762    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-78cj8"
Jul 29 03:56:20.488426 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:20.488400    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-78cj8"]
Jul 29 03:56:20.490427 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:20.490398    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3116ed_c1f9_44e5_a0e1_bb04654bec8a.slice/crio-5f28f4aa99d491267dca87a5d647e7ede98b42d601dce9b7dcef527900d8b90a WatchSource:0}: Error finding container 5f28f4aa99d491267dca87a5d647e7ede98b42d601dce9b7dcef527900d8b90a: Status 404 returned error can't find the container with id 5f28f4aa99d491267dca87a5d647e7ede98b42d601dce9b7dcef527900d8b90a
Jul 29 03:56:21.180075 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:21.180040    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mntmr"
Jul 29 03:56:21.263705 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:21.263629    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-78cj8" event={"ID":"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a","Type":"ContainerStarted","Data":"5f28f4aa99d491267dca87a5d647e7ede98b42d601dce9b7dcef527900d8b90a"}
Jul 29 03:56:25.639822 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.639732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:56:25.639822 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.639780    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:56:25.639822 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.639828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:56:25.642739 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.642709    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 03:56:25.643810 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.643794    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 03:56:25.643865 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.643793    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 03:56:25.653345 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.653319    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 03:56:25.653469 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.653390    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d1a3a6f-876d-4412-92f6-4e350e665858-original-pull-secret\") pod \"global-pull-secret-syncer-dpx6b\" (UID: \"1d1a3a6f-876d-4412-92f6-4e350e665858\") " pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:56:25.653469 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.653422    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f7820e-009f-49c0-8949-15f9a5a3ffc8-metrics-certs\") pod \"network-metrics-daemon-ljlpr\" (UID: \"53f7820e-009f-49c0-8949-15f9a5a3ffc8\") " pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:56:25.663684 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.663662    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbq4g\" (UniqueName: \"kubernetes.io/projected/a1db9c4e-5c70-4d96-8488-be0da392a46f-kube-api-access-wbq4g\") pod \"network-check-target-7kj2v\" (UID: \"a1db9c4e-5c70-4d96-8488-be0da392a46f\") " pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:56:25.676980 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.676960    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h8jgt\""
Jul 29 03:56:25.682171 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.682153    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dpx6b"
Jul 29 03:56:25.685291 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.685275    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:56:25.689821 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.689807    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-whxkd\""
Jul 29 03:56:25.697921 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.697909    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljlpr"
Jul 29 03:56:25.841572 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.841545    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dpx6b"]
Jul 29 03:56:25.844275 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:25.844221    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1a3a6f_876d_4412_92f6_4e350e665858.slice/crio-1effccf11533add4e9d929a2c26b41ee120f189b45433132e68f17324c0245e4 WatchSource:0}: Error finding container 1effccf11533add4e9d929a2c26b41ee120f189b45433132e68f17324c0245e4: Status 404 returned error can't find the container with id 1effccf11533add4e9d929a2c26b41ee120f189b45433132e68f17324c0245e4
Jul 29 03:56:25.887192 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.887150    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7kj2v"]
Jul 29 03:56:25.890475 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:25.890416    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1db9c4e_5c70_4d96_8488_be0da392a46f.slice/crio-c008b9efc9bc9366d2e43386b94644cfe9505f593db1aeb4cd44e6c668e1e2ff WatchSource:0}: Error finding container c008b9efc9bc9366d2e43386b94644cfe9505f593db1aeb4cd44e6c668e1e2ff: Status 404 returned error can't find the container with id c008b9efc9bc9366d2e43386b94644cfe9505f593db1aeb4cd44e6c668e1e2ff
Jul 29 03:56:25.913398 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:25.913364    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ljlpr"]
Jul 29 03:56:25.917541 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:25.917469    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f7820e_009f_49c0_8949_15f9a5a3ffc8.slice/crio-8e06adc25c20c659b3529982e6ac7092289884236d59ab22cb470407dcd41721 WatchSource:0}: Error finding container 8e06adc25c20c659b3529982e6ac7092289884236d59ab22cb470407dcd41721: Status 404 returned error can't find the container with id 8e06adc25c20c659b3529982e6ac7092289884236d59ab22cb470407dcd41721
Jul 29 03:56:26.279918 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.279763    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-78cj8" event={"ID":"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a","Type":"ContainerStarted","Data":"f63dcdbdda4694e8389543693a9be196884de3078a97fb3648e9aaf2b70b7f59"}
Jul 29 03:56:26.281177 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.281106    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljlpr" event={"ID":"53f7820e-009f-49c0-8949-15f9a5a3ffc8","Type":"ContainerStarted","Data":"8e06adc25c20c659b3529982e6ac7092289884236d59ab22cb470407dcd41721"}
Jul 29 03:56:26.282476 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.282450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7kj2v" event={"ID":"a1db9c4e-5c70-4d96-8488-be0da392a46f","Type":"ContainerStarted","Data":"c008b9efc9bc9366d2e43386b94644cfe9505f593db1aeb4cd44e6c668e1e2ff"}
Jul 29 03:56:26.283854 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.283834    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dpx6b" event={"ID":"1d1a3a6f-876d-4412-92f6-4e350e665858","Type":"ContainerStarted","Data":"1effccf11533add4e9d929a2c26b41ee120f189b45433132e68f17324c0245e4"}
Jul 29 03:56:26.834723 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.834684    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"]
Jul 29 03:56:26.859792 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.859761    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"]
Jul 29 03:56:26.861238 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.860459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:26.865198 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.864971    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 03:56:26.865198 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.865026    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 03:56:26.867340 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.866960    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 29 03:56:26.867340 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.866960    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 03:56:26.874397 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.873960    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"]
Jul 29 03:56:26.874397 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.874008    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"]
Jul 29 03:56:26.874397 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.874113    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:26.878109 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.878088    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 29 03:56:26.878428 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.878405    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 29 03:56:26.878697 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.878676    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 29 03:56:26.878765 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.878688    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 29 03:56:26.914398 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.914336    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b766cf96c-kkdg6"]
Jul 29 03:56:26.914609 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:26.914577    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6" podUID="20f69360-1b6e-4e39-87ad-b8245146642c"
Jul 29 03:56:26.953930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.953444    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:26.953930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.953523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cffae3e-a446-4cb9-a6cd-0a78fc855920-tmp\") pod \"klusterlet-addon-workmgr-6dc7b4f9cc-6trhz\" (UID: \"2cffae3e-a446-4cb9-a6cd-0a78fc855920\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:26.953930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.953565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-hub\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:26.953930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.953612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssmb\" (UniqueName: \"kubernetes.io/projected/2cffae3e-a446-4cb9-a6cd-0a78fc855920-kube-api-access-2ssmb\") pod \"klusterlet-addon-workmgr-6dc7b4f9cc-6trhz\" (UID: \"2cffae3e-a446-4cb9-a6cd-0a78fc855920\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:26.953930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.953657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:26.953930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.953684    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2cffae3e-a446-4cb9-a6cd-0a78fc855920-klusterlet-config\") pod \"klusterlet-addon-workmgr-6dc7b4f9cc-6trhz\" (UID: \"2cffae3e-a446-4cb9-a6cd-0a78fc855920\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:26.953930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.953701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7bp6\" (UniqueName: \"kubernetes.io/projected/c46ea488-1528-4b6a-b642-61607eceacfb-kube-api-access-c7bp6\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:26.953930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.953746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-ca\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:26.953930 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:26.953781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c46ea488-1528-4b6a-b642-61607eceacfb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.023517 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.022433    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-669f6f8b9f-6k9bf"]
Jul 29 03:56:27.044360 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.044326    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-669f6f8b9f-6k9bf"]
Jul 29 03:56:27.044551 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.044452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.054622 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.054383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c46ea488-1528-4b6a-b642-61607eceacfb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.054622 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.054423    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.054622 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.054455    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cffae3e-a446-4cb9-a6cd-0a78fc855920-tmp\") pod \"klusterlet-addon-workmgr-6dc7b4f9cc-6trhz\" (UID: \"2cffae3e-a446-4cb9-a6cd-0a78fc855920\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:27.054622 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.054522    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-hub\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.054622 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.054584    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssmb\" (UniqueName: \"kubernetes.io/projected/2cffae3e-a446-4cb9-a6cd-0a78fc855920-kube-api-access-2ssmb\") pod \"klusterlet-addon-workmgr-6dc7b4f9cc-6trhz\" (UID: \"2cffae3e-a446-4cb9-a6cd-0a78fc855920\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:27.055631 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.055397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cffae3e-a446-4cb9-a6cd-0a78fc855920-tmp\") pod \"klusterlet-addon-workmgr-6dc7b4f9cc-6trhz\" (UID: \"2cffae3e-a446-4cb9-a6cd-0a78fc855920\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:27.055912 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.055784    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c46ea488-1528-4b6a-b642-61607eceacfb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.055912 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.055844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.057128 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.055886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2cffae3e-a446-4cb9-a6cd-0a78fc855920-klusterlet-config\") pod \"klusterlet-addon-workmgr-6dc7b4f9cc-6trhz\" (UID: \"2cffae3e-a446-4cb9-a6cd-0a78fc855920\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:27.057128 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.056744    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7bp6\" (UniqueName: \"kubernetes.io/projected/c46ea488-1528-4b6a-b642-61607eceacfb-kube-api-access-c7bp6\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.057128 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.056800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-ca\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.062879 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.060187    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2cffae3e-a446-4cb9-a6cd-0a78fc855920-klusterlet-config\") pod \"klusterlet-addon-workmgr-6dc7b4f9cc-6trhz\" (UID: \"2cffae3e-a446-4cb9-a6cd-0a78fc855920\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:27.062879 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.060465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.062879 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.061434    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-ca\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.062879 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.061985    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-hub\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.062879 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.061999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c46ea488-1528-4b6a-b642-61607eceacfb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.070030 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.069993    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssmb\" (UniqueName: \"kubernetes.io/projected/2cffae3e-a446-4cb9-a6cd-0a78fc855920-kube-api-access-2ssmb\") pod \"klusterlet-addon-workmgr-6dc7b4f9cc-6trhz\" (UID: \"2cffae3e-a446-4cb9-a6cd-0a78fc855920\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:27.071017 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.070975    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7bp6\" (UniqueName: \"kubernetes.io/projected/c46ea488-1528-4b6a-b642-61607eceacfb-kube-api-access-c7bp6\") pod \"cluster-proxy-proxy-agent-5d778c99d5-65rmj\" (UID: \"c46ea488-1528-4b6a-b642-61607eceacfb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.157802 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.157724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785da88f-b9f3-4f53-bf60-1c218ca9edfb-registry-certificates\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.157802 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.157781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785da88f-b9f3-4f53-bf60-1c218ca9edfb-installation-pull-secrets\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.158008 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.157853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sxmw\" (UniqueName: \"kubernetes.io/projected/785da88f-b9f3-4f53-bf60-1c218ca9edfb-kube-api-access-6sxmw\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.158008 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.157892    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785da88f-b9f3-4f53-bf60-1c218ca9edfb-trusted-ca\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.158008 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.157921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785da88f-b9f3-4f53-bf60-1c218ca9edfb-image-registry-private-configuration\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.158008 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.157954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785da88f-b9f3-4f53-bf60-1c218ca9edfb-bound-sa-token\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.158008 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.157971    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785da88f-b9f3-4f53-bf60-1c218ca9edfb-registry-tls\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.158008 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.157995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785da88f-b9f3-4f53-bf60-1c218ca9edfb-ca-trust-extracted\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.177271 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.177237    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:27.197396 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.197372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"
Jul 29 03:56:27.258699 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:56:27.258699 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sxmw\" (UniqueName: \"kubernetes.io/projected/785da88f-b9f3-4f53-bf60-1c218ca9edfb-kube-api-access-6sxmw\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.258906 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785da88f-b9f3-4f53-bf60-1c218ca9edfb-trusted-ca\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.258906 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785da88f-b9f3-4f53-bf60-1c218ca9edfb-image-registry-private-configuration\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.258906 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785da88f-b9f3-4f53-bf60-1c218ca9edfb-bound-sa-token\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.258906 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258830    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785da88f-b9f3-4f53-bf60-1c218ca9edfb-registry-tls\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.258906 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785da88f-b9f3-4f53-bf60-1c218ca9edfb-ca-trust-extracted\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.258906 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785da88f-b9f3-4f53-bf60-1c218ca9edfb-registry-certificates\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.259287 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785da88f-b9f3-4f53-bf60-1c218ca9edfb-installation-pull-secrets\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.259287 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.258957    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:56:27.260275 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.260245    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785da88f-b9f3-4f53-bf60-1c218ca9edfb-ca-trust-extracted\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.260520 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.260478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785da88f-b9f3-4f53-bf60-1c218ca9edfb-trusted-ca\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.260759 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.260733    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785da88f-b9f3-4f53-bf60-1c218ca9edfb-registry-certificates\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.263957 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.263933    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4431ead-a5f9-413e-ae26-fc3641c64ac2-metrics-tls\") pod \"dns-default-wfn94\" (UID: \"a4431ead-a5f9-413e-ae26-fc3641c64ac2\") " pod="openshift-dns/dns-default-wfn94"
Jul 29 03:56:27.266049 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.265924    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785da88f-b9f3-4f53-bf60-1c218ca9edfb-image-registry-private-configuration\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.266049 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.265948    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785da88f-b9f3-4f53-bf60-1c218ca9edfb-registry-tls\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.266327 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.266283    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"image-registry-6b766cf96c-kkdg6\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") " pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:56:27.267629 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.267586    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785da88f-b9f3-4f53-bf60-1c218ca9edfb-installation-pull-secrets\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.269456 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.269417    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sxmw\" (UniqueName: \"kubernetes.io/projected/785da88f-b9f3-4f53-bf60-1c218ca9edfb-kube-api-access-6sxmw\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.270231 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.270193    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785da88f-b9f3-4f53-bf60-1c218ca9edfb-bound-sa-token\") pod \"image-registry-669f6f8b9f-6k9bf\" (UID: \"785da88f-b9f3-4f53-bf60-1c218ca9edfb\") " pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.287471 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.287446    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:56:27.295072 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.295043    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:56:27.360140 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.360106    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wjq2b\""
Jul 29 03:56:27.367197 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.367172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.459702    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-registry-certificates\") pod \"20f69360-1b6e-4e39-87ad-b8245146642c\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") "
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.459750    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rncf6\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-kube-api-access-rncf6\") pod \"20f69360-1b6e-4e39-87ad-b8245146642c\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") "
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.459784    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-bound-sa-token\") pod \"20f69360-1b6e-4e39-87ad-b8245146642c\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") "
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.459808    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20f69360-1b6e-4e39-87ad-b8245146642c-ca-trust-extracted\") pod \"20f69360-1b6e-4e39-87ad-b8245146642c\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") "
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.459844    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-installation-pull-secrets\") pod \"20f69360-1b6e-4e39-87ad-b8245146642c\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") "
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.459879    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-trusted-ca\") pod \"20f69360-1b6e-4e39-87ad-b8245146642c\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") "
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.459911    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") pod \"20f69360-1b6e-4e39-87ad-b8245146642c\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") "
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.459960    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-image-registry-private-configuration\") pod \"20f69360-1b6e-4e39-87ad-b8245146642c\" (UID: \"20f69360-1b6e-4e39-87ad-b8245146642c\") "
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.460085    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "20f69360-1b6e-4e39-87ad-b8245146642c" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.460163    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-registry-certificates\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 03:56:27.460458 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.460448    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f69360-1b6e-4e39-87ad-b8245146642c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "20f69360-1b6e-4e39-87ad-b8245146642c" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:56:27.460964 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.460603    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "20f69360-1b6e-4e39-87ad-b8245146642c" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:56:27.462843 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.462799    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-kube-api-access-rncf6" (OuterVolumeSpecName: "kube-api-access-rncf6") pod "20f69360-1b6e-4e39-87ad-b8245146642c" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c"). InnerVolumeSpecName "kube-api-access-rncf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:56:27.463054 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.463030    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "20f69360-1b6e-4e39-87ad-b8245146642c" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:56:27.464009 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.463966    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "20f69360-1b6e-4e39-87ad-b8245146642c" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:56:27.464866 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.464833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "20f69360-1b6e-4e39-87ad-b8245146642c" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:56:27.464960 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.464875    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "20f69360-1b6e-4e39-87ad-b8245146642c" (UID: "20f69360-1b6e-4e39-87ad-b8245146642c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:56:27.476320 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.476298    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fhgfp\""
Jul 29 03:56:27.483830 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.483637    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wfn94"
Jul 29 03:56:27.560717 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.560685    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rncf6\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-kube-api-access-rncf6\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 03:56:27.560717 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.560719    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-bound-sa-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 03:56:27.560933 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.560739    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20f69360-1b6e-4e39-87ad-b8245146642c-ca-trust-extracted\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 03:56:27.560933 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.560754    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-installation-pull-secrets\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 03:56:27.560933 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.560768    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20f69360-1b6e-4e39-87ad-b8245146642c-trusted-ca\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 03:56:27.560933 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.560781    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20f69360-1b6e-4e39-87ad-b8245146642c-registry-tls\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 03:56:27.560933 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:27.560795    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20f69360-1b6e-4e39-87ad-b8245146642c-image-registry-private-configuration\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 03:56:28.290970 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:28.290301    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b766cf96c-kkdg6"
Jul 29 03:56:28.335555 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:28.335511    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b766cf96c-kkdg6"]
Jul 29 03:56:28.342959 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:28.342933    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b766cf96c-kkdg6"]
Jul 29 03:56:29.140316 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:29.140209    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj"]
Jul 29 03:56:29.871594 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:29.871549    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20f69360-1b6e-4e39-87ad-b8245146642c" path="/var/lib/kubelet/pods/20f69360-1b6e-4e39-87ad-b8245146642c/volumes"
Jul 29 03:56:31.411222 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:31.411183    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc46ea488_1528_4b6a_b642_61607eceacfb.slice/crio-cd43bfce0a2ef998cd3f989af937284ed61844a688b11f589f95db9c72d4e625 WatchSource:0}: Error finding container cd43bfce0a2ef998cd3f989af937284ed61844a688b11f589f95db9c72d4e625: Status 404 returned error can't find the container with id cd43bfce0a2ef998cd3f989af937284ed61844a688b11f589f95db9c72d4e625
Jul 29 03:56:31.545426 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:31.545392    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-669f6f8b9f-6k9bf"]
Jul 29 03:56:31.560874 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:31.560847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"]
Jul 29 03:56:32.037898 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:32.037857    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785da88f_b9f3_4f53_bf60_1c218ca9edfb.slice/crio-b2339d6681ace7f931989bbda478c5cbe3d8ee938fd886beeb818cf8f1648900 WatchSource:0}: Error finding container b2339d6681ace7f931989bbda478c5cbe3d8ee938fd886beeb818cf8f1648900: Status 404 returned error can't find the container with id b2339d6681ace7f931989bbda478c5cbe3d8ee938fd886beeb818cf8f1648900
Jul 29 03:56:32.122799 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:32.122759    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cffae3e_a446_4cb9_a6cd_0a78fc855920.slice/crio-498fa1a8261363d64a35f84dac437f386de9fb4024011b6ce07d719576b0a7d1 WatchSource:0}: Error finding container 498fa1a8261363d64a35f84dac437f386de9fb4024011b6ce07d719576b0a7d1: Status 404 returned error can't find the container with id 498fa1a8261363d64a35f84dac437f386de9fb4024011b6ce07d719576b0a7d1
Jul 29 03:56:32.303174 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.303150    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wfn94"]
Jul 29 03:56:32.316188 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:32.316038    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4431ead_a5f9_413e_ae26_fc3641c64ac2.slice/crio-b18c309f6eaeab0a5a440cf751d7fb48511970514410af2d31fe164db7f64755 WatchSource:0}: Error finding container b18c309f6eaeab0a5a440cf751d7fb48511970514410af2d31fe164db7f64755: Status 404 returned error can't find the container with id b18c309f6eaeab0a5a440cf751d7fb48511970514410af2d31fe164db7f64755
Jul 29 03:56:32.327006 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.326468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf" event={"ID":"785da88f-b9f3-4f53-bf60-1c218ca9edfb","Type":"ContainerStarted","Data":"bdbe346879a40aeedf149cff20d9a17e309cc8165694da173f0d964b2b765132"}
Jul 29 03:56:32.327121 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.327044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf" event={"ID":"785da88f-b9f3-4f53-bf60-1c218ca9edfb","Type":"ContainerStarted","Data":"b2339d6681ace7f931989bbda478c5cbe3d8ee938fd886beeb818cf8f1648900"}
Jul 29 03:56:32.327254 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.327234    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:32.330303 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.330242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz" event={"ID":"2cffae3e-a446-4cb9-a6cd-0a78fc855920","Type":"ContainerStarted","Data":"498fa1a8261363d64a35f84dac437f386de9fb4024011b6ce07d719576b0a7d1"}
Jul 29 03:56:32.335331 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.335247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljlpr" event={"ID":"53f7820e-009f-49c0-8949-15f9a5a3ffc8","Type":"ContainerStarted","Data":"00b4c655842a861e05b2fad0f7e4d4073714114bce7b594fa4252e8490259f6b"}
Jul 29 03:56:32.340826 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.340274    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7kj2v" event={"ID":"a1db9c4e-5c70-4d96-8488-be0da392a46f","Type":"ContainerStarted","Data":"424d2839fdb0a739a6b692221a2c7986a21b194a423bca856b59c25d311e2cd6"}
Jul 29 03:56:32.340826 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.340771    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:56:32.342381 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.342333    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj" event={"ID":"c46ea488-1528-4b6a-b642-61607eceacfb","Type":"ContainerStarted","Data":"cd43bfce0a2ef998cd3f989af937284ed61844a688b11f589f95db9c72d4e625"}
Jul 29 03:56:32.354868 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.352899    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf" podStartSLOduration=5.352881541 podStartE2EDuration="5.352881541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:32.350614587 +0000 UTC m=+72.945715305" watchObservedRunningTime="2026-07-29 03:56:32.352881541 +0000 UTC m=+72.947982256"
Jul 29 03:56:32.370542 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:32.370472    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7kj2v" podStartSLOduration=66.138028281 podStartE2EDuration="1m12.37045637s" totalImagesPullingTime="6.232428089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:32.369835002 +0000 UTC m=+72.964935717" watchObservedRunningTime="2026-07-29 03:56:32.37045637 +0000 UTC m=+72.965557064"
Jul 29 03:56:33.354812 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:33.354731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-78cj8" event={"ID":"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a","Type":"ContainerStarted","Data":"f46e22e8a2db661156eadda8e961b5fe0f7f5fdd40542f2a7006acf7ccee68eb"}
Jul 29 03:56:33.359769 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:33.359255    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljlpr" event={"ID":"53f7820e-009f-49c0-8949-15f9a5a3ffc8","Type":"ContainerStarted","Data":"f15500609603a0228de4cd386c570062b3abc072b25647e3cdd09300535cb4dc"}
Jul 29 03:56:33.362049 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:33.362023    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wfn94" event={"ID":"a4431ead-a5f9-413e-ae26-fc3641c64ac2","Type":"ContainerStarted","Data":"b18c309f6eaeab0a5a440cf751d7fb48511970514410af2d31fe164db7f64755"}
Jul 29 03:56:33.365074 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:33.365049    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dpx6b" event={"ID":"1d1a3a6f-876d-4412-92f6-4e350e665858","Type":"ContainerStarted","Data":"a07a6849a0ce784294a625d6aafe2218fc5c89615fe04db59b0c7428a1fd85ce"}
Jul 29 03:56:33.421144 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:33.421066    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ljlpr" podStartSLOduration=67.217610002 podStartE2EDuration="1m13.421046892s" totalImagesPullingTime="6.20343689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:33.3986465 +0000 UTC m=+73.993747221" watchObservedRunningTime="2026-07-29 03:56:33.421046892 +0000 UTC m=+74.016147612"
Jul 29 03:56:33.421403 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:33.421371    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dpx6b" podStartSLOduration=67.143603004 podStartE2EDuration="1m13.42136177s" totalImagesPullingTime="6.277758766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:33.419876075 +0000 UTC m=+74.014976803" watchObservedRunningTime="2026-07-29 03:56:33.42136177 +0000 UTC m=+74.016462467"
Jul 29 03:56:40.395307 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.395165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wfn94" event={"ID":"a4431ead-a5f9-413e-ae26-fc3641c64ac2","Type":"ContainerStarted","Data":"b4d40c51f0d399bd5a6eb170fcbaa067b529350cda387d9a1389524eb1bd7e0d"}
Jul 29 03:56:40.395307 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.395226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wfn94" event={"ID":"a4431ead-a5f9-413e-ae26-fc3641c64ac2","Type":"ContainerStarted","Data":"81c017405e619ee7c38a4d2d599e3af5ad79c8ec0d005cf0a84554474d4ad3b4"}
Jul 29 03:56:40.395307 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.395256    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wfn94"
Jul 29 03:56:40.396655 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.396625    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz" event={"ID":"2cffae3e-a446-4cb9-a6cd-0a78fc855920","Type":"ContainerStarted","Data":"9eae0db4bfc4a0cd283eff8b6cfe316294b1525571e5225a7e83abaf16463ae8"}
Jul 29 03:56:40.396802 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.396782    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:40.398715 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.398694    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz"
Jul 29 03:56:40.398902 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.398884    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-78cj8" event={"ID":"2d3116ed-c1f9-44e5-a0e1-bb04654bec8a","Type":"ContainerStarted","Data":"c6089cef2cd11e5ea078dc072d4021da681185676bf98c3a164019f236ad99fb"}
Jul 29 03:56:40.400892 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.400875    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj" event={"ID":"c46ea488-1528-4b6a-b642-61607eceacfb","Type":"ContainerStarted","Data":"0e0ddd9f4a2ff06e432dc61cd57ae03c8266d932fbb6a38f8107b786d910518f"}
Jul 29 03:56:40.401003 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.400899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj" event={"ID":"c46ea488-1528-4b6a-b642-61607eceacfb","Type":"ContainerStarted","Data":"a55137cac6eae557e0936c1a9b15016a29eff7985143b66983bfc205a3bc5f8e"}
Jul 29 03:56:40.401003 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.400912    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj" event={"ID":"c46ea488-1528-4b6a-b642-61607eceacfb","Type":"ContainerStarted","Data":"94b1116eb5a8400f61bc24cf7897d995664b820466fe8bf41519cb2d7a1cae28"}
Jul 29 03:56:40.413309 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.413273    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wfn94" podStartSLOduration=38.142075438 podStartE2EDuration="45.413262018s" totalImagesPullingTime="7.27118658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:40.411942232 +0000 UTC m=+81.007042948" watchObservedRunningTime="2026-07-29 03:56:40.413262018 +0000 UTC m=+81.008362738"
Jul 29 03:56:40.429351 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.429295    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-78cj8" podStartSLOduration=17.510818729 podStartE2EDuration="36.429278045s" totalImagesPullingTime="18.918459316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:56:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:40.428298134 +0000 UTC m=+81.023398851" watchObservedRunningTime="2026-07-29 03:56:40.429278045 +0000 UTC m=+81.024378765"
Jul 29 03:56:40.461323 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.461284    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc7b4f9cc-6trhz" podStartSLOduration=6.969714713 podStartE2EDuration="14.461273197s" totalImagesPullingTime="7.491558484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:40.442943599 +0000 UTC m=+81.038044317" watchObservedRunningTime="2026-07-29 03:56:40.461273197 +0000 UTC m=+81.056373915"
Jul 29 03:56:40.461672 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:40.461651    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d778c99d5-65rmj" podStartSLOduration=6.306279516 podStartE2EDuration="14.461644414s" totalImagesPullingTime="8.155364898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:40.460898197 +0000 UTC m=+81.055998915" watchObservedRunningTime="2026-07-29 03:56:40.461644414 +0000 UTC m=+81.056745130"
Jul 29 03:56:47.371459 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:47.371424    2573 patch_prober.go:28] interesting pod/image-registry-669f6f8b9f-6k9bf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 03:56:47.371950 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:47.371480    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf" podUID="785da88f-b9f3-4f53-bf60-1c218ca9edfb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 03:56:50.407100 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.407072    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wfn94"
Jul 29 03:56:50.515505 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.515452    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h7gpj"]
Jul 29 03:56:50.521142 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.521118    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.523565 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.523545    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 03:56:50.523853 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.523820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 03:56:50.524048 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.523999    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 03:56:50.524150 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.524080    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 03:56:50.524150 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.524143    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b4bvh\""
Jul 29 03:56:50.524264 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.524217    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 03:56:50.524354 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.524337    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 03:56:50.532675 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.532653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-textfile\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.532794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.532691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cad02e15-5bf6-46a1-9f28-96641bd71cf4-root\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.532794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.532721    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-wtmp\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.532794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.532748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-tls\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.532794 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.532771    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cad02e15-5bf6-46a1-9f28-96641bd71cf4-metrics-client-ca\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.533001 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.532795    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.533001 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.532875    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gspph\" (UniqueName: \"kubernetes.io/projected/cad02e15-5bf6-46a1-9f28-96641bd71cf4-kube-api-access-gspph\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.533001 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.532917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cad02e15-5bf6-46a1-9f28-96641bd71cf4-sys\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.533001 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.532977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.633691 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.633653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-wtmp\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.633691 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.633699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-tls\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.633943 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.633727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cad02e15-5bf6-46a1-9f28-96641bd71cf4-metrics-client-ca\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.633943 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.633795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.633943 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.633833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gspph\" (UniqueName: \"kubernetes.io/projected/cad02e15-5bf6-46a1-9f28-96641bd71cf4-kube-api-access-gspph\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.633943 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:50.633837    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 03:56:50.633943 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.633864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cad02e15-5bf6-46a1-9f28-96641bd71cf4-sys\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.633943 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.633906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.633943 ip-10-0-132-42 kubenswrapper[2573]: E0729 03:56:50.633925    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-tls podName:cad02e15-5bf6-46a1-9f28-96641bd71cf4 nodeName:}" failed. No retries permitted until 2026-07-29 03:56:51.133902371 +0000 UTC m=+91.729003067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-tls") pod "node-exporter-h7gpj" (UID: "cad02e15-5bf6-46a1-9f28-96641bd71cf4") : secret "node-exporter-tls" not found
Jul 29 03:56:50.634304 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.633981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cad02e15-5bf6-46a1-9f28-96641bd71cf4-sys\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.634304 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.634001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-textfile\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.634304 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.634035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cad02e15-5bf6-46a1-9f28-96641bd71cf4-root\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.634304 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.634091    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cad02e15-5bf6-46a1-9f28-96641bd71cf4-root\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.634304 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.633863    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-wtmp\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.634570 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.634420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-textfile\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.634931 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.634907    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.635008 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.634915    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cad02e15-5bf6-46a1-9f28-96641bd71cf4-metrics-client-ca\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.636837 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.636811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:50.643093 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:50.643066    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gspph\" (UniqueName: \"kubernetes.io/projected/cad02e15-5bf6-46a1-9f28-96641bd71cf4-kube-api-access-gspph\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:51.138667 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:51.138635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-tls\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:51.141117 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:51.141083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cad02e15-5bf6-46a1-9f28-96641bd71cf4-node-exporter-tls\") pod \"node-exporter-h7gpj\" (UID: \"cad02e15-5bf6-46a1-9f28-96641bd71cf4\") " pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:51.433704 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:51.433634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h7gpj"
Jul 29 03:56:51.446769 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:56:51.446736    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad02e15_5bf6_46a1_9f28_96641bd71cf4.slice/crio-b35dd3764e79f3edf979dc721cc9deeda32de72dc400742d8b656973278e4a5c WatchSource:0}: Error finding container b35dd3764e79f3edf979dc721cc9deeda32de72dc400742d8b656973278e4a5c: Status 404 returned error can't find the container with id b35dd3764e79f3edf979dc721cc9deeda32de72dc400742d8b656973278e4a5c
Jul 29 03:56:52.443536 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:52.443486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7gpj" event={"ID":"cad02e15-5bf6-46a1-9f28-96641bd71cf4","Type":"ContainerStarted","Data":"68182b84fc2b9a010352a0c79c788cdcf032b356a16a2a265e72e97587d289aa"}
Jul 29 03:56:52.443886 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:52.443560    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7gpj" event={"ID":"cad02e15-5bf6-46a1-9f28-96641bd71cf4","Type":"ContainerStarted","Data":"b35dd3764e79f3edf979dc721cc9deeda32de72dc400742d8b656973278e4a5c"}
Jul 29 03:56:53.370632 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:53.370599    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-669f6f8b9f-6k9bf"
Jul 29 03:56:53.448940 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:53.448904    2573 generic.go:356] "Generic (PLEG): container finished" podID="cad02e15-5bf6-46a1-9f28-96641bd71cf4" containerID="68182b84fc2b9a010352a0c79c788cdcf032b356a16a2a265e72e97587d289aa" exitCode=0
Jul 29 03:56:53.449320 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:53.448959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7gpj" event={"ID":"cad02e15-5bf6-46a1-9f28-96641bd71cf4","Type":"ContainerDied","Data":"68182b84fc2b9a010352a0c79c788cdcf032b356a16a2a265e72e97587d289aa"}
Jul 29 03:56:54.454843 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:54.454806    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7gpj" event={"ID":"cad02e15-5bf6-46a1-9f28-96641bd71cf4","Type":"ContainerStarted","Data":"95ed8528db2d70e421572471fa99aae6a1a07e0684c06218f608a9708f117e56"}
Jul 29 03:56:54.455216 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:54.454868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7gpj" event={"ID":"cad02e15-5bf6-46a1-9f28-96641bd71cf4","Type":"ContainerStarted","Data":"ffdc687418625af34e6a5537d2149478151b2022fca35fc5fe52d1a43d475d4b"}
Jul 29 03:56:54.477077 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:56:54.477028    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h7gpj" podStartSLOduration=3.476707329 podStartE2EDuration="4.477009648s" totalImagesPullingTime="928.694092ms" totalInitContainerRuntime="71.608227ms" isStatefulPod=true podCreationTimestamp="2026-07-29 03:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:56:54.47493071 +0000 UTC m=+95.070031426" watchObservedRunningTime="2026-07-29 03:56:54.477009648 +0000 UTC m=+95.072110366"
Jul 29 03:57:04.374164 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:57:04.374129    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7kj2v"
Jul 29 03:59:48.860172 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:48.860086    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"]
Jul 29 03:59:48.863067 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:48.863052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"
Jul 29 03:59:48.865823 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:48.865798    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rh5m5\""
Jul 29 03:59:48.865964 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:48.865800    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 03:59:48.865964 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:48.865804    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 03:59:48.874956 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:48.873032    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"]
Jul 29 03:59:48.987730 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:48.987690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmfqk\" (UniqueName: \"kubernetes.io/projected/be2b3ed6-606d-464b-9461-c8f0ad8e15db-kube-api-access-wmfqk\") pod \"openshift-lws-operator-fd8ccff4c-vq2v9\" (UID: \"be2b3ed6-606d-464b-9461-c8f0ad8e15db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"
Jul 29 03:59:48.987897 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:48.987757    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be2b3ed6-606d-464b-9461-c8f0ad8e15db-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vq2v9\" (UID: \"be2b3ed6-606d-464b-9461-c8f0ad8e15db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"
Jul 29 03:59:49.088775 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:49.088739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmfqk\" (UniqueName: \"kubernetes.io/projected/be2b3ed6-606d-464b-9461-c8f0ad8e15db-kube-api-access-wmfqk\") pod \"openshift-lws-operator-fd8ccff4c-vq2v9\" (UID: \"be2b3ed6-606d-464b-9461-c8f0ad8e15db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"
Jul 29 03:59:49.088943 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:49.088805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be2b3ed6-606d-464b-9461-c8f0ad8e15db-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vq2v9\" (UID: \"be2b3ed6-606d-464b-9461-c8f0ad8e15db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"
Jul 29 03:59:49.089146 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:49.089131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be2b3ed6-606d-464b-9461-c8f0ad8e15db-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vq2v9\" (UID: \"be2b3ed6-606d-464b-9461-c8f0ad8e15db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"
Jul 29 03:59:49.097634 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:49.097610    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmfqk\" (UniqueName: \"kubernetes.io/projected/be2b3ed6-606d-464b-9461-c8f0ad8e15db-kube-api-access-wmfqk\") pod \"openshift-lws-operator-fd8ccff4c-vq2v9\" (UID: \"be2b3ed6-606d-464b-9461-c8f0ad8e15db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"
Jul 29 03:59:49.173863 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:49.173789    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"
Jul 29 03:59:49.299197 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:49.299166    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9"]
Jul 29 03:59:49.302572 ip-10-0-132-42 kubenswrapper[2573]: W0729 03:59:49.302546    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe2b3ed6_606d_464b_9461_c8f0ad8e15db.slice/crio-73e8e813859d6d6e0c85bc9f5adbf15be74088eeeca4dd69e91372d948aee90c WatchSource:0}: Error finding container 73e8e813859d6d6e0c85bc9f5adbf15be74088eeeca4dd69e91372d948aee90c: Status 404 returned error can't find the container with id 73e8e813859d6d6e0c85bc9f5adbf15be74088eeeca4dd69e91372d948aee90c
Jul 29 03:59:50.020467 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:50.020421    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9" event={"ID":"be2b3ed6-606d-464b-9461-c8f0ad8e15db","Type":"ContainerStarted","Data":"73e8e813859d6d6e0c85bc9f5adbf15be74088eeeca4dd69e91372d948aee90c"}
Jul 29 03:59:52.029348 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:52.029314    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9" event={"ID":"be2b3ed6-606d-464b-9461-c8f0ad8e15db","Type":"ContainerStarted","Data":"9b7578a4042f86b23cab734efbe6c7fb7516cef8a6cda58ada41a0c7e4f3e54b"}
Jul 29 03:59:52.048120 ip-10-0-132-42 kubenswrapper[2573]: I0729 03:59:52.048064    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vq2v9" podStartSLOduration=1.503395468 podStartE2EDuration="4.048047329s" totalImagesPullingTime="2.544651861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:59:52.046897204 +0000 UTC m=+272.641997925" watchObservedRunningTime="2026-07-29 03:59:52.048047329 +0000 UTC m=+272.643148046"
Jul 29 04:00:05.378401 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.378369    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"]
Jul 29 04:00:05.381517 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.381502    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.385391 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.385363    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xhj24\""
Jul 29 04:00:05.385531 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.385448    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 04:00:05.385531 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.385525    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 04:00:05.385652 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.385585    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 04:00:05.400404 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.400384    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"]
Jul 29 04:00:05.509738 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.509702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz5xf\" (UniqueName: \"kubernetes.io/projected/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-kube-api-access-bz5xf\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.509898 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.509756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-manager-config\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.509898 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.509800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-metrics-cert\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.509898 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.509839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-cert\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.610945 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.610916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-manager-config\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.610945 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.610945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-metrics-cert\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.611074 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.610966    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-cert\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.611074 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.611007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz5xf\" (UniqueName: \"kubernetes.io/projected/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-kube-api-access-bz5xf\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.611576 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.611555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-manager-config\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.613668 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.613637    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-cert\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.613797 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.613727    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-metrics-cert\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.620368 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.620344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz5xf\" (UniqueName: \"kubernetes.io/projected/8dd6ff74-9e6f-45d9-a514-4492a15b92a9-kube-api-access-bz5xf\") pod \"lws-controller-manager-86cc57cc46-nn4hm\" (UID: \"8dd6ff74-9e6f-45d9-a514-4492a15b92a9\") " pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.690326 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.690247    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:05.816724 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:05.816695    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"]
Jul 29 04:00:05.820223 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:00:05.820194    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd6ff74_9e6f_45d9_a514_4492a15b92a9.slice/crio-61d08a94db464f8c51342ec5f2c1433a6b0d9149b3ec277546f4b3dc9de2cd45 WatchSource:0}: Error finding container 61d08a94db464f8c51342ec5f2c1433a6b0d9149b3ec277546f4b3dc9de2cd45: Status 404 returned error can't find the container with id 61d08a94db464f8c51342ec5f2c1433a6b0d9149b3ec277546f4b3dc9de2cd45
Jul 29 04:00:06.077671 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:06.077643    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm" event={"ID":"8dd6ff74-9e6f-45d9-a514-4492a15b92a9","Type":"ContainerStarted","Data":"61d08a94db464f8c51342ec5f2c1433a6b0d9149b3ec277546f4b3dc9de2cd45"}
Jul 29 04:00:09.700834 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.700801    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"]
Jul 29 04:00:09.704388 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.704355    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.707444 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.707380    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 04:00:09.707444 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.707419    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 04:00:09.707757 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.707583    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 04:00:09.707933 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.707908    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 04:00:09.708037 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.708021    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-npvqn\""
Jul 29 04:00:09.719747 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.719723    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"]
Jul 29 04:00:09.844716 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.844675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8eaa5df6-517a-4f51-8830-67d326e632af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.844902 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.844734    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8eaa5df6-517a-4f51-8830-67d326e632af-manifests\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.844902 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.844792    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kzvb\" (UniqueName: \"kubernetes.io/projected/8eaa5df6-517a-4f51-8830-67d326e632af-kube-api-access-8kzvb\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.844902 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.844847    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eaa5df6-517a-4f51-8830-67d326e632af-tmp\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.844902 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.844878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8eaa5df6-517a-4f51-8830-67d326e632af-webhook-cert\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.946244 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.946206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8eaa5df6-517a-4f51-8830-67d326e632af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.946397 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.946382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8eaa5df6-517a-4f51-8830-67d326e632af-manifests\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.946482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.946420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kzvb\" (UniqueName: \"kubernetes.io/projected/8eaa5df6-517a-4f51-8830-67d326e632af-kube-api-access-8kzvb\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.946482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.946464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eaa5df6-517a-4f51-8830-67d326e632af-tmp\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.946668 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.946639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8eaa5df6-517a-4f51-8830-67d326e632af-webhook-cert\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.946852 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.946823    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8eaa5df6-517a-4f51-8830-67d326e632af-manifests\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.949044 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.949019    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eaa5df6-517a-4f51-8830-67d326e632af-tmp\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.949354 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.949313    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8eaa5df6-517a-4f51-8830-67d326e632af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.949454 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.949373    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8eaa5df6-517a-4f51-8830-67d326e632af-webhook-cert\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:09.958732 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:09.958670    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kzvb\" (UniqueName: \"kubernetes.io/projected/8eaa5df6-517a-4f51-8830-67d326e632af-kube-api-access-8kzvb\") pod \"opendatahub-operator-controller-manager-d56969f4b-nhlj9\" (UID: \"8eaa5df6-517a-4f51-8830-67d326e632af\") " pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:10.016886 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:10.016851    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:10.464418 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:10.464397    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"]
Jul 29 04:00:10.466979 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:00:10.466951    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eaa5df6_517a_4f51_8830_67d326e632af.slice/crio-65d53c0e1aae8e5bb3ca62710600da608ef83c2a6984adca70c42b935441e36c WatchSource:0}: Error finding container 65d53c0e1aae8e5bb3ca62710600da608ef83c2a6984adca70c42b935441e36c: Status 404 returned error can't find the container with id 65d53c0e1aae8e5bb3ca62710600da608ef83c2a6984adca70c42b935441e36c
Jul 29 04:00:11.098102 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:11.098057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm" event={"ID":"8dd6ff74-9e6f-45d9-a514-4492a15b92a9","Type":"ContainerStarted","Data":"231f78f1eac77adcd5ee77026a68814e3a6368c74974ccc3ae8a113757fcf8c6"}
Jul 29 04:00:11.098596 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:11.098157    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:11.099411 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:11.099392    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9" event={"ID":"8eaa5df6-517a-4f51-8830-67d326e632af","Type":"ContainerStarted","Data":"65d53c0e1aae8e5bb3ca62710600da608ef83c2a6984adca70c42b935441e36c"}
Jul 29 04:00:11.119307 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:11.119258    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm" podStartSLOduration=1.55360905 podStartE2EDuration="6.11924572s" totalImagesPullingTime="4.56563667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:00:11.11879721 +0000 UTC m=+291.713897929" watchObservedRunningTime="2026-07-29 04:00:11.11924572 +0000 UTC m=+291.714346437"
Jul 29 04:00:14.115031 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:14.114993    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9" event={"ID":"8eaa5df6-517a-4f51-8830-67d326e632af","Type":"ContainerStarted","Data":"2074d47eb736653e301af2e1bb79d6304d3c05fc1e423bc61abe7b10cabaaffe"}
Jul 29 04:00:15.120024 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:15.119940    2573 generic.go:356] "Generic (PLEG): container finished" podID="8eaa5df6-517a-4f51-8830-67d326e632af" containerID="2074d47eb736653e301af2e1bb79d6304d3c05fc1e423bc61abe7b10cabaaffe" exitCode=0
Jul 29 04:00:15.120024 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:15.119999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9" event={"ID":"8eaa5df6-517a-4f51-8830-67d326e632af","Type":"ContainerDied","Data":"2074d47eb736653e301af2e1bb79d6304d3c05fc1e423bc61abe7b10cabaaffe"}
Jul 29 04:00:16.125152 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:16.125116    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9" event={"ID":"8eaa5df6-517a-4f51-8830-67d326e632af","Type":"ContainerStarted","Data":"ff12825315664766384141d79ef315d3fdebec79a4dfbea07b8b44ff0dae18f6"}
Jul 29 04:00:16.125545 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:16.125256    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:16.149082 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:16.149036    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9" podStartSLOduration=2.28299129 podStartE2EDuration="7.149019816s" totalImagesPullingTime="3.827621608s" totalInitContainerRuntime="1.038406918s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:00:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:00:16.146648918 +0000 UTC m=+296.741749634" watchObservedRunningTime="2026-07-29 04:00:16.149019816 +0000 UTC m=+296.744120533"
Jul 29 04:00:19.715301 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:19.715272    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 04:00:22.108261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:22.108227    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86cc57cc46-nn4hm"
Jul 29 04:00:27.131413 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:27.131371    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d56969f4b-nhlj9"
Jul 29 04:00:47.244409 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.244377    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"]
Jul 29 04:00:47.246220 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.246205    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.248854 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.248835    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 04:00:47.249390 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.249362    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 04:00:47.249390 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.249384    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 04:00:47.249807 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.249790    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mrrv2\""
Jul 29 04:00:47.260240 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.260214    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"]
Jul 29 04:00:47.326720 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.326684    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.326720 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.326719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.326929 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.326743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp9tg\" (UniqueName: \"kubernetes.io/projected/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-kube-api-access-bp9tg\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.326929 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.326810    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.326929 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.326916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.327022 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.326957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.327058 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.327021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.327058 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.327049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.327118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.327074    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.427899 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.427864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428071 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.427904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428071 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.427946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428071 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.427970    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428071 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.427997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428071 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.428033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428071 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.428059    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428375 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.428092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp9tg\" (UniqueName: \"kubernetes.io/projected/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-kube-api-access-bp9tg\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428375 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.428127    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428480 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.428437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428480 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.428455    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428732 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.428709    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428853 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.428833    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.428895 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.428784    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.430503 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.430472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.430759 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.430745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.437929 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.437899    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.438043 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.437958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp9tg\" (UniqueName: \"kubernetes.io/projected/39f1b5cc-0ef3-449f-9062-e6d1942f3d5e-kube-api-access-bp9tg\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq\" (UID: \"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.556896 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.556872    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:47.689714 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.689682    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"]
Jul 29 04:00:47.692770 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:00:47.692738    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f1b5cc_0ef3_449f_9062_e6d1942f3d5e.slice/crio-4a8b86dee6cd7ffce12d964c14f4130228bd537ee8dc700ce526ea3d4d76b578 WatchSource:0}: Error finding container 4a8b86dee6cd7ffce12d964c14f4130228bd537ee8dc700ce526ea3d4d76b578: Status 404 returned error can't find the container with id 4a8b86dee6cd7ffce12d964c14f4130228bd537ee8dc700ce526ea3d4d76b578
Jul 29 04:00:47.694739 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:47.694724    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:00:48.238436 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:48.238400    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq" event={"ID":"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e","Type":"ContainerStarted","Data":"4a8b86dee6cd7ffce12d964c14f4130228bd537ee8dc700ce526ea3d4d76b578"}
Jul 29 04:00:50.723880 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:50.723836    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:00:50.724138 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:50.723939    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:00:50.724138 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:50.723976    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:00:51.252245 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:51.252207    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq" event={"ID":"39f1b5cc-0ef3-449f-9062-e6d1942f3d5e","Type":"ContainerStarted","Data":"9a934b525715315b57ad7090f39f1c596537f44ed70d46a0f61e4150b8eafcc0"}
Jul 29 04:00:51.272888 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:51.272831    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq" podStartSLOduration=1.244112162 podStartE2EDuration="4.27281194s" totalImagesPullingTime="3.028699778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:00:51.272127139 +0000 UTC m=+331.867227857" watchObservedRunningTime="2026-07-29 04:00:51.27281194 +0000 UTC m=+331.867912658"
Jul 29 04:00:51.557469 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:51.557436    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:51.712485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:51.712453    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:52.256138 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:52.256108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:00:52.257020 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:00:52.257001    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq"
Jul 29 04:01:30.368784 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.368702    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b96pz"]
Jul 29 04:01:30.376510 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.376462    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b96pz"
Jul 29 04:01:30.379151 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.379126    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-t5ljb\""
Jul 29 04:01:30.379298 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.379176    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 04:01:30.379706 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.379138    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 04:01:30.383390 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.383366    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b96pz"]
Jul 29 04:01:30.471268 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.471231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/3d11bf98-6714-47c4-bb23-d928515f5d6c-kube-api-access-f5fxh\") pod \"kuadrant-operator-catalog-b96pz\" (UID: \"3d11bf98-6714-47c4-bb23-d928515f5d6c\") " pod="kuadrant-system/kuadrant-operator-catalog-b96pz"
Jul 29 04:01:30.572262 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.572228    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/3d11bf98-6714-47c4-bb23-d928515f5d6c-kube-api-access-f5fxh\") pod \"kuadrant-operator-catalog-b96pz\" (UID: \"3d11bf98-6714-47c4-bb23-d928515f5d6c\") " pod="kuadrant-system/kuadrant-operator-catalog-b96pz"
Jul 29 04:01:30.580839 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.580813    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/3d11bf98-6714-47c4-bb23-d928515f5d6c-kube-api-access-f5fxh\") pod \"kuadrant-operator-catalog-b96pz\" (UID: \"3d11bf98-6714-47c4-bb23-d928515f5d6c\") " pod="kuadrant-system/kuadrant-operator-catalog-b96pz"
Jul 29 04:01:30.688841 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.688753    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b96pz"
Jul 29 04:01:30.735231 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.735200    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b96pz"]
Jul 29 04:01:30.815903 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.815867    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b96pz"]
Jul 29 04:01:30.820340 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:01:30.820315    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d11bf98_6714_47c4_bb23_d928515f5d6c.slice/crio-19ec6c479c73ffe88ac12c6da90e02c4369e3d8c0eca301f8ba88ae8b658294f WatchSource:0}: Error finding container 19ec6c479c73ffe88ac12c6da90e02c4369e3d8c0eca301f8ba88ae8b658294f: Status 404 returned error can't find the container with id 19ec6c479c73ffe88ac12c6da90e02c4369e3d8c0eca301f8ba88ae8b658294f
Jul 29 04:01:30.945629 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.945550    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l2hwd"]
Jul 29 04:01:30.950132 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.950117    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l2hwd"
Jul 29 04:01:30.956162 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.956132    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l2hwd"]
Jul 29 04:01:30.973853 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:30.973828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f966\" (UniqueName: \"kubernetes.io/projected/6fe64710-a370-40fd-87cc-f017c87e66d6-kube-api-access-6f966\") pod \"kuadrant-operator-catalog-l2hwd\" (UID: \"6fe64710-a370-40fd-87cc-f017c87e66d6\") " pod="kuadrant-system/kuadrant-operator-catalog-l2hwd"
Jul 29 04:01:31.075081 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:31.075049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f966\" (UniqueName: \"kubernetes.io/projected/6fe64710-a370-40fd-87cc-f017c87e66d6-kube-api-access-6f966\") pod \"kuadrant-operator-catalog-l2hwd\" (UID: \"6fe64710-a370-40fd-87cc-f017c87e66d6\") " pod="kuadrant-system/kuadrant-operator-catalog-l2hwd"
Jul 29 04:01:31.084855 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:31.084825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f966\" (UniqueName: \"kubernetes.io/projected/6fe64710-a370-40fd-87cc-f017c87e66d6-kube-api-access-6f966\") pod \"kuadrant-operator-catalog-l2hwd\" (UID: \"6fe64710-a370-40fd-87cc-f017c87e66d6\") " pod="kuadrant-system/kuadrant-operator-catalog-l2hwd"
Jul 29 04:01:31.259993 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:31.259906    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l2hwd"
Jul 29 04:01:31.403020 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:31.402997    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l2hwd"]
Jul 29 04:01:31.405029 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:01:31.405005    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe64710_a370_40fd_87cc_f017c87e66d6.slice/crio-afa9dc17d27da630b37f53d5566ed0040e2e763d07b6c6ef2701031f0716f040 WatchSource:0}: Error finding container afa9dc17d27da630b37f53d5566ed0040e2e763d07b6c6ef2701031f0716f040: Status 404 returned error can't find the container with id afa9dc17d27da630b37f53d5566ed0040e2e763d07b6c6ef2701031f0716f040
Jul 29 04:01:31.409406 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:31.409380    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b96pz" event={"ID":"3d11bf98-6714-47c4-bb23-d928515f5d6c","Type":"ContainerStarted","Data":"19ec6c479c73ffe88ac12c6da90e02c4369e3d8c0eca301f8ba88ae8b658294f"}
Jul 29 04:01:32.417426 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:32.417358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l2hwd" event={"ID":"6fe64710-a370-40fd-87cc-f017c87e66d6","Type":"ContainerStarted","Data":"afa9dc17d27da630b37f53d5566ed0040e2e763d07b6c6ef2701031f0716f040"}
Jul 29 04:01:33.422560 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:33.422522    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l2hwd" event={"ID":"6fe64710-a370-40fd-87cc-f017c87e66d6","Type":"ContainerStarted","Data":"277ab3018a7749289610d199524bdddcaa02715579d8f3d134b97d06c9711f8b"}
Jul 29 04:01:33.423947 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:33.423923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b96pz" event={"ID":"3d11bf98-6714-47c4-bb23-d928515f5d6c","Type":"ContainerStarted","Data":"51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480"}
Jul 29 04:01:33.424062 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:33.423989    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-b96pz" podUID="3d11bf98-6714-47c4-bb23-d928515f5d6c" containerName="registry-server" containerID="cri-o://51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480" gracePeriod=2
Jul 29 04:01:33.439032 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:33.438993    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l2hwd" podStartSLOduration=1.882497389 podStartE2EDuration="3.438977595s" totalImagesPullingTime="1.556480206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:01:33.437519918 +0000 UTC m=+374.032620636" watchObservedRunningTime="2026-07-29 04:01:33.438977595 +0000 UTC m=+374.034078290"
Jul 29 04:01:33.452785 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:33.452741    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-b96pz" podStartSLOduration=1.3131539970000001 podStartE2EDuration="3.452725945s" totalImagesPullingTime="2.139571948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:01:33.451392511 +0000 UTC m=+374.046493228" watchObservedRunningTime="2026-07-29 04:01:33.452725945 +0000 UTC m=+374.047826672"
Jul 29 04:01:33.656595 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:33.656568    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b96pz"
Jul 29 04:01:33.695773 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:33.695705    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/3d11bf98-6714-47c4-bb23-d928515f5d6c-kube-api-access-f5fxh\") pod \"3d11bf98-6714-47c4-bb23-d928515f5d6c\" (UID: \"3d11bf98-6714-47c4-bb23-d928515f5d6c\") "
Jul 29 04:01:33.697987 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:33.697960    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d11bf98-6714-47c4-bb23-d928515f5d6c-kube-api-access-f5fxh" (OuterVolumeSpecName: "kube-api-access-f5fxh") pod "3d11bf98-6714-47c4-bb23-d928515f5d6c" (UID: "3d11bf98-6714-47c4-bb23-d928515f5d6c"). InnerVolumeSpecName "kube-api-access-f5fxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:01:33.796480 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:33.796447    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/3d11bf98-6714-47c4-bb23-d928515f5d6c-kube-api-access-f5fxh\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:01:34.429034 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:34.428997    2573 generic.go:356] "Generic (PLEG): container finished" podID="3d11bf98-6714-47c4-bb23-d928515f5d6c" containerID="51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480" exitCode=0
Jul 29 04:01:34.429542 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:34.429043    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b96pz"
Jul 29 04:01:34.429542 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:34.429084    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b96pz" event={"ID":"3d11bf98-6714-47c4-bb23-d928515f5d6c","Type":"ContainerDied","Data":"51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480"}
Jul 29 04:01:34.429542 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:34.429142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b96pz" event={"ID":"3d11bf98-6714-47c4-bb23-d928515f5d6c","Type":"ContainerDied","Data":"19ec6c479c73ffe88ac12c6da90e02c4369e3d8c0eca301f8ba88ae8b658294f"}
Jul 29 04:01:34.429542 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:34.429171    2573 scope.go:117] "RemoveContainer" containerID="51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480"
Jul 29 04:01:34.437961 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:34.437944    2573 scope.go:117] "RemoveContainer" containerID="51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480"
Jul 29 04:01:34.438248 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:01:34.438227    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480\": container with ID starting with 51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480 not found: ID does not exist" containerID="51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480"
Jul 29 04:01:34.438300 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:34.438256    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480"} err="failed to get container status \"51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480\": rpc error: code = NotFound desc = could not find container \"51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480\": container with ID starting with 51545d23c62268d20aba22cb173e98376870b3920a6df9fdf6231497b8eec480 not found: ID does not exist"
Jul 29 04:01:34.445081 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:34.445059    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b96pz"]
Jul 29 04:01:34.450423 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:34.450399    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b96pz"]
Jul 29 04:01:35.866697 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:35.866654    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d11bf98-6714-47c4-bb23-d928515f5d6c" path="/var/lib/kubelet/pods/3d11bf98-6714-47c4-bb23-d928515f5d6c/volumes"
Jul 29 04:01:41.260116 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:41.260060    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-l2hwd"
Jul 29 04:01:41.260580 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:41.260224    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-l2hwd"
Jul 29 04:01:41.281261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:41.281237    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-l2hwd"
Jul 29 04:01:41.477104 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:01:41.477077    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-l2hwd"
Jul 29 04:02:02.403396 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.402169    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d586t"]
Jul 29 04:02:02.403396 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.402856    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d11bf98-6714-47c4-bb23-d928515f5d6c" containerName="registry-server"
Jul 29 04:02:02.403396 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.402876    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d11bf98-6714-47c4-bb23-d928515f5d6c" containerName="registry-server"
Jul 29 04:02:02.403396 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.403010    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d11bf98-6714-47c4-bb23-d928515f5d6c" containerName="registry-server"
Jul 29 04:02:02.410837 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.410813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t"
Jul 29 04:02:02.413837 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.413811    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-q952l\""
Jul 29 04:02:02.414431 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.414411    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d586t"]
Jul 29 04:02:02.517931 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.517885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfflx\" (UniqueName: \"kubernetes.io/projected/6836c4c3-a693-449b-85b9-3caf96915b16-kube-api-access-tfflx\") pod \"authorino-operator-75cc8d5cb7-d586t\" (UID: \"6836c4c3-a693-449b-85b9-3caf96915b16\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t"
Jul 29 04:02:02.618585 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.618545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfflx\" (UniqueName: \"kubernetes.io/projected/6836c4c3-a693-449b-85b9-3caf96915b16-kube-api-access-tfflx\") pod \"authorino-operator-75cc8d5cb7-d586t\" (UID: \"6836c4c3-a693-449b-85b9-3caf96915b16\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t"
Jul 29 04:02:02.627172 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.627136    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfflx\" (UniqueName: \"kubernetes.io/projected/6836c4c3-a693-449b-85b9-3caf96915b16-kube-api-access-tfflx\") pod \"authorino-operator-75cc8d5cb7-d586t\" (UID: \"6836c4c3-a693-449b-85b9-3caf96915b16\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t"
Jul 29 04:02:02.723094 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.723015    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t"
Jul 29 04:02:02.858193 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:02.858158    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d586t"]
Jul 29 04:02:02.862383 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:02:02.862351    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6836c4c3_a693_449b_85b9_3caf96915b16.slice/crio-2672341fe7111c512cabe13083903e4de234ad477b31021648c3c709592d29f5 WatchSource:0}: Error finding container 2672341fe7111c512cabe13083903e4de234ad477b31021648c3c709592d29f5: Status 404 returned error can't find the container with id 2672341fe7111c512cabe13083903e4de234ad477b31021648c3c709592d29f5
Jul 29 04:02:03.540839 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:03.540807    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t" event={"ID":"6836c4c3-a693-449b-85b9-3caf96915b16","Type":"ContainerStarted","Data":"2672341fe7111c512cabe13083903e4de234ad477b31021648c3c709592d29f5"}
Jul 29 04:02:05.550992 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:05.550957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t" event={"ID":"6836c4c3-a693-449b-85b9-3caf96915b16","Type":"ContainerStarted","Data":"16f5ab4bb66388594596c526f034004fc992c483b8d00fd47acf03af22a555b3"}
Jul 29 04:02:05.551411 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:05.551048    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t"
Jul 29 04:02:05.572505 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:05.572443    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t" podStartSLOduration=1.008109003 podStartE2EDuration="3.572427707s" totalImagesPullingTime="2.564318704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:02:05.571297451 +0000 UTC m=+406.166398193" watchObservedRunningTime="2026-07-29 04:02:05.572427707 +0000 UTC m=+406.167528423"
Jul 29 04:02:16.557429 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:16.557397    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d586t"
Jul 29 04:02:22.242609 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.242579    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"]
Jul 29 04:02:22.246817 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.246800    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.249380 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.249359    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jbt2t\""
Jul 29 04:02:22.249511 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.249453    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 04:02:22.249581 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.249507    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 04:02:22.254072 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.254049    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"]
Jul 29 04:02:22.377539 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.377475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9nv7\" (UniqueName: \"kubernetes.io/projected/3a18dda3-ce17-4090-9b79-54a8f979c0b8-kube-api-access-n9nv7\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.377539 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.377533    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a18dda3-ce17-4090-9b79-54a8f979c0b8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.377762 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.377597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a18dda3-ce17-4090-9b79-54a8f979c0b8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.478899 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.478868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9nv7\" (UniqueName: \"kubernetes.io/projected/3a18dda3-ce17-4090-9b79-54a8f979c0b8-kube-api-access-n9nv7\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.478899 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.478906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a18dda3-ce17-4090-9b79-54a8f979c0b8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.479155 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.478931    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a18dda3-ce17-4090-9b79-54a8f979c0b8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.479155 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:02:22.479045    2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 29 04:02:22.479155 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:02:22.479116    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a18dda3-ce17-4090-9b79-54a8f979c0b8-plugin-serving-cert podName:3a18dda3-ce17-4090-9b79-54a8f979c0b8 nodeName:}" failed. No retries permitted until 2026-07-29 04:02:22.979095882 +0000 UTC m=+423.574196580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3a18dda3-ce17-4090-9b79-54a8f979c0b8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-jjszq" (UID: "3a18dda3-ce17-4090-9b79-54a8f979c0b8") : secret "plugin-serving-cert" not found
Jul 29 04:02:22.479618 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.479598    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a18dda3-ce17-4090-9b79-54a8f979c0b8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.496015 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.495949    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9nv7\" (UniqueName: \"kubernetes.io/projected/3a18dda3-ce17-4090-9b79-54a8f979c0b8-kube-api-access-n9nv7\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.983392 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.983350    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a18dda3-ce17-4090-9b79-54a8f979c0b8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:22.985943 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:22.985911    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a18dda3-ce17-4090-9b79-54a8f979c0b8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjszq\" (UID: \"3a18dda3-ce17-4090-9b79-54a8f979c0b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:23.157829 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:23.157777    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"
Jul 29 04:02:23.292463 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:23.292430    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq"]
Jul 29 04:02:23.295383 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:02:23.295358    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a18dda3_ce17_4090_9b79_54a8f979c0b8.slice/crio-cf53205ce34fad70626f8fc6635701a8bd9ad30ba7e27c49db25d5c5c3d90d6c WatchSource:0}: Error finding container cf53205ce34fad70626f8fc6635701a8bd9ad30ba7e27c49db25d5c5c3d90d6c: Status 404 returned error can't find the container with id cf53205ce34fad70626f8fc6635701a8bd9ad30ba7e27c49db25d5c5c3d90d6c
Jul 29 04:02:23.625625 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:23.625582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq" event={"ID":"3a18dda3-ce17-4090-9b79-54a8f979c0b8","Type":"ContainerStarted","Data":"cf53205ce34fad70626f8fc6635701a8bd9ad30ba7e27c49db25d5c5c3d90d6c"}
Jul 29 04:02:31.873679 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:31.873637    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"]
Jul 29 04:02:31.893883 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:31.893850    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"]
Jul 29 04:02:31.894050 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:31.893943    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:31.897272 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:31.897241    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pc9k8\""
Jul 29 04:02:32.065090 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:32.065054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3199a0ba-3352-4f1c-a0ef-21500c630461-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" (UID: \"3199a0ba-3352-4f1c-a0ef-21500c630461\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:32.065275 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:32.065111    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6xb4\" (UniqueName: \"kubernetes.io/projected/3199a0ba-3352-4f1c-a0ef-21500c630461-kube-api-access-g6xb4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" (UID: \"3199a0ba-3352-4f1c-a0ef-21500c630461\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:32.166145 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:32.166053    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3199a0ba-3352-4f1c-a0ef-21500c630461-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" (UID: \"3199a0ba-3352-4f1c-a0ef-21500c630461\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:32.166145 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:32.166116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6xb4\" (UniqueName: \"kubernetes.io/projected/3199a0ba-3352-4f1c-a0ef-21500c630461-kube-api-access-g6xb4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" (UID: \"3199a0ba-3352-4f1c-a0ef-21500c630461\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:32.166532 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:32.166480    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3199a0ba-3352-4f1c-a0ef-21500c630461-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" (UID: \"3199a0ba-3352-4f1c-a0ef-21500c630461\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:32.174876 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:32.174847    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6xb4\" (UniqueName: \"kubernetes.io/projected/3199a0ba-3352-4f1c-a0ef-21500c630461-kube-api-access-g6xb4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" (UID: \"3199a0ba-3352-4f1c-a0ef-21500c630461\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:32.206735 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:32.206700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:32.541393 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:32.541358    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"]
Jul 29 04:02:32.546009 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:32.545976    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"]
Jul 29 04:02:44.732133 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:44.732093    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq" event={"ID":"3a18dda3-ce17-4090-9b79-54a8f979c0b8","Type":"ContainerStarted","Data":"0a7d3cc7571463b2899eaa70718106284da5f8191342d592d986135148efc5e0"}
Jul 29 04:02:44.747972 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:44.747919    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjszq" podStartSLOduration=1.472405064 podStartE2EDuration="22.747902824s" totalImagesPullingTime="21.27549776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:02:44.747053712 +0000 UTC m=+445.342154435" watchObservedRunningTime="2026-07-29 04:02:44.747902824 +0000 UTC m=+445.343003541"
Jul 29 04:02:47.033191 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:02:47.033151    2573 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-z9lt8_kuadrant-system_3199a0ba-3352-4f1c-a0ef-21500c630461_0(8325485914b3e5e0b21a3cf889b664f4244a5ad78c1b2d1f69465e9883d0eeef): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-z9lt8 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 29 04:02:47.033440 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:02:47.033219    2573 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-z9lt8_kuadrant-system_3199a0ba-3352-4f1c-a0ef-21500c630461_0(8325485914b3e5e0b21a3cf889b664f4244a5ad78c1b2d1f69465e9883d0eeef): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-z9lt8 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:47.746570 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:47.746539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:47.749103 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:02:47.749076    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" is forbidden: User \"system:node:ip-10-0-132-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-42.ec2.internal' and this object" podUID="3199a0ba-3352-4f1c-a0ef-21500c630461" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:47.754010 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:47.753989    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:47.756349 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:02:47.756323    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" is forbidden: User \"system:node:ip-10-0-132-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-42.ec2.internal' and this object" podUID="3199a0ba-3352-4f1c-a0ef-21500c630461" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:47.793400 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:47.793374    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6xb4\" (UniqueName: \"kubernetes.io/projected/3199a0ba-3352-4f1c-a0ef-21500c630461-kube-api-access-g6xb4\") pod \"3199a0ba-3352-4f1c-a0ef-21500c630461\" (UID: \"3199a0ba-3352-4f1c-a0ef-21500c630461\") "
Jul 29 04:02:47.793521 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:47.793423    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3199a0ba-3352-4f1c-a0ef-21500c630461-extensions-socket-volume\") pod \"3199a0ba-3352-4f1c-a0ef-21500c630461\" (UID: \"3199a0ba-3352-4f1c-a0ef-21500c630461\") "
Jul 29 04:02:47.793709 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:47.793686    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3199a0ba-3352-4f1c-a0ef-21500c630461-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3199a0ba-3352-4f1c-a0ef-21500c630461" (UID: "3199a0ba-3352-4f1c-a0ef-21500c630461"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:02:47.795648 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:47.795620    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3199a0ba-3352-4f1c-a0ef-21500c630461-kube-api-access-g6xb4" (OuterVolumeSpecName: "kube-api-access-g6xb4") pod "3199a0ba-3352-4f1c-a0ef-21500c630461" (UID: "3199a0ba-3352-4f1c-a0ef-21500c630461"). InnerVolumeSpecName "kube-api-access-g6xb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:02:47.866831 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:47.866802    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3199a0ba-3352-4f1c-a0ef-21500c630461" path="/var/lib/kubelet/pods/3199a0ba-3352-4f1c-a0ef-21500c630461/volumes"
Jul 29 04:02:47.894615 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:47.894590    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6xb4\" (UniqueName: \"kubernetes.io/projected/3199a0ba-3352-4f1c-a0ef-21500c630461-kube-api-access-g6xb4\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:02:47.894615 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:47.894611    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3199a0ba-3352-4f1c-a0ef-21500c630461-extensions-socket-volume\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:02:48.751013 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:02:48.750979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:48.753521 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:02:48.753470    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" is forbidden: User \"system:node:ip-10-0-132-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-42.ec2.internal' and this object" podUID="3199a0ba-3352-4f1c-a0ef-21500c630461" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:48.755580 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:02:48.755562    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" is forbidden: User \"system:node:ip-10-0-132-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-42.ec2.internal' and this object" podUID="3199a0ba-3352-4f1c-a0ef-21500c630461" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:02:49.866008 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:02:49.865963    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-z9lt8\" is forbidden: User \"system:node:ip-10-0-132-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-42.ec2.internal' and this object" podUID="3199a0ba-3352-4f1c-a0ef-21500c630461" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z9lt8"
Jul 29 04:03:04.845646 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.845608    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"]
Jul 29 04:03:04.866897 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.866860    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"]
Jul 29 04:03:04.867072 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.866974    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:04.869729 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.869709    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-szp6p\""
Jul 29 04:03:04.931314 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.931278    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:04.931536 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.931321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:04.931536 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.931353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:04.931536 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.931403    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:04.931536 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.931447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:04.931536 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.931479    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:04.931536 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.931524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:04.931800 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.931556    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:04.931800 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:04.931578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr2dh\" (UniqueName: \"kubernetes.io/projected/d6c1794a-60be-4274-a884-fb4c2f4df6d4-kube-api-access-pr2dh\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.032572 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.032572 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.032830 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.032830 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.032830 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.032830 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.032830 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032693    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.033085 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.033085 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr2dh\" (UniqueName: \"kubernetes.io/projected/d6c1794a-60be-4274-a884-fb4c2f4df6d4-kube-api-access-pr2dh\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.033085 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.032987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.033085 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.033003    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.033278 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.033098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.033534 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.033471    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.033534 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.033585    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.035404 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.035382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.035565 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.035548    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.041757 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.041730    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6c1794a-60be-4274-a884-fb4c2f4df6d4-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.042346 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.042318    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr2dh\" (UniqueName: \"kubernetes.io/projected/d6c1794a-60be-4274-a884-fb4c2f4df6d4-kube-api-access-pr2dh\") pod \"maas-default-gateway-openshift-default-5ccb968c66-mwrlk\" (UID: \"d6c1794a-60be-4274-a884-fb4c2f4df6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.176853 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.176755    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:05.328366 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.328199    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"]
Jul 29 04:03:05.330983 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:03:05.330954    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c1794a_60be_4274_a884_fb4c2f4df6d4.slice/crio-ca5f47bc12ec8cc5f52d2e4e509f636fe804082b74315580d1fb85c55fbb5021 WatchSource:0}: Error finding container ca5f47bc12ec8cc5f52d2e4e509f636fe804082b74315580d1fb85c55fbb5021: Status 404 returned error can't find the container with id ca5f47bc12ec8cc5f52d2e4e509f636fe804082b74315580d1fb85c55fbb5021
Jul 29 04:03:05.333400 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.333361    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:03:05.333534 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.333443    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:03:05.333534 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.333504    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:03:05.825470 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.825432    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk" event={"ID":"d6c1794a-60be-4274-a884-fb4c2f4df6d4","Type":"ContainerStarted","Data":"a4311e817d65308dc9267f12fab80ca5f8187468dfd6c0166f93b6b1b4141336"}
Jul 29 04:03:05.825717 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.825514    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk" event={"ID":"d6c1794a-60be-4274-a884-fb4c2f4df6d4","Type":"ContainerStarted","Data":"ca5f47bc12ec8cc5f52d2e4e509f636fe804082b74315580d1fb85c55fbb5021"}
Jul 29 04:03:05.846073 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:05.846020    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk" podStartSLOduration=1.84600266 podStartE2EDuration="1.84600266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:05.844671467 +0000 UTC m=+466.439772198" watchObservedRunningTime="2026-07-29 04:03:05.84600266 +0000 UTC m=+466.441103377"
Jul 29 04:03:06.177205 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:06.177128    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:06.182428 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:06.182400    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:06.829322 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:06.829286    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:06.830254 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:06.830234    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:03:08.774197 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:08.774154    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:03:08.865366 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:08.865333    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:03:08.865569 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:08.865410    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:03:08.865569 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:08.865460    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:08.868288 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:08.868268    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 04:03:08.967267 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:08.967224    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7njd\" (UniqueName: \"kubernetes.io/projected/34974edb-b7a8-49fc-8a05-ca2509ba4bfe-kube-api-access-x7njd\") pod \"limitador-limitador-54d6d988d5-c28cg\" (UID: \"34974edb-b7a8-49fc-8a05-ca2509ba4bfe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:08.967467 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:08.967286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34974edb-b7a8-49fc-8a05-ca2509ba4bfe-config-file\") pod \"limitador-limitador-54d6d988d5-c28cg\" (UID: \"34974edb-b7a8-49fc-8a05-ca2509ba4bfe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:09.068630 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:09.068551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7njd\" (UniqueName: \"kubernetes.io/projected/34974edb-b7a8-49fc-8a05-ca2509ba4bfe-kube-api-access-x7njd\") pod \"limitador-limitador-54d6d988d5-c28cg\" (UID: \"34974edb-b7a8-49fc-8a05-ca2509ba4bfe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:09.068630 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:09.068590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34974edb-b7a8-49fc-8a05-ca2509ba4bfe-config-file\") pod \"limitador-limitador-54d6d988d5-c28cg\" (UID: \"34974edb-b7a8-49fc-8a05-ca2509ba4bfe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:09.069273 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:09.069253    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34974edb-b7a8-49fc-8a05-ca2509ba4bfe-config-file\") pod \"limitador-limitador-54d6d988d5-c28cg\" (UID: \"34974edb-b7a8-49fc-8a05-ca2509ba4bfe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:09.078587 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:09.078557    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7njd\" (UniqueName: \"kubernetes.io/projected/34974edb-b7a8-49fc-8a05-ca2509ba4bfe-kube-api-access-x7njd\") pod \"limitador-limitador-54d6d988d5-c28cg\" (UID: \"34974edb-b7a8-49fc-8a05-ca2509ba4bfe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:09.176610 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:09.176576    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:09.338911 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:09.338889    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:03:09.341096 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:03:09.341063    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34974edb_b7a8_49fc_8a05_ca2509ba4bfe.slice/crio-1dc1f4d25f9b85dab969fc90f6a0483ca245bb9d3f1bb0545d9814855c120620 WatchSource:0}: Error finding container 1dc1f4d25f9b85dab969fc90f6a0483ca245bb9d3f1bb0545d9814855c120620: Status 404 returned error can't find the container with id 1dc1f4d25f9b85dab969fc90f6a0483ca245bb9d3f1bb0545d9814855c120620
Jul 29 04:03:09.847781 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:09.847736    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg" event={"ID":"34974edb-b7a8-49fc-8a05-ca2509ba4bfe","Type":"ContainerStarted","Data":"1dc1f4d25f9b85dab969fc90f6a0483ca245bb9d3f1bb0545d9814855c120620"}
Jul 29 04:03:12.863347 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:12.863315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg" event={"ID":"34974edb-b7a8-49fc-8a05-ca2509ba4bfe","Type":"ContainerStarted","Data":"269fa91a8efe8ab3a35fe4d191da6747c36a63159a145ef11e2a95545e7f1622"}
Jul 29 04:03:12.863801 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:12.863465    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:12.879091 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:12.879043    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg" podStartSLOduration=1.5063406769999999 podStartE2EDuration="4.879027556s" totalImagesPullingTime="3.372686879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:12.878763761 +0000 UTC m=+473.473864479" watchObservedRunningTime="2026-07-29 04:03:12.879027556 +0000 UTC m=+473.474128273"
Jul 29 04:03:23.869095 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:23.869069    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-c28cg"
Jul 29 04:03:41.732539 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.732482    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-854ffb899-2wxqp"]
Jul 29 04:03:41.805385 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.805344    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-854ffb899-2wxqp"]
Jul 29 04:03:41.805571 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.805468    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:03:41.809832 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.809811    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dht7f\""
Jul 29 04:03:41.809963 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.809845    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 04:03:41.846317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.846281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-tls-cert\") pod \"authorino-854ffb899-2wxqp\" (UID: \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\") " pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:03:41.846473 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.846324    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfhcd\" (UniqueName: \"kubernetes.io/projected/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-kube-api-access-mfhcd\") pod \"authorino-854ffb899-2wxqp\" (UID: \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\") " pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:03:41.946872 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.946841    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-tls-cert\") pod \"authorino-854ffb899-2wxqp\" (UID: \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\") " pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:03:41.947030 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.946886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfhcd\" (UniqueName: \"kubernetes.io/projected/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-kube-api-access-mfhcd\") pod \"authorino-854ffb899-2wxqp\" (UID: \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\") " pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:03:41.949531 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.949510    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-tls-cert\") pod \"authorino-854ffb899-2wxqp\" (UID: \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\") " pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:03:41.955724 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:41.955688    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfhcd\" (UniqueName: \"kubernetes.io/projected/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-kube-api-access-mfhcd\") pod \"authorino-854ffb899-2wxqp\" (UID: \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\") " pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:03:42.114044 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:42.114010    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:03:42.250534 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:42.250480    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-854ffb899-2wxqp"]
Jul 29 04:03:42.254083 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:03:42.254051    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b9cc98e_62b5_4bb0_95c7_b3c7923a4e7b.slice/crio-fa85636d35ce81c375f9f5c899ed443a85376b45a4e857e95345dcd55cf733fc WatchSource:0}: Error finding container fa85636d35ce81c375f9f5c899ed443a85376b45a4e857e95345dcd55cf733fc: Status 404 returned error can't find the container with id fa85636d35ce81c375f9f5c899ed443a85376b45a4e857e95345dcd55cf733fc
Jul 29 04:03:42.985262 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:42.985204    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854ffb899-2wxqp" event={"ID":"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b","Type":"ContainerStarted","Data":"fa85636d35ce81c375f9f5c899ed443a85376b45a4e857e95345dcd55cf733fc"}
Jul 29 04:03:46.000087 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:46.000048    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854ffb899-2wxqp" event={"ID":"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b","Type":"ContainerStarted","Data":"49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222"}
Jul 29 04:03:46.018444 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:03:46.018399    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-854ffb899-2wxqp" podStartSLOduration=1.9829756170000001 podStartE2EDuration="5.018382276s" totalImagesPullingTime="3.035406659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:46.017591942 +0000 UTC m=+506.612692660" watchObservedRunningTime="2026-07-29 04:03:46.018382276 +0000 UTC m=+506.613483030"
Jul 29 04:04:27.532534 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:27.532418    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:04:35.205845 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:35.205771    2573 generic.go:356] "Generic (PLEG): container finished" podID="d6c1794a-60be-4274-a884-fb4c2f4df6d4" containerID="a4311e817d65308dc9267f12fab80ca5f8187468dfd6c0166f93b6b1b4141336" exitCode=0
Jul 29 04:04:35.205845 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:35.205812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk" event={"ID":"d6c1794a-60be-4274-a884-fb4c2f4df6d4","Type":"ContainerDied","Data":"a4311e817d65308dc9267f12fab80ca5f8187468dfd6c0166f93b6b1b4141336"}
Jul 29 04:04:35.206340 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:35.206174    2573 scope.go:117] "RemoveContainer" containerID="a4311e817d65308dc9267f12fab80ca5f8187468dfd6c0166f93b6b1b4141336"
Jul 29 04:04:35.207277 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:35.207245    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:04:35.207387 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:35.207331    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:04:35.207446 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:35.207381    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:04:36.212630 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:36.212593    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk" event={"ID":"d6c1794a-60be-4274-a884-fb4c2f4df6d4","Type":"ContainerStarted","Data":"dfadaf9d6f9dbde43ef007a2f682d9234020c75ea1b36847c6b17529f731ebf2"}
Jul 29 04:04:36.829750 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:36.829716    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:04:37.178579 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:37.178459    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:04:37.180050 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:37.180023    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mwrlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Jul 29 04:04:37.180605 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:37.180268    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk" podUID="d6c1794a-60be-4274-a884-fb4c2f4df6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 29 04:04:38.178436 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:38.177923    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mwrlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Jul 29 04:04:38.178436 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:38.177994    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk" podUID="d6c1794a-60be-4274-a884-fb4c2f4df6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 29 04:04:39.178354 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:39.177892    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mwrlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Jul 29 04:04:39.178354 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:39.177956    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk" podUID="d6c1794a-60be-4274-a884-fb4c2f4df6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 29 04:04:40.177444 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:40.177406    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-mwrlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Jul 29 04:04:40.177757 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:40.177724    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk" podUID="d6c1794a-60be-4274-a884-fb4c2f4df6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 29 04:04:41.180969 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:41.180934    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:04:41.182073 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:41.182057    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-mwrlk"
Jul 29 04:04:48.804538 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:04:48.804479    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:05:21.274120 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:05:21.274082    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:05:36.783453 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:05:36.783416    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:05:53.558717 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:05:53.558619    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:06:07.169021 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:06:07.168980    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:06:18.668513 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:06:18.666794    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:07:06.094906 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.094867    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-679f6d945d-2rp67"]
Jul 29 04:07:06.097143 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.097122    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-679f6d945d-2rp67"
Jul 29 04:07:06.104620 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.104598    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-679f6d945d-2rp67"]
Jul 29 04:07:06.139941 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.139908    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43fb13c2-c07f-471e-a2cf-8476d1e03225-tls-cert\") pod \"authorino-679f6d945d-2rp67\" (UID: \"43fb13c2-c07f-471e-a2cf-8476d1e03225\") " pod="kuadrant-system/authorino-679f6d945d-2rp67"
Jul 29 04:07:06.140088 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.139969    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6v4t\" (UniqueName: \"kubernetes.io/projected/43fb13c2-c07f-471e-a2cf-8476d1e03225-kube-api-access-b6v4t\") pod \"authorino-679f6d945d-2rp67\" (UID: \"43fb13c2-c07f-471e-a2cf-8476d1e03225\") " pod="kuadrant-system/authorino-679f6d945d-2rp67"
Jul 29 04:07:06.240573 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.240541    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6v4t\" (UniqueName: \"kubernetes.io/projected/43fb13c2-c07f-471e-a2cf-8476d1e03225-kube-api-access-b6v4t\") pod \"authorino-679f6d945d-2rp67\" (UID: \"43fb13c2-c07f-471e-a2cf-8476d1e03225\") " pod="kuadrant-system/authorino-679f6d945d-2rp67"
Jul 29 04:07:06.240733 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.240598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43fb13c2-c07f-471e-a2cf-8476d1e03225-tls-cert\") pod \"authorino-679f6d945d-2rp67\" (UID: \"43fb13c2-c07f-471e-a2cf-8476d1e03225\") " pod="kuadrant-system/authorino-679f6d945d-2rp67"
Jul 29 04:07:06.243137 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.243104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43fb13c2-c07f-471e-a2cf-8476d1e03225-tls-cert\") pod \"authorino-679f6d945d-2rp67\" (UID: \"43fb13c2-c07f-471e-a2cf-8476d1e03225\") " pod="kuadrant-system/authorino-679f6d945d-2rp67"
Jul 29 04:07:06.248195 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.248169    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6v4t\" (UniqueName: \"kubernetes.io/projected/43fb13c2-c07f-471e-a2cf-8476d1e03225-kube-api-access-b6v4t\") pod \"authorino-679f6d945d-2rp67\" (UID: \"43fb13c2-c07f-471e-a2cf-8476d1e03225\") " pod="kuadrant-system/authorino-679f6d945d-2rp67"
Jul 29 04:07:06.407408 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.407333    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-679f6d945d-2rp67"
Jul 29 04:07:06.539389 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.539321    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-679f6d945d-2rp67"]
Jul 29 04:07:06.542122 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:07:06.542094    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43fb13c2_c07f_471e_a2cf_8476d1e03225.slice/crio-b7edc55ca92dcaccbd79b198e566db62b934f100e3b7f60dfd54e85d13ad7291 WatchSource:0}: Error finding container b7edc55ca92dcaccbd79b198e566db62b934f100e3b7f60dfd54e85d13ad7291: Status 404 returned error can't find the container with id b7edc55ca92dcaccbd79b198e566db62b934f100e3b7f60dfd54e85d13ad7291
Jul 29 04:07:06.543426 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.543410    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:07:06.852232 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:06.852202    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-679f6d945d-2rp67" event={"ID":"43fb13c2-c07f-471e-a2cf-8476d1e03225","Type":"ContainerStarted","Data":"b7edc55ca92dcaccbd79b198e566db62b934f100e3b7f60dfd54e85d13ad7291"}
Jul 29 04:07:07.858593 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:07.858540    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-679f6d945d-2rp67" event={"ID":"43fb13c2-c07f-471e-a2cf-8476d1e03225","Type":"ContainerStarted","Data":"d90a2761ce1243a692d2484d662abb76c6a4ee8c2514de82bb85032ebd85eff2"}
Jul 29 04:07:07.882716 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:07.882651    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-679f6d945d-2rp67" podStartSLOduration=1.373642742 podStartE2EDuration="1.882629385s" totalImagesPullingTime="508.986643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:07:07.882174043 +0000 UTC m=+708.477274765" watchObservedRunningTime="2026-07-29 04:07:07.882629385 +0000 UTC m=+708.477730103"
Jul 29 04:07:07.942527 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:07.938906    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-854ffb899-2wxqp"]
Jul 29 04:07:07.942527 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:07.939161    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-854ffb899-2wxqp" podUID="4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b" containerName="authorino" containerID="cri-o://49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222" gracePeriod=30
Jul 29 04:07:08.198427 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.198402    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:07:08.259672 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.259638    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-tls-cert\") pod \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\" (UID: \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\") "
Jul 29 04:07:08.259837 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.259694    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfhcd\" (UniqueName: \"kubernetes.io/projected/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-kube-api-access-mfhcd\") pod \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\" (UID: \"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b\") "
Jul 29 04:07:08.261874 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.261848    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-kube-api-access-mfhcd" (OuterVolumeSpecName: "kube-api-access-mfhcd") pod "4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b" (UID: "4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b"). InnerVolumeSpecName "kube-api-access-mfhcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:07:08.269761 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.269738    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b" (UID: "4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:07:08.360914 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.360855    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-tls-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:07:08.360914 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.360889    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfhcd\" (UniqueName: \"kubernetes.io/projected/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b-kube-api-access-mfhcd\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:07:08.865073 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.865041    2573 generic.go:356] "Generic (PLEG): container finished" podID="4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b" containerID="49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222" exitCode=0
Jul 29 04:07:08.865073 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.865072    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854ffb899-2wxqp"
Jul 29 04:07:08.865636 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.865118    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854ffb899-2wxqp" event={"ID":"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b","Type":"ContainerDied","Data":"49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222"}
Jul 29 04:07:08.865636 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.865149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854ffb899-2wxqp" event={"ID":"4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b","Type":"ContainerDied","Data":"fa85636d35ce81c375f9f5c899ed443a85376b45a4e857e95345dcd55cf733fc"}
Jul 29 04:07:08.865636 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.865169    2573 scope.go:117] "RemoveContainer" containerID="49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222"
Jul 29 04:07:08.874733 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.874716    2573 scope.go:117] "RemoveContainer" containerID="49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222"
Jul 29 04:07:08.874980 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:07:08.874964    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222\": container with ID starting with 49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222 not found: ID does not exist" containerID="49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222"
Jul 29 04:07:08.875032 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.874989    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222"} err="failed to get container status \"49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222\": rpc error: code = NotFound desc = could not find container \"49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222\": container with ID starting with 49036275204b654af3893c20d24ee5395cd0071c14ff89dd565b2c5afe3cf222 not found: ID does not exist"
Jul 29 04:07:08.886024 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.885994    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-854ffb899-2wxqp"]
Jul 29 04:07:08.889464 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:08.889435    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-854ffb899-2wxqp"]
Jul 29 04:07:09.867262 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:09.867227    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b" path="/var/lib/kubelet/pods/4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b/volumes"
Jul 29 04:07:35.572436 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:35.572401    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:07:44.850612 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:44.850578    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:07:55.158755 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:07:55.158718    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:08:55.082716 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.082634    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8cdf94955-8lpz4"]
Jul 29 04:08:55.083170 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.082981    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b" containerName="authorino"
Jul 29 04:08:55.083170 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.082996    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b" containerName="authorino"
Jul 29 04:08:55.083170 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.083054    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9cc98e-62b5-4bb0-95c7-b3c7923a4e7b" containerName="authorino"
Jul 29 04:08:55.084846 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.084829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:08:55.088857 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.088828    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-t2j64\""
Jul 29 04:08:55.088857 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.088838    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 04:08:55.089037 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.088839    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 04:08:55.096006 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.095982    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8cdf94955-8lpz4"]
Jul 29 04:08:55.193889 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.193856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttxwj\" (UniqueName: \"kubernetes.io/projected/d6a99628-78a7-402a-8c23-82668bee1949-kube-api-access-ttxwj\") pod \"maas-controller-8cdf94955-8lpz4\" (UID: \"d6a99628-78a7-402a-8c23-82668bee1949\") " pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:08:55.194076 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.193921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a99628-78a7-402a-8c23-82668bee1949-webhook-cert\") pod \"maas-controller-8cdf94955-8lpz4\" (UID: \"d6a99628-78a7-402a-8c23-82668bee1949\") " pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:08:55.294861 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.294826    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttxwj\" (UniqueName: \"kubernetes.io/projected/d6a99628-78a7-402a-8c23-82668bee1949-kube-api-access-ttxwj\") pod \"maas-controller-8cdf94955-8lpz4\" (UID: \"d6a99628-78a7-402a-8c23-82668bee1949\") " pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:08:55.294987 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.294895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a99628-78a7-402a-8c23-82668bee1949-webhook-cert\") pod \"maas-controller-8cdf94955-8lpz4\" (UID: \"d6a99628-78a7-402a-8c23-82668bee1949\") " pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:08:55.297463 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.297438    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a99628-78a7-402a-8c23-82668bee1949-webhook-cert\") pod \"maas-controller-8cdf94955-8lpz4\" (UID: \"d6a99628-78a7-402a-8c23-82668bee1949\") " pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:08:55.304028 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.304003    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttxwj\" (UniqueName: \"kubernetes.io/projected/d6a99628-78a7-402a-8c23-82668bee1949-kube-api-access-ttxwj\") pod \"maas-controller-8cdf94955-8lpz4\" (UID: \"d6a99628-78a7-402a-8c23-82668bee1949\") " pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:08:55.395239 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.395143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:08:55.527557 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:55.527527    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8cdf94955-8lpz4"]
Jul 29 04:08:55.530543 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:08:55.530519    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a99628_78a7_402a_8c23_82668bee1949.slice/crio-f5955ba74325c518bc93ffb9b87b26118d36f47c87f92d2913402307aef1caa6 WatchSource:0}: Error finding container f5955ba74325c518bc93ffb9b87b26118d36f47c87f92d2913402307aef1caa6: Status 404 returned error can't find the container with id f5955ba74325c518bc93ffb9b87b26118d36f47c87f92d2913402307aef1caa6
Jul 29 04:08:56.316276 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:56.316237    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cdf94955-8lpz4" event={"ID":"d6a99628-78a7-402a-8c23-82668bee1949","Type":"ContainerStarted","Data":"f5955ba74325c518bc93ffb9b87b26118d36f47c87f92d2913402307aef1caa6"}
Jul 29 04:08:58.327301 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:58.327267    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cdf94955-8lpz4" event={"ID":"d6a99628-78a7-402a-8c23-82668bee1949","Type":"ContainerStarted","Data":"3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb"}
Jul 29 04:08:58.327692 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:58.327374    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:08:58.346342 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:08:58.346297    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8cdf94955-8lpz4" podStartSLOduration=0.859326142 podStartE2EDuration="3.346283202s" totalImagesPullingTime="2.48695706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:58.345442226 +0000 UTC m=+818.940542944" watchObservedRunningTime="2026-07-29 04:08:58.346283202 +0000 UTC m=+818.941383943"
Jul 29 04:09:09.334155 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:09.334122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:09:13.984414 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:13.984374    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8cdf94955-8lpz4"]
Jul 29 04:09:13.985067 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:13.984613    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8cdf94955-8lpz4" podUID="d6a99628-78a7-402a-8c23-82668bee1949" containerName="manager" containerID="cri-o://3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb" gracePeriod=30
Jul 29 04:09:14.227817 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.227793    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:09:14.358130 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.358094    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttxwj\" (UniqueName: \"kubernetes.io/projected/d6a99628-78a7-402a-8c23-82668bee1949-kube-api-access-ttxwj\") pod \"d6a99628-78a7-402a-8c23-82668bee1949\" (UID: \"d6a99628-78a7-402a-8c23-82668bee1949\") "
Jul 29 04:09:14.358287 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.358168    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a99628-78a7-402a-8c23-82668bee1949-webhook-cert\") pod \"d6a99628-78a7-402a-8c23-82668bee1949\" (UID: \"d6a99628-78a7-402a-8c23-82668bee1949\") "
Jul 29 04:09:14.360445 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.360416    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a99628-78a7-402a-8c23-82668bee1949-kube-api-access-ttxwj" (OuterVolumeSpecName: "kube-api-access-ttxwj") pod "d6a99628-78a7-402a-8c23-82668bee1949" (UID: "d6a99628-78a7-402a-8c23-82668bee1949"). InnerVolumeSpecName "kube-api-access-ttxwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:09:14.360580 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.360479    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6a99628-78a7-402a-8c23-82668bee1949-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d6a99628-78a7-402a-8c23-82668bee1949" (UID: "d6a99628-78a7-402a-8c23-82668bee1949"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:09:14.400984 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.400948    2573 generic.go:356] "Generic (PLEG): container finished" podID="d6a99628-78a7-402a-8c23-82668bee1949" containerID="3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb" exitCode=0
Jul 29 04:09:14.400984 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.400987    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cdf94955-8lpz4"
Jul 29 04:09:14.401172 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.401034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cdf94955-8lpz4" event={"ID":"d6a99628-78a7-402a-8c23-82668bee1949","Type":"ContainerDied","Data":"3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb"}
Jul 29 04:09:14.401172 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.401083    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cdf94955-8lpz4" event={"ID":"d6a99628-78a7-402a-8c23-82668bee1949","Type":"ContainerDied","Data":"f5955ba74325c518bc93ffb9b87b26118d36f47c87f92d2913402307aef1caa6"}
Jul 29 04:09:14.401172 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.401105    2573 scope.go:117] "RemoveContainer" containerID="3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb"
Jul 29 04:09:14.409957 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.409937    2573 scope.go:117] "RemoveContainer" containerID="3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb"
Jul 29 04:09:14.410208 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:09:14.410185    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb\": container with ID starting with 3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb not found: ID does not exist" containerID="3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb"
Jul 29 04:09:14.410277 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.410222    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb"} err="failed to get container status \"3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb\": rpc error: code = NotFound desc = could not find container \"3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb\": container with ID starting with 3f5c415521dc34405e71e233ec5502eb5adecbdcb7776f4bfac97f6138c888bb not found: ID does not exist"
Jul 29 04:09:14.423131 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.423099    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8cdf94955-8lpz4"]
Jul 29 04:09:14.426549 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.426522    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8cdf94955-8lpz4"]
Jul 29 04:09:14.459355 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.459326    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a99628-78a7-402a-8c23-82668bee1949-webhook-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:09:14.459355 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:14.459353    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttxwj\" (UniqueName: \"kubernetes.io/projected/d6a99628-78a7-402a-8c23-82668bee1949-kube-api-access-ttxwj\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:09:15.249509 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.249458    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8cdf94955-6wkmt"]
Jul 29 04:09:15.249884 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.249754    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a99628-78a7-402a-8c23-82668bee1949" containerName="manager"
Jul 29 04:09:15.249884 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.249766    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a99628-78a7-402a-8c23-82668bee1949" containerName="manager"
Jul 29 04:09:15.249884 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.249824    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a99628-78a7-402a-8c23-82668bee1949" containerName="manager"
Jul 29 04:09:15.252616 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.252594    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:15.262023 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.262005    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-t2j64\""
Jul 29 04:09:15.263459 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.263441    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 04:09:15.263579 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.263459    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 04:09:15.278164 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.278140    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8cdf94955-6wkmt"]
Jul 29 04:09:15.366675 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.366644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/343c69d9-f68f-45cd-b710-8fe2383718f8-webhook-cert\") pod \"maas-controller-8cdf94955-6wkmt\" (UID: \"343c69d9-f68f-45cd-b710-8fe2383718f8\") " pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:15.366675 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.366676    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6z8v\" (UniqueName: \"kubernetes.io/projected/343c69d9-f68f-45cd-b710-8fe2383718f8-kube-api-access-d6z8v\") pod \"maas-controller-8cdf94955-6wkmt\" (UID: \"343c69d9-f68f-45cd-b710-8fe2383718f8\") " pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:15.467572 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.467530    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/343c69d9-f68f-45cd-b710-8fe2383718f8-webhook-cert\") pod \"maas-controller-8cdf94955-6wkmt\" (UID: \"343c69d9-f68f-45cd-b710-8fe2383718f8\") " pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:15.467572 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.467577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6z8v\" (UniqueName: \"kubernetes.io/projected/343c69d9-f68f-45cd-b710-8fe2383718f8-kube-api-access-d6z8v\") pod \"maas-controller-8cdf94955-6wkmt\" (UID: \"343c69d9-f68f-45cd-b710-8fe2383718f8\") " pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:15.470078 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.470056    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/343c69d9-f68f-45cd-b710-8fe2383718f8-webhook-cert\") pod \"maas-controller-8cdf94955-6wkmt\" (UID: \"343c69d9-f68f-45cd-b710-8fe2383718f8\") " pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:15.476678 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.476651    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6z8v\" (UniqueName: \"kubernetes.io/projected/343c69d9-f68f-45cd-b710-8fe2383718f8-kube-api-access-d6z8v\") pod \"maas-controller-8cdf94955-6wkmt\" (UID: \"343c69d9-f68f-45cd-b710-8fe2383718f8\") " pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:15.561980 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.561955    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:15.695805 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.695784    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8cdf94955-6wkmt"]
Jul 29 04:09:15.697915 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:09:15.697884    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod343c69d9_f68f_45cd_b710_8fe2383718f8.slice/crio-595ce638699e94464fb91fc5f23698b636e96ce3f586f127567dee99323385c8 WatchSource:0}: Error finding container 595ce638699e94464fb91fc5f23698b636e96ce3f586f127567dee99323385c8: Status 404 returned error can't find the container with id 595ce638699e94464fb91fc5f23698b636e96ce3f586f127567dee99323385c8
Jul 29 04:09:15.867139 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:15.867063    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a99628-78a7-402a-8c23-82668bee1949" path="/var/lib/kubelet/pods/d6a99628-78a7-402a-8c23-82668bee1949/volumes"
Jul 29 04:09:16.411462 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:16.411430    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cdf94955-6wkmt" event={"ID":"343c69d9-f68f-45cd-b710-8fe2383718f8","Type":"ContainerStarted","Data":"f30b128c5e0b2c0629acc3639f33271b23dd33e2c88d57f22c570af08608d7a2"}
Jul 29 04:09:16.411879 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:16.411481    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8cdf94955-6wkmt" event={"ID":"343c69d9-f68f-45cd-b710-8fe2383718f8","Type":"ContainerStarted","Data":"595ce638699e94464fb91fc5f23698b636e96ce3f586f127567dee99323385c8"}
Jul 29 04:09:16.411879 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:16.411638    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:16.429775 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:16.429727    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8cdf94955-6wkmt" podStartSLOduration=1.076338942 podStartE2EDuration="1.429709948s" totalImagesPullingTime="353.371006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:09:16.427957978 +0000 UTC m=+837.023058698" watchObservedRunningTime="2026-07-29 04:09:16.429709948 +0000 UTC m=+837.024810642"
Jul 29 04:09:27.417083 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:27.417055    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8cdf94955-6wkmt"
Jul 29 04:09:35.180131 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:35.180092    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:09:46.673134 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:09:46.673095    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:10:46.775271 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:10:46.775240    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:10:56.256721 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:10:56.256680    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:11:22.455043 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:11:22.455006    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:11:31.464424 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:11:31.464391    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:11:42.153554 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:11:42.153449    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:11:53.760598 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:11:53.760555    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:12:04.262937 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:12:04.262905    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:12:11.958129 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:12:11.958091    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:12:19.262748 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:12:19.262710    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:12:27.058953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:12:27.058918    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:12:42.862697 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:12:42.862661    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:12:54.356163 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:12:54.356125    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:13:16.068255 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:13:16.068174    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:13:29.253593 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:13:29.253555    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:13:42.863722 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:13:42.863691    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:14:03.655587 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:14:03.655545    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:14:19.461411 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:14:19.461371    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:14:28.365381 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:14:28.365334    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:14:37.672171 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:14:37.672134    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:14:46.957484 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:14:46.957401    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:14:56.561354 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:14:56.561324    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:15:06.358251 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:15:06.358213    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:15:16.865330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:15:16.865292    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:15:24.960118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:15:24.960087    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:18:46.465469 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:18:46.465422    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:18:57.260622 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:18:57.260582    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:19:05.854459 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:19:05.854415    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:19:14.561400 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:19:14.561300    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:19:24.155427 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:19:24.155383    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:19:34.562269 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:19:34.562228    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:19:44.356755 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:19:44.356714    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:19:55.069066 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:19:55.069027    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:20:03.160999 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:03.160953    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:20:12.956395 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:12.956361    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:20:19.453747 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:19.453710    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:20:40.763555 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:40.763461    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:20:50.255733 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:50.255695    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:20:56.738344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.738306    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"]
Jul 29 04:20:56.741714 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.741696    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.745926 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.745902    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 04:20:56.745926 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.745915    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-0aedf407-kserve-self-signed-certs\""
Jul 29 04:20:56.746219 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.745902    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h4cwp\""
Jul 29 04:20:56.746219 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.745915    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 04:20:56.758847 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.758823    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"]
Jul 29 04:20:56.811621 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.811584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-home\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.811621 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.811623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-tmp-dir\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.811823 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.811693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-model-cache\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.811823 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.811730    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e52aa7d5-de75-43a6-869e-ac9970e58f20-tls-certs\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.811823 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.811790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-dshm\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.811823 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.811808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvsfm\" (UniqueName: \"kubernetes.io/projected/e52aa7d5-de75-43a6-869e-ac9970e58f20-kube-api-access-zvsfm\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.913197 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.913159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-dshm\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.913197 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.913201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvsfm\" (UniqueName: \"kubernetes.io/projected/e52aa7d5-de75-43a6-869e-ac9970e58f20-kube-api-access-zvsfm\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.913514 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.913461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-home\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.913658 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.913541    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-tmp-dir\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.913658 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.913604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-model-cache\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.913658 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.913635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e52aa7d5-de75-43a6-869e-ac9970e58f20-tls-certs\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.913884 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.913862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-home\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.913943 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.913910    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-tmp-dir\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.914026 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.914008    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-model-cache\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.915645 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.915625    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-dshm\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.916046 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.916030    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e52aa7d5-de75-43a6-869e-ac9970e58f20-tls-certs\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:56.920733 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:56.920716    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvsfm\" (UniqueName: \"kubernetes.io/projected/e52aa7d5-de75-43a6-869e-ac9970e58f20-kube-api-access-zvsfm\") pod \"e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") " pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:57.051252 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:57.051216    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:20:57.178627 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:57.178596    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"]
Jul 29 04:20:57.181595 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:20:57.181565    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode52aa7d5_de75_43a6_869e_ac9970e58f20.slice/crio-61443da1d368059563e07bbd337280a0fe2466279332df7e3c3a96316eb362ca WatchSource:0}: Error finding container 61443da1d368059563e07bbd337280a0fe2466279332df7e3c3a96316eb362ca: Status 404 returned error can't find the container with id 61443da1d368059563e07bbd337280a0fe2466279332df7e3c3a96316eb362ca
Jul 29 04:20:57.183698 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:57.183677    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:20:57.409347 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:57.409256    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6" event={"ID":"e52aa7d5-de75-43a6-869e-ac9970e58f20","Type":"ContainerStarted","Data":"61443da1d368059563e07bbd337280a0fe2466279332df7e3c3a96316eb362ca"}
Jul 29 04:20:58.415942 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:58.415899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6" event={"ID":"e52aa7d5-de75-43a6-869e-ac9970e58f20","Type":"ContainerStarted","Data":"ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569"}
Jul 29 04:20:58.431196 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:20:58.431124    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6" podStartSLOduration=1.330580587 podStartE2EDuration="2.43110596s" totalImagesPullingTime="1.100525373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:20:58.430880436 +0000 UTC m=+1539.025981154" watchObservedRunningTime="2026-07-29 04:20:58.43110596 +0000 UTC m=+1539.026206677"
Jul 29 04:21:01.658928 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:21:01.658887    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:21:07.052109 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:21:07.052074    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:21:07.052482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:21:07.052123    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:21:07.064462 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:21:07.064440    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:21:07.465149 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:21:07.465069    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:21:17.256344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:21:17.256301    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:21:52.626008 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:21:52.625970    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"]
Jul 29 04:21:56.451726 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:21:56.451685    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:22:07.645687 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.645620    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6" podUID="e52aa7d5-de75-43a6-869e-ac9970e58f20" containerName="main" containerID="cri-o://ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569" gracePeriod=45
Jul 29 04:22:07.896127 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.896063    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:22:07.924944 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.924913    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvsfm\" (UniqueName: \"kubernetes.io/projected/e52aa7d5-de75-43a6-869e-ac9970e58f20-kube-api-access-zvsfm\") pod \"e52aa7d5-de75-43a6-869e-ac9970e58f20\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") "
Jul 29 04:22:07.925099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.924984    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-model-cache\") pod \"e52aa7d5-de75-43a6-869e-ac9970e58f20\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") "
Jul 29 04:22:07.925099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.925014    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-dshm\") pod \"e52aa7d5-de75-43a6-869e-ac9970e58f20\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") "
Jul 29 04:22:07.925099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.925051    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e52aa7d5-de75-43a6-869e-ac9970e58f20-tls-certs\") pod \"e52aa7d5-de75-43a6-869e-ac9970e58f20\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") "
Jul 29 04:22:07.925099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.925081    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-tmp-dir\") pod \"e52aa7d5-de75-43a6-869e-ac9970e58f20\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") "
Jul 29 04:22:07.925310 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.925123    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-home\") pod \"e52aa7d5-de75-43a6-869e-ac9970e58f20\" (UID: \"e52aa7d5-de75-43a6-869e-ac9970e58f20\") "
Jul 29 04:22:07.925310 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.925276    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-model-cache" (OuterVolumeSpecName: "model-cache") pod "e52aa7d5-de75-43a6-869e-ac9970e58f20" (UID: "e52aa7d5-de75-43a6-869e-ac9970e58f20"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:22:07.925471 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.925424    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e52aa7d5-de75-43a6-869e-ac9970e58f20" (UID: "e52aa7d5-de75-43a6-869e-ac9970e58f20"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:22:07.925832 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.925511    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-model-cache\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:22:07.925832 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.925660    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-home" (OuterVolumeSpecName: "home") pod "e52aa7d5-de75-43a6-869e-ac9970e58f20" (UID: "e52aa7d5-de75-43a6-869e-ac9970e58f20"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:22:07.927404 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.927371    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e52aa7d5-de75-43a6-869e-ac9970e58f20-kube-api-access-zvsfm" (OuterVolumeSpecName: "kube-api-access-zvsfm") pod "e52aa7d5-de75-43a6-869e-ac9970e58f20" (UID: "e52aa7d5-de75-43a6-869e-ac9970e58f20"). InnerVolumeSpecName "kube-api-access-zvsfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:22:07.927538 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.927411    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-dshm" (OuterVolumeSpecName: "dshm") pod "e52aa7d5-de75-43a6-869e-ac9970e58f20" (UID: "e52aa7d5-de75-43a6-869e-ac9970e58f20"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:22:07.927538 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:07.927426    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e52aa7d5-de75-43a6-869e-ac9970e58f20-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e52aa7d5-de75-43a6-869e-ac9970e58f20" (UID: "e52aa7d5-de75-43a6-869e-ac9970e58f20"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:22:08.026478 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.026432    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-home\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:22:08.026478 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.026472    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvsfm\" (UniqueName: \"kubernetes.io/projected/e52aa7d5-de75-43a6-869e-ac9970e58f20-kube-api-access-zvsfm\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:22:08.026478 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.026482    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-dshm\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:22:08.026478 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.026510    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e52aa7d5-de75-43a6-869e-ac9970e58f20-tls-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:22:08.026478 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.026519    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e52aa7d5-de75-43a6-869e-ac9970e58f20-tmp-dir\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:22:08.721757 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.721720    2573 generic.go:356] "Generic (PLEG): container finished" podID="e52aa7d5-de75-43a6-869e-ac9970e58f20" containerID="ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569" exitCode=0
Jul 29 04:22:08.722203 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.721769    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"
Jul 29 04:22:08.722203 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.721803    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6" event={"ID":"e52aa7d5-de75-43a6-869e-ac9970e58f20","Type":"ContainerDied","Data":"ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569"}
Jul 29 04:22:08.722203 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.721852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6" event={"ID":"e52aa7d5-de75-43a6-869e-ac9970e58f20","Type":"ContainerDied","Data":"61443da1d368059563e07bbd337280a0fe2466279332df7e3c3a96316eb362ca"}
Jul 29 04:22:08.722203 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.721871    2573 scope.go:117] "RemoveContainer" containerID="ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569"
Jul 29 04:22:08.731079 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.731060    2573 scope.go:117] "RemoveContainer" containerID="ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569"
Jul 29 04:22:08.731321 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:22:08.731303    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569\": container with ID starting with ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569 not found: ID does not exist" containerID="ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569"
Jul 29 04:22:08.731387 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.731327    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569"} err="failed to get container status \"ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569\": rpc error: code = NotFound desc = could not find container \"ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569\": container with ID starting with ba23fd7904b54e0018188279ed6a30332968a7d7b576d377d2bab4eb794c9569 not found: ID does not exist"
Jul 29 04:22:08.743222 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.743196    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"]
Jul 29 04:22:08.746575 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:08.746551    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-0aedf407-kserve-5d44d49659-g9vl6"]
Jul 29 04:22:09.459473 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:09.459436    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:22:09.867151 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:09.867120    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e52aa7d5-de75-43a6-869e-ac9970e58f20" path="/var/lib/kubelet/pods/e52aa7d5-de75-43a6-869e-ac9970e58f20/volumes"
Jul 29 04:22:21.063636 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:21.063588    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:22:41.253130 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:41.253096    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:22:57.160775 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:22:57.160734    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:23:06.160389 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:23:06.160351    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:23:16.261763 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:23:16.261731    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:23:25.372012 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:23:25.371975    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:23:34.461267 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:23:34.461233    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:23:47.764067 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:23:47.763969    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:23:56.859359 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:23:56.859324    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:24:06.558845 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:24:06.558808    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:24:19.062693 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:24:19.062656    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:24:28.255633 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:24:28.255597    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:24:34.657358 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:24:34.657322    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:24:45.867344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:24:45.867312    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:25:00.961784 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:25:00.961746    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:25:13.452547 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:25:13.452429    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:25:28.557083 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:25:28.557032    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:25:43.459227 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:25:43.459179    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:25:52.951638 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:25:52.951598    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:26:05.155602 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:05.155557    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:26:19.066413 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:19.066375    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:26:28.757567 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:28.757526    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:26:39.055992 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:39.055956    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:26:40.484563 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.484460    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"]
Jul 29 04:26:40.484994 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.484773    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e52aa7d5-de75-43a6-869e-ac9970e58f20" containerName="main"
Jul 29 04:26:40.484994 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.484783    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e52aa7d5-de75-43a6-869e-ac9970e58f20" containerName="main"
Jul 29 04:26:40.484994 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.484846    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e52aa7d5-de75-43a6-869e-ac9970e58f20" containerName="main"
Jul 29 04:26:40.487777 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.487759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.490346 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.490321    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-dd29cdf8-openshift-default-dockercfg-5k52v\""
Jul 29 04:26:40.511294 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.511265    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"]
Jul 29 04:26:40.514711 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.514687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-socket\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.514821 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.514721    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-podinfo\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.514821 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.514750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eac554-7135-4a4b-b2e5-d8456de188e5-istiod-ca-cert\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.514916 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.514837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-credential-socket\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.514994 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.514961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnzd5\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-kube-api-access-xnzd5\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.515099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.515016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-token\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.515099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.515038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-data\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.515099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.515079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-certs\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.515099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.515093    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-envoy\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.615672 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.615626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-socket\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.615862 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.615686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-podinfo\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.615862 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.615718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eac554-7135-4a4b-b2e5-d8456de188e5-istiod-ca-cert\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.615862 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.615759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-credential-socket\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.616018 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.615851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnzd5\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-kube-api-access-xnzd5\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.616018 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.615905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-token\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.616018 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.615933    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-data\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.616018 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.615972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-certs\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.616018 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.615996    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-envoy\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.616687 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.616104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-socket\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.616687 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.616146    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-credential-socket\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.616687 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.616542    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eac554-7135-4a4b-b2e5-d8456de188e5-istiod-ca-cert\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.616687 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.616575    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-data\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.617138 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.616764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-certs\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.618837 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.618808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-envoy\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.618994 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.618971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-podinfo\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.629277 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.629251    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnzd5\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-kube-api-access-xnzd5\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.629942 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.629912    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-token\") pod \"e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") " pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.797571 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.797536    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:40.937423 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.937346    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"]
Jul 29 04:26:40.939672 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:26:40.939631    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70eac554_7135_4a4b_b2e5_d8456de188e5.slice/crio-173bf4e170f6e8c487cc0d92aba31ed859332756ec6403ae4b3cf0e8452e04a8 WatchSource:0}: Error finding container 173bf4e170f6e8c487cc0d92aba31ed859332756ec6403ae4b3cf0e8452e04a8: Status 404 returned error can't find the container with id 173bf4e170f6e8c487cc0d92aba31ed859332756ec6403ae4b3cf0e8452e04a8
Jul 29 04:26:40.941618 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.941589    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:26:40.941697 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.941650    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:26:40.941697 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:40.941680    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:26:41.888089 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:41.888055    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" event={"ID":"70eac554-7135-4a4b-b2e5-d8456de188e5","Type":"ContainerStarted","Data":"e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351"}
Jul 29 04:26:41.888486 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:41.888100    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" event={"ID":"70eac554-7135-4a4b-b2e5-d8456de188e5","Type":"ContainerStarted","Data":"173bf4e170f6e8c487cc0d92aba31ed859332756ec6403ae4b3cf0e8452e04a8"}
Jul 29 04:26:41.907625 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:41.907568    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" podStartSLOduration=1.9075510279999999 podStartE2EDuration="1.907551028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:26:41.906503851 +0000 UTC m=+1882.501604562" watchObservedRunningTime="2026-07-29 04:26:41.907551028 +0000 UTC m=+1882.502651744"
Jul 29 04:26:42.798179 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:42.798143    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:42.803062 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:42.803037    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:42.892415 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:42.892388    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:42.893332 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:42.893314    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:47.455503 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:47.455453    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:26:55.947811 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:55.947773    2573 generic.go:356] "Generic (PLEG): container finished" podID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerID="e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351" exitCode=0
Jul 29 04:26:55.947811 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:55.947814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" event={"ID":"70eac554-7135-4a4b-b2e5-d8456de188e5","Type":"ContainerDied","Data":"e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351"}
Jul 29 04:26:55.948353 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:55.948304    2573 scope.go:117] "RemoveContainer" containerID="e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351"
Jul 29 04:26:55.949562 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:55.949526    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:26:55.949742 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:55.949614    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:26:55.949742 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:55.949649    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:26:56.954630 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:56.954592    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" event={"ID":"70eac554-7135-4a4b-b2e5-d8456de188e5","Type":"ContainerStarted","Data":"e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d"}
Jul 29 04:26:57.798675 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:57.798629    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:57.799785 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:57.799759    2573 patch_prober.go:28] interesting pod/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 29 04:26:57.799852 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:57.799832    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 29 04:26:57.893317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:57.893283    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:26:58.798709 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:58.798672    2573 patch_prober.go:28] interesting pod/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 29 04:26:58.799109 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:58.798728    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 29 04:26:59.798754 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:59.798704    2573 patch_prober.go:28] interesting pod/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 29 04:26:59.799164 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:26:59.798778    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 29 04:27:00.798259 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:00.798219    2573 patch_prober.go:28] interesting pod/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 29 04:27:00.798446 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:00.798314    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 29 04:27:01.801654 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:01.801624    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:27:01.802670 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:01.802651    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:27:24.224446 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:24.224410    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"]
Jul 29 04:27:24.224993 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:24.224728    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy" containerID="cri-o://e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d" gracePeriod=30
Jul 29 04:27:25.291675 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.291637    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"]
Jul 29 04:27:25.295048 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.295026    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.301756 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.301731    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-74690011-gw-openshift-default-dockercfg-qp59z\""
Jul 29 04:27:25.312726 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.312699    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"]
Jul 29 04:27:25.321470 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.321438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-envoy\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.321644 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.321486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-data\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.321644 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.321535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-token\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.321644 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.321559    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb4e040c-c5c9-437e-bf3d-1084e6542999-istiod-ca-cert\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.321776 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.321655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-socket\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.321776 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.321696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-podinfo\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.321776 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.321746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbwq\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-kube-api-access-kpbwq\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.321901 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.321792    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-certs\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.321901 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.321856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-credential-socket\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.422600 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.422557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbwq\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-kube-api-access-kpbwq\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.422801 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.422626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-certs\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.422801 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.422677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-credential-socket\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.422801 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.422722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-envoy\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.422801 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.422748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-data\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.422801 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.422773    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-token\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.422801 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.422798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb4e040c-c5c9-437e-bf3d-1084e6542999-istiod-ca-cert\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.423103 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.422881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-socket\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.423103 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.422908    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-podinfo\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.423103 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.423084    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-credential-socket\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.423270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.423252    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-socket\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.423338 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.423287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-certs\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.423395 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.423370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-data\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.423808 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.423703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb4e040c-c5c9-437e-bf3d-1084e6542999-istiod-ca-cert\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.425530 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.425469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-envoy\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.425788 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.425771    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-podinfo\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.430593 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.430565    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbwq\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-kube-api-access-kpbwq\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.431120 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.431101    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-token\") pod \"e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") " pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.605369 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.605275    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:25.739806 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.739779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"]
Jul 29 04:27:25.742816 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:27:25.742787    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4e040c_c5c9_437e_bf3d_1084e6542999.slice/crio-607acf7386529f702b1ee3bdd20733a2ad09aa15d291b8894e9b0ca236e47b93 WatchSource:0}: Error finding container 607acf7386529f702b1ee3bdd20733a2ad09aa15d291b8894e9b0ca236e47b93: Status 404 returned error can't find the container with id 607acf7386529f702b1ee3bdd20733a2ad09aa15d291b8894e9b0ca236e47b93
Jul 29 04:27:25.745526 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.745473    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:27:25.745620 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.745569    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:27:25.745620 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:25.745606    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:27:26.082508 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:26.082460    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" event={"ID":"fb4e040c-c5c9-437e-bf3d-1084e6542999","Type":"ContainerStarted","Data":"0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b"}
Jul 29 04:27:26.082697 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:26.082531    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" event={"ID":"fb4e040c-c5c9-437e-bf3d-1084e6542999","Type":"ContainerStarted","Data":"607acf7386529f702b1ee3bdd20733a2ad09aa15d291b8894e9b0ca236e47b93"}
Jul 29 04:27:26.100781 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:26.100719    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" podStartSLOduration=1.100698523 podStartE2EDuration="1.100698523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:27:26.10030707 +0000 UTC m=+1926.695407789" watchObservedRunningTime="2026-07-29 04:27:26.100698523 +0000 UTC m=+1926.695799241"
Jul 29 04:27:26.606052 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:26.606017    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:26.610691 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:26.610662    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:27.087923 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:27.087893    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:27.088911 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:27.088891    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:27.775526 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:27.775471    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:27:29.476090 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.476061    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:27:29.562934 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.562906    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-token\") pod \"70eac554-7135-4a4b-b2e5-d8456de188e5\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") "
Jul 29 04:27:29.563118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.562954    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-certs\") pod \"70eac554-7135-4a4b-b2e5-d8456de188e5\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") "
Jul 29 04:27:29.563118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.562981    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-socket\") pod \"70eac554-7135-4a4b-b2e5-d8456de188e5\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") "
Jul 29 04:27:29.563118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.562997    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eac554-7135-4a4b-b2e5-d8456de188e5-istiod-ca-cert\") pod \"70eac554-7135-4a4b-b2e5-d8456de188e5\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") "
Jul 29 04:27:29.563118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.563015    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-credential-socket\") pod \"70eac554-7135-4a4b-b2e5-d8456de188e5\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") "
Jul 29 04:27:29.563118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.563049    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-data\") pod \"70eac554-7135-4a4b-b2e5-d8456de188e5\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") "
Jul 29 04:27:29.563118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.563096    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-podinfo\") pod \"70eac554-7135-4a4b-b2e5-d8456de188e5\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") "
Jul 29 04:27:29.563118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.563116    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnzd5\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-kube-api-access-xnzd5\") pod \"70eac554-7135-4a4b-b2e5-d8456de188e5\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") "
Jul 29 04:27:29.563462 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.563138    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-envoy\") pod \"70eac554-7135-4a4b-b2e5-d8456de188e5\" (UID: \"70eac554-7135-4a4b-b2e5-d8456de188e5\") "
Jul 29 04:27:29.563462 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.563275    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70eac554-7135-4a4b-b2e5-d8456de188e5" (UID: "70eac554-7135-4a4b-b2e5-d8456de188e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:27:29.563462 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.563431    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70eac554-7135-4a4b-b2e5-d8456de188e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70eac554-7135-4a4b-b2e5-d8456de188e5" (UID: "70eac554-7135-4a4b-b2e5-d8456de188e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:27:29.563662 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.563566    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70eac554-7135-4a4b-b2e5-d8456de188e5" (UID: "70eac554-7135-4a4b-b2e5-d8456de188e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:27:29.563706 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.563655    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70eac554-7135-4a4b-b2e5-d8456de188e5" (UID: "70eac554-7135-4a4b-b2e5-d8456de188e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:27:29.564251 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.564191    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "70eac554-7135-4a4b-b2e5-d8456de188e5" (UID: "70eac554-7135-4a4b-b2e5-d8456de188e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:27:29.565656 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.565624    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-kube-api-access-xnzd5" (OuterVolumeSpecName: "kube-api-access-xnzd5") pod "70eac554-7135-4a4b-b2e5-d8456de188e5" (UID: "70eac554-7135-4a4b-b2e5-d8456de188e5"). InnerVolumeSpecName "kube-api-access-xnzd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:27:29.565756 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.565672    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70eac554-7135-4a4b-b2e5-d8456de188e5" (UID: "70eac554-7135-4a4b-b2e5-d8456de188e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:27:29.565941 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.565925    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "70eac554-7135-4a4b-b2e5-d8456de188e5" (UID: "70eac554-7135-4a4b-b2e5-d8456de188e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:27:29.565987 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.565972    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70eac554-7135-4a4b-b2e5-d8456de188e5" (UID: "70eac554-7135-4a4b-b2e5-d8456de188e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:27:29.663881 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.663846    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:27:29.663881 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.663873    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:27:29.663881 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.663882    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:27:29.663881 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.663890    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70eac554-7135-4a4b-b2e5-d8456de188e5-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:27:29.664213 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.663898    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:27:29.664213 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.663908    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:27:29.664213 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.663915    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:27:29.664213 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.663923    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnzd5\" (UniqueName: \"kubernetes.io/projected/70eac554-7135-4a4b-b2e5-d8456de188e5-kube-api-access-xnzd5\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:27:29.664213 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:29.663931    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70eac554-7135-4a4b-b2e5-d8456de188e5-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:27:30.102893 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.102843    2573 generic.go:356] "Generic (PLEG): container finished" podID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerID="e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d" exitCode=0
Jul 29 04:27:30.103057 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.102909    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"
Jul 29 04:27:30.103057 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.102915    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" event={"ID":"70eac554-7135-4a4b-b2e5-d8456de188e5","Type":"ContainerDied","Data":"e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d"}
Jul 29 04:27:30.103057 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.102976    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9" event={"ID":"70eac554-7135-4a4b-b2e5-d8456de188e5","Type":"ContainerDied","Data":"173bf4e170f6e8c487cc0d92aba31ed859332756ec6403ae4b3cf0e8452e04a8"}
Jul 29 04:27:30.103057 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.103006    2573 scope.go:117] "RemoveContainer" containerID="e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d"
Jul 29 04:27:30.111886 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.111869    2573 scope.go:117] "RemoveContainer" containerID="e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351"
Jul 29 04:27:30.121402 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.121381    2573 scope.go:117] "RemoveContainer" containerID="e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d"
Jul 29 04:27:30.121713 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:27:30.121692    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d\": container with ID starting with e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d not found: ID does not exist" containerID="e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d"
Jul 29 04:27:30.121783 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.121727    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d"} err="failed to get container status \"e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d\": rpc error: code = NotFound desc = could not find container \"e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d\": container with ID starting with e26bdbe160483e476d32aa6aa74f0f67d8ac2170ba60cfa4d488288cb433f07d not found: ID does not exist"
Jul 29 04:27:30.121783 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.121754    2573 scope.go:117] "RemoveContainer" containerID="e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351"
Jul 29 04:27:30.122061 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:27:30.122036    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351\": container with ID starting with e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351 not found: ID does not exist" containerID="e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351"
Jul 29 04:27:30.122144 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.122068    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351"} err="failed to get container status \"e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351\": rpc error: code = NotFound desc = could not find container \"e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351\": container with ID starting with e373f51126bafcfad47aa83b9df953ea9765bc6b4a478fcb6efcde4831b5d351 not found: ID does not exist"
Jul 29 04:27:30.122997 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.122978    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"]
Jul 29 04:27:30.126318 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:30.126270    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-dd29cdf8-openshift-default-979475f6-zj2n9"]
Jul 29 04:27:31.866674 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:31.866641    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" path="/var/lib/kubelet/pods/70eac554-7135-4a4b-b2e5-d8456de188e5/volumes"
Jul 29 04:27:38.453894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:38.453849    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:27:42.089960 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:42.089925    2573 patch_prober.go:28] interesting pod/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 29 04:27:42.090367 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:42.089993    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 29 04:27:42.159044 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:42.159009    2573 generic.go:356] "Generic (PLEG): container finished" podID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerID="0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b" exitCode=0
Jul 29 04:27:42.159220 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:42.159081    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" event={"ID":"fb4e040c-c5c9-437e-bf3d-1084e6542999","Type":"ContainerDied","Data":"0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b"}
Jul 29 04:27:42.159483 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:42.159469    2573 scope.go:117] "RemoveContainer" containerID="0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b"
Jul 29 04:27:42.160633 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:42.160604    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:27:42.160714 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:42.160693    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:27:42.160756 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:42.160741    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:27:43.165339 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:43.165302    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" event={"ID":"fb4e040c-c5c9-437e-bf3d-1084e6542999","Type":"ContainerStarted","Data":"32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e"}
Jul 29 04:27:43.605663 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:43.605628    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:43.605867 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:43.605843    2573 patch_prober.go:28] interesting pod/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 29 04:27:43.605930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:43.605906    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 29 04:27:44.606226 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:44.606192    2573 patch_prober.go:28] interesting pod/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 29 04:27:44.606642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:44.606262    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 29 04:27:45.606588 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:45.606551    2573 patch_prober.go:28] interesting pod/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 29 04:27:45.606966 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:45.606607    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 29 04:27:46.606305 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:46.606262    2573 patch_prober.go:28] interesting pod/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 29 04:27:46.606537 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:46.606322    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 29 04:27:47.609559 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:47.609528    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:47.609936 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:47.609809    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:47.610403 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:47.610387    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:27:59.331518 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:59.331459    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"]
Jul 29 04:27:59.332478 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:27:59.332409    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy" containerID="cri-o://32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e" gracePeriod=30
Jul 29 04:28:00.086159 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.086122    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"]
Jul 29 04:28:00.087173 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.087147    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy"
Jul 29 04:28:00.087339 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.087326    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy"
Jul 29 04:28:00.087439 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.087429    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy"
Jul 29 04:28:00.087539 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.087529    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy"
Jul 29 04:28:00.087812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.087798    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy"
Jul 29 04:28:00.087904 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.087893    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="70eac554-7135-4a4b-b2e5-d8456de188e5" containerName="istio-proxy"
Jul 29 04:28:00.093276 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.093250    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.096138 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.096110    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4dcdbfe9-openshift-default-dockercfg-w7rb9\""
Jul 29 04:28:00.099288 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.099261    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"]
Jul 29 04:28:00.233786 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.233755    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqbmm\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-kube-api-access-bqbmm\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.233975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.233794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-certs\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.233975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.233865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-socket\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.233975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.233905    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-podinfo\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.233975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.233943    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-envoy\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.233975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.233966    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istiod-ca-cert\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.234170 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.234005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-credential-socket\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.234170 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.234021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-data\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.234170 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.234056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-token\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.335400 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.335365    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-token\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.335892 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.335418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqbmm\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-kube-api-access-bqbmm\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.335892 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.335454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-certs\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.335892 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.335537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-socket\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.335892 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.335660    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-podinfo\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.335892 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.335722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-envoy\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.335892 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.335752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istiod-ca-cert\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.335892 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.335814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-credential-socket\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.335892 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.335840    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-data\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.336330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.336005    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-socket\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.336330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.336108    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-certs\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.336330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.336189    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-data\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.336330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.336249    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-credential-socket\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.336531 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.336481    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istiod-ca-cert\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.338050 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.338031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-envoy\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.338265 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.338247    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-podinfo\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.343258 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.343238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqbmm\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-kube-api-access-bqbmm\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.343368 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.343332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-token\") pod \"e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") " pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.405646 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.405614    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:00.540520 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.540481    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"]
Jul 29 04:28:00.542734 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:28:00.542694    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5451882_1e20_4c8f_a5b6_fd27f37a83d3.slice/crio-cabace35d09fb890e020868c0b53907d86cc27c936e1e803a16ec5d6feb248a9 WatchSource:0}: Error finding container cabace35d09fb890e020868c0b53907d86cc27c936e1e803a16ec5d6feb248a9: Status 404 returned error can't find the container with id cabace35d09fb890e020868c0b53907d86cc27c936e1e803a16ec5d6feb248a9
Jul 29 04:28:00.544825 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.544792    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:00.544917 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.544859    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:00.544917 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:00.544888    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:01.248303 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:01.248265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" event={"ID":"e5451882-1e20-4c8f-a5b6-fd27f37a83d3","Type":"ContainerStarted","Data":"dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca"}
Jul 29 04:28:01.248510 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:01.248329    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" event={"ID":"e5451882-1e20-4c8f-a5b6-fd27f37a83d3","Type":"ContainerStarted","Data":"cabace35d09fb890e020868c0b53907d86cc27c936e1e803a16ec5d6feb248a9"}
Jul 29 04:28:01.268593 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:01.268533    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" podStartSLOduration=1.268458142 podStartE2EDuration="1.268458142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:28:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:28:01.26677333 +0000 UTC m=+1961.861874044" watchObservedRunningTime="2026-07-29 04:28:01.268458142 +0000 UTC m=+1961.863558858"
Jul 29 04:28:01.406066 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:01.406032    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:01.411258 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:01.411231    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:02.253773 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:02.253746    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:02.254893 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:02.254871    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:02.574187 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:02.574149    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:28:02.613079 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:02.613032    2573 patch_prober.go:28] interesting pod/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 29 04:28:02.613261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:02.613106    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:28:04.595312 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.595252    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:28:04.777189 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777143    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-data\") pod \"fb4e040c-c5c9-437e-bf3d-1084e6542999\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") "
Jul 29 04:28:04.777419 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777213    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-credential-socket\") pod \"fb4e040c-c5c9-437e-bf3d-1084e6542999\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") "
Jul 29 04:28:04.777419 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777263    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb4e040c-c5c9-437e-bf3d-1084e6542999-istiod-ca-cert\") pod \"fb4e040c-c5c9-437e-bf3d-1084e6542999\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") "
Jul 29 04:28:04.777419 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777300    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-token\") pod \"fb4e040c-c5c9-437e-bf3d-1084e6542999\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") "
Jul 29 04:28:04.777419 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777324    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-socket\") pod \"fb4e040c-c5c9-437e-bf3d-1084e6542999\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") "
Jul 29 04:28:04.777419 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777365    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-podinfo\") pod \"fb4e040c-c5c9-437e-bf3d-1084e6542999\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") "
Jul 29 04:28:04.777647 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777478    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb4e040c-c5c9-437e-bf3d-1084e6542999" (UID: "fb4e040c-c5c9-437e-bf3d-1084e6542999"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:04.777647 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777563    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-envoy\") pod \"fb4e040c-c5c9-437e-bf3d-1084e6542999\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") "
Jul 29 04:28:04.777719 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777683    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-certs\") pod \"fb4e040c-c5c9-437e-bf3d-1084e6542999\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") "
Jul 29 04:28:04.777719 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777685    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb4e040c-c5c9-437e-bf3d-1084e6542999" (UID: "fb4e040c-c5c9-437e-bf3d-1084e6542999"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:04.777820 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777719    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpbwq\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-kube-api-access-kpbwq\") pod \"fb4e040c-c5c9-437e-bf3d-1084e6542999\" (UID: \"fb4e040c-c5c9-437e-bf3d-1084e6542999\") "
Jul 29 04:28:04.777820 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777784    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb4e040c-c5c9-437e-bf3d-1084e6542999-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb4e040c-c5c9-437e-bf3d-1084e6542999" (UID: "fb4e040c-c5c9-437e-bf3d-1084e6542999"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:28:04.777925 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.777905    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb4e040c-c5c9-437e-bf3d-1084e6542999" (UID: "fb4e040c-c5c9-437e-bf3d-1084e6542999"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:04.778037 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.778016    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:04.778098 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.778042    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:04.778098 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.778056    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:04.778098 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.778071    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb4e040c-c5c9-437e-bf3d-1084e6542999-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:04.778397 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.778210    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb4e040c-c5c9-437e-bf3d-1084e6542999" (UID: "fb4e040c-c5c9-437e-bf3d-1084e6542999"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:04.779861 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.779832    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb4e040c-c5c9-437e-bf3d-1084e6542999" (UID: "fb4e040c-c5c9-437e-bf3d-1084e6542999"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:28:04.779965 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.779870    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb4e040c-c5c9-437e-bf3d-1084e6542999" (UID: "fb4e040c-c5c9-437e-bf3d-1084e6542999"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:28:04.779965 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.779871    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb4e040c-c5c9-437e-bf3d-1084e6542999" (UID: "fb4e040c-c5c9-437e-bf3d-1084e6542999"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:04.779965 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.779959    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-kube-api-access-kpbwq" (OuterVolumeSpecName: "kube-api-access-kpbwq") pod "fb4e040c-c5c9-437e-bf3d-1084e6542999" (UID: "fb4e040c-c5c9-437e-bf3d-1084e6542999"). InnerVolumeSpecName "kube-api-access-kpbwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:28:04.879261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.879190    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:04.879261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.879214    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:04.879261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.879224    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:04.879261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.879232    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpbwq\" (UniqueName: \"kubernetes.io/projected/fb4e040c-c5c9-437e-bf3d-1084e6542999-kube-api-access-kpbwq\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:04.879261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:04.879241    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb4e040c-c5c9-437e-bf3d-1084e6542999-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:05.269060 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.268969    2573 generic.go:356] "Generic (PLEG): container finished" podID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerID="32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e" exitCode=0
Jul 29 04:28:05.269060 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.269028    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"
Jul 29 04:28:05.269060 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.269050    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" event={"ID":"fb4e040c-c5c9-437e-bf3d-1084e6542999","Type":"ContainerDied","Data":"32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e"}
Jul 29 04:28:05.269302 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.269110    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm" event={"ID":"fb4e040c-c5c9-437e-bf3d-1084e6542999","Type":"ContainerDied","Data":"607acf7386529f702b1ee3bdd20733a2ad09aa15d291b8894e9b0ca236e47b93"}
Jul 29 04:28:05.269302 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.269144    2573 scope.go:117] "RemoveContainer" containerID="32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e"
Jul 29 04:28:05.278031 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.278014    2573 scope.go:117] "RemoveContainer" containerID="0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b"
Jul 29 04:28:05.285981 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.285960    2573 scope.go:117] "RemoveContainer" containerID="32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e"
Jul 29 04:28:05.286227 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:28:05.286211    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e\": container with ID starting with 32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e not found: ID does not exist" containerID="32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e"
Jul 29 04:28:05.286269 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.286235    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e"} err="failed to get container status \"32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e\": rpc error: code = NotFound desc = could not find container \"32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e\": container with ID starting with 32ac4f0ae08f898d76d663424bccddeb43f7a97e4c85a14fff86accf575ffe4e not found: ID does not exist"
Jul 29 04:28:05.286269 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.286251    2573 scope.go:117] "RemoveContainer" containerID="0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b"
Jul 29 04:28:05.286472 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:28:05.286456    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b\": container with ID starting with 0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b not found: ID does not exist" containerID="0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b"
Jul 29 04:28:05.286530 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.286477    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b"} err="failed to get container status \"0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b\": rpc error: code = NotFound desc = could not find container \"0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b\": container with ID starting with 0960afb9c957ff8440548dc0cefde0e06e4b156bfdded77786b0bd3b45eab73b not found: ID does not exist"
Jul 29 04:28:05.289393 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.289373    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"]
Jul 29 04:28:05.294764 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.294745    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-74690011-gw-openshift-default-54f9b649d8-rnvmm"]
Jul 29 04:28:05.868211 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:05.868177    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" path="/var/lib/kubelet/pods/fb4e040c-c5c9-437e-bf3d-1084e6542999/volumes"
Jul 29 04:28:13.059147 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:13.059112    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:28:17.255353 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:17.255242    2573 patch_prober.go:28] interesting pod/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 29 04:28:17.255353 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:17.255312    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 29 04:28:17.335697 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:17.335660    2573 generic.go:356] "Generic (PLEG): container finished" podID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerID="dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca" exitCode=0
Jul 29 04:28:17.335859 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:17.335733    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" event={"ID":"e5451882-1e20-4c8f-a5b6-fd27f37a83d3","Type":"ContainerDied","Data":"dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca"}
Jul 29 04:28:17.336159 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:17.336144    2573 scope.go:117] "RemoveContainer" containerID="dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca"
Jul 29 04:28:17.337134 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:17.337107    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:17.337205 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:17.337189    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:17.337270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:17.337255    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:18.342203 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:18.342162    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" event={"ID":"e5451882-1e20-4c8f-a5b6-fd27f37a83d3","Type":"ContainerStarted","Data":"20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876"}
Jul 29 04:28:18.405792 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:18.405759    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:18.405975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:18.405953    2573 patch_prober.go:28] interesting pod/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 29 04:28:18.406022 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:18.405999    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 29 04:28:19.406012 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:19.405980    2573 patch_prober.go:28] interesting pod/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 29 04:28:19.406424 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:19.406044    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 29 04:28:20.406683 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:20.406652    2573 patch_prober.go:28] interesting pod/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 29 04:28:20.407076 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:20.406710    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 29 04:28:21.406346 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:21.406301    2573 patch_prober.go:28] interesting pod/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 29 04:28:21.406596 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:21.406370    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 29 04:28:22.406897 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:22.406850    2573 patch_prober.go:28] interesting pod/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 29 04:28:22.407458 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:22.406906    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 29 04:28:23.410302 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:23.410268    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:23.410701 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:23.410600    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:23.411268 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:23.411252    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:34.626040 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:34.626004    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"]
Jul 29 04:28:34.626923 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:34.626243    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy" containerID="cri-o://20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876" gracePeriod=30
Jul 29 04:28:35.339912 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.339882    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"]
Jul 29 04:28:35.340193 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.340181    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy"
Jul 29 04:28:35.340242 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.340195    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy"
Jul 29 04:28:35.340277 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.340261    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy"
Jul 29 04:28:35.340277 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.340269    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy"
Jul 29 04:28:35.343279 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.343262    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.346338 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.346321    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a77d4166-openshift-default-dockercfg-d5qfb\""
Jul 29 04:28:35.355095 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.355069    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"]
Jul 29 04:28:35.436764 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.436719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d7320-64e2-4d3b-897b-dc7723047bfe-istiod-ca-cert\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.436969 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.436799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-socket\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.436969 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.436840    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-credential-socket\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.436969 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.436926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-podinfo\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.437133 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.436976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-272rb\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-kube-api-access-272rb\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.437133 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.437005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-data\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.437133 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.437035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-token\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.437133 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.437062    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-envoy\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.437133 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.437116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-certs\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538115 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538074    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-podinfo\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538303 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-272rb\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-kube-api-access-272rb\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538303 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-data\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538303 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-token\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538303 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-envoy\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538303 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538259    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-certs\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538303 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d7320-64e2-4d3b-897b-dc7723047bfe-istiod-ca-cert\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538604 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-socket\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538604 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538369    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-credential-socket\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.538882 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-data\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.539132 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538894    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-certs\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.539132 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.538911    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-credential-socket\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.539132 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.539070    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d7320-64e2-4d3b-897b-dc7723047bfe-istiod-ca-cert\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.539132 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.539072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-socket\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.540831 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.540799    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-envoy\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.540939 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.540877    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-podinfo\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.546098 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.546069    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-272rb\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-kube-api-access-272rb\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.546187 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.546109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-token\") pod \"e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") " pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.653423 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.653320    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:35.791352 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.791319    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"]
Jul 29 04:28:35.794813 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:28:35.794775    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922d7320_64e2_4d3b_897b_dc7723047bfe.slice/crio-44148c8b17769e394fb5b6cc7f844f991ae14f3934454999ae0c84028b61cd1f WatchSource:0}: Error finding container 44148c8b17769e394fb5b6cc7f844f991ae14f3934454999ae0c84028b61cd1f: Status 404 returned error can't find the container with id 44148c8b17769e394fb5b6cc7f844f991ae14f3934454999ae0c84028b61cd1f
Jul 29 04:28:35.797829 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.797771    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:35.797940 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.797866    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:35.797940 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:35.797901    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:36.421401 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:36.421364    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" event={"ID":"922d7320-64e2-4d3b-897b-dc7723047bfe","Type":"ContainerStarted","Data":"b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6"}
Jul 29 04:28:36.421599 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:36.421419    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" event={"ID":"922d7320-64e2-4d3b-897b-dc7723047bfe","Type":"ContainerStarted","Data":"44148c8b17769e394fb5b6cc7f844f991ae14f3934454999ae0c84028b61cd1f"}
Jul 29 04:28:36.440330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:36.440275    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" podStartSLOduration=1.440256378 podStartE2EDuration="1.440256378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:28:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:28:36.438775267 +0000 UTC m=+1997.033875981" watchObservedRunningTime="2026-07-29 04:28:36.440256378 +0000 UTC m=+1997.035357097"
Jul 29 04:28:36.653543 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:36.653508    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:36.658337 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:36.658305    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:37.058082 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:37.058047    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:28:37.426486 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:37.426403    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:37.427298 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:37.427275    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:38.412825 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:38.412794    2573 patch_prober.go:28] interesting pod/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 04:28:38.413188 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:38.412847    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:28:39.885830 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.885802    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:39.978617 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978525    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-credential-socket\") pod \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") "
Jul 29 04:28:39.978617 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978580    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-certs\") pod \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") "
Jul 29 04:28:39.978617 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978614    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-socket\") pod \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") "
Jul 29 04:28:39.978894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978643    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istiod-ca-cert\") pod \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") "
Jul 29 04:28:39.978894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978686    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-data\") pod \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") "
Jul 29 04:28:39.978894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-envoy\") pod \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") "
Jul 29 04:28:39.978894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978775    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqbmm\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-kube-api-access-bqbmm\") pod \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") "
Jul 29 04:28:39.978894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978801    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-podinfo\") pod \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") "
Jul 29 04:28:39.978894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5451882-1e20-4c8f-a5b6-fd27f37a83d3" (UID: "e5451882-1e20-4c8f-a5b6-fd27f37a83d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:39.978894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978855    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-token\") pod \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\" (UID: \"e5451882-1e20-4c8f-a5b6-fd27f37a83d3\") "
Jul 29 04:28:39.978894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978877    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5451882-1e20-4c8f-a5b6-fd27f37a83d3" (UID: "e5451882-1e20-4c8f-a5b6-fd27f37a83d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:39.979250 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.978983    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5451882-1e20-4c8f-a5b6-fd27f37a83d3" (UID: "e5451882-1e20-4c8f-a5b6-fd27f37a83d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:39.979250 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.979053    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5451882-1e20-4c8f-a5b6-fd27f37a83d3" (UID: "e5451882-1e20-4c8f-a5b6-fd27f37a83d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:28:39.979250 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.979169    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:39.979250 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.979187    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:39.979250 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.979203    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:39.979535 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.979215    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:39.980948 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.980911    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5451882-1e20-4c8f-a5b6-fd27f37a83d3" (UID: "e5451882-1e20-4c8f-a5b6-fd27f37a83d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:39.981669 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.981621    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-kube-api-access-bqbmm" (OuterVolumeSpecName: "kube-api-access-bqbmm") pod "e5451882-1e20-4c8f-a5b6-fd27f37a83d3" (UID: "e5451882-1e20-4c8f-a5b6-fd27f37a83d3"). InnerVolumeSpecName "kube-api-access-bqbmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:28:39.981759 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.981690    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5451882-1e20-4c8f-a5b6-fd27f37a83d3" (UID: "e5451882-1e20-4c8f-a5b6-fd27f37a83d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:28:39.981759 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.981696    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5451882-1e20-4c8f-a5b6-fd27f37a83d3" (UID: "e5451882-1e20-4c8f-a5b6-fd27f37a83d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:28:39.981759 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:39.981711    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5451882-1e20-4c8f-a5b6-fd27f37a83d3" (UID: "e5451882-1e20-4c8f-a5b6-fd27f37a83d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:28:40.080543 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.080485    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:40.080543 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.080545    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqbmm\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-kube-api-access-bqbmm\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:40.080750 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.080559    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:40.080750 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.080575    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:40.080750 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.080587    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5451882-1e20-4c8f-a5b6-fd27f37a83d3-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:28:40.441122 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.441087    2573 generic.go:356] "Generic (PLEG): container finished" podID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerID="20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876" exitCode=0
Jul 29 04:28:40.441292 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.441151    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" event={"ID":"e5451882-1e20-4c8f-a5b6-fd27f37a83d3","Type":"ContainerDied","Data":"20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876"}
Jul 29 04:28:40.441292 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.441217    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4" event={"ID":"e5451882-1e20-4c8f-a5b6-fd27f37a83d3","Type":"ContainerDied","Data":"cabace35d09fb890e020868c0b53907d86cc27c936e1e803a16ec5d6feb248a9"}
Jul 29 04:28:40.441292 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.441153    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"
Jul 29 04:28:40.441292 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.441239    2573 scope.go:117] "RemoveContainer" containerID="20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876"
Jul 29 04:28:40.450629 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.450611    2573 scope.go:117] "RemoveContainer" containerID="dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca"
Jul 29 04:28:40.458448 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.458429    2573 scope.go:117] "RemoveContainer" containerID="20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876"
Jul 29 04:28:40.458755 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:28:40.458732    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876\": container with ID starting with 20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876 not found: ID does not exist" containerID="20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876"
Jul 29 04:28:40.458810 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.458764    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876"} err="failed to get container status \"20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876\": rpc error: code = NotFound desc = could not find container \"20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876\": container with ID starting with 20cb92142e9ef5bd762dad5737f4eb63abdf2eca9715f6ff3ebe522120b19876 not found: ID does not exist"
Jul 29 04:28:40.458810 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.458784    2573 scope.go:117] "RemoveContainer" containerID="dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca"
Jul 29 04:28:40.459004 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:28:40.458986    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca\": container with ID starting with dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca not found: ID does not exist" containerID="dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca"
Jul 29 04:28:40.459056 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.459014    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca"} err="failed to get container status \"dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca\": rpc error: code = NotFound desc = could not find container \"dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca\": container with ID starting with dcc1bfb0c69c0a565ab026a8546bcbcfbcd5446218018a572893c8768523f2ca not found: ID does not exist"
Jul 29 04:28:40.463070 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.463046    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"]
Jul 29 04:28:40.466704 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:40.466684    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4dcdbfe9-openshift-default-d94cfc74-vknp4"]
Jul 29 04:28:41.867584 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:41.867553    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" path="/var/lib/kubelet/pods/e5451882-1e20-4c8f-a5b6-fd27f37a83d3/volumes"
Jul 29 04:28:47.952338 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:47.952301    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:28:51.499877 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:51.499843    2573 generic.go:356] "Generic (PLEG): container finished" podID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerID="b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6" exitCode=0
Jul 29 04:28:51.500298 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:51.499915    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" event={"ID":"922d7320-64e2-4d3b-897b-dc7723047bfe","Type":"ContainerDied","Data":"b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6"}
Jul 29 04:28:51.500298 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:51.500274    2573 scope.go:117] "RemoveContainer" containerID="b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6"
Jul 29 04:28:51.501238 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:51.501214    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:51.501295 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:51.501278    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:51.501350 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:51.501311    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:28:52.427156 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:52.427103    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:52.508554 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:52.508518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" event={"ID":"922d7320-64e2-4d3b-897b-dc7723047bfe","Type":"ContainerStarted","Data":"a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939"}
Jul 29 04:28:52.653855 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:52.653817    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:52.655058 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:52.655030    2573 patch_prober.go:28] interesting pod/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 29 04:28:52.655195 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:52.655087    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 29 04:28:53.654477 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:53.654445    2573 patch_prober.go:28] interesting pod/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 29 04:28:53.654887 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:53.654520    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 29 04:28:54.654793 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:54.654753    2573 patch_prober.go:28] interesting pod/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 29 04:28:54.655202 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:54.654817    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 29 04:28:55.654747 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:55.654708    2573 patch_prober.go:28] interesting pod/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 29 04:28:55.654919 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:55.654767    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 29 04:28:56.658440 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:56.658412    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:56.658828 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:56.658724    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:28:56.659477 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:28:56.659457    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:29:08.688851 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:08.688810    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"]
Jul 29 04:29:08.689389 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:08.689068    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy" containerID="cri-o://a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939" gracePeriod=30
Jul 29 04:29:10.368335 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:10.368294    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:29:11.661368 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:11.661333    2573 patch_prober.go:28] interesting pod/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 04:29:11.661778 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:11.661395    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:29:13.937720 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.937687    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:29:13.974400 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974326    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d7320-64e2-4d3b-897b-dc7723047bfe-istiod-ca-cert\") pod \"922d7320-64e2-4d3b-897b-dc7723047bfe\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") "
Jul 29 04:29:13.974400 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974368    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-credential-socket\") pod \"922d7320-64e2-4d3b-897b-dc7723047bfe\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") "
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974403    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-envoy\") pod \"922d7320-64e2-4d3b-897b-dc7723047bfe\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") "
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-socket\") pod \"922d7320-64e2-4d3b-897b-dc7723047bfe\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") "
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974467    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-podinfo\") pod \"922d7320-64e2-4d3b-897b-dc7723047bfe\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") "
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974519    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-token\") pod \"922d7320-64e2-4d3b-897b-dc7723047bfe\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") "
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974552    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-272rb\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-kube-api-access-272rb\") pod \"922d7320-64e2-4d3b-897b-dc7723047bfe\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") "
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974594    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-data\") pod \"922d7320-64e2-4d3b-897b-dc7723047bfe\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") "
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974630    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-certs\") pod \"922d7320-64e2-4d3b-897b-dc7723047bfe\" (UID: \"922d7320-64e2-4d3b-897b-dc7723047bfe\") "
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974644    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "922d7320-64e2-4d3b-897b-dc7723047bfe" (UID: "922d7320-64e2-4d3b-897b-dc7723047bfe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974829    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/922d7320-64e2-4d3b-897b-dc7723047bfe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "922d7320-64e2-4d3b-897b-dc7723047bfe" (UID: "922d7320-64e2-4d3b-897b-dc7723047bfe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:29:13.974953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.974871    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:29:13.975465 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.975065    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "922d7320-64e2-4d3b-897b-dc7723047bfe" (UID: "922d7320-64e2-4d3b-897b-dc7723047bfe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:29:13.975465 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.975103    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "922d7320-64e2-4d3b-897b-dc7723047bfe" (UID: "922d7320-64e2-4d3b-897b-dc7723047bfe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:29:13.975831 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.975805    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-data" (OuterVolumeSpecName: "istio-data") pod "922d7320-64e2-4d3b-897b-dc7723047bfe" (UID: "922d7320-64e2-4d3b-897b-dc7723047bfe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:29:13.977036 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.977016    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "922d7320-64e2-4d3b-897b-dc7723047bfe" (UID: "922d7320-64e2-4d3b-897b-dc7723047bfe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:29:13.977525 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.977472    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-token" (OuterVolumeSpecName: "istio-token") pod "922d7320-64e2-4d3b-897b-dc7723047bfe" (UID: "922d7320-64e2-4d3b-897b-dc7723047bfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:29:13.977596 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.977553    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "922d7320-64e2-4d3b-897b-dc7723047bfe" (UID: "922d7320-64e2-4d3b-897b-dc7723047bfe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:29:13.977596 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:13.977567    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-kube-api-access-272rb" (OuterVolumeSpecName: "kube-api-access-272rb") pod "922d7320-64e2-4d3b-897b-dc7723047bfe" (UID: "922d7320-64e2-4d3b-897b-dc7723047bfe"). InnerVolumeSpecName "kube-api-access-272rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:29:14.075462 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.075423    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:29:14.075462 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.075458    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:29:14.075462 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.075467    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-272rb\" (UniqueName: \"kubernetes.io/projected/922d7320-64e2-4d3b-897b-dc7723047bfe-kube-api-access-272rb\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:29:14.075717 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.075477    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:29:14.075717 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.075486    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:29:14.075717 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.075524    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d7320-64e2-4d3b-897b-dc7723047bfe-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:29:14.075717 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.075536    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:29:14.075717 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.075548    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d7320-64e2-4d3b-897b-dc7723047bfe-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:29:14.603256 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.603195    2573 generic.go:356] "Generic (PLEG): container finished" podID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerID="a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939" exitCode=0
Jul 29 04:29:14.603256 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.603251    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"
Jul 29 04:29:14.603529 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.603285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" event={"ID":"922d7320-64e2-4d3b-897b-dc7723047bfe","Type":"ContainerDied","Data":"a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939"}
Jul 29 04:29:14.603529 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.603358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7" event={"ID":"922d7320-64e2-4d3b-897b-dc7723047bfe","Type":"ContainerDied","Data":"44148c8b17769e394fb5b6cc7f844f991ae14f3934454999ae0c84028b61cd1f"}
Jul 29 04:29:14.603529 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.603379    2573 scope.go:117] "RemoveContainer" containerID="a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939"
Jul 29 04:29:14.613461 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.613445    2573 scope.go:117] "RemoveContainer" containerID="b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6"
Jul 29 04:29:14.623210 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.623189    2573 scope.go:117] "RemoveContainer" containerID="a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939"
Jul 29 04:29:14.623545 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:29:14.623521    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939\": container with ID starting with a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939 not found: ID does not exist" containerID="a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939"
Jul 29 04:29:14.623667 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.623554    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939"} err="failed to get container status \"a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939\": rpc error: code = NotFound desc = could not find container \"a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939\": container with ID starting with a1b17abcd5002230f210e72aaf7981790d30327366e1cd9b30e74abf21f58939 not found: ID does not exist"
Jul 29 04:29:14.623667 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.623579    2573 scope.go:117] "RemoveContainer" containerID="b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6"
Jul 29 04:29:14.623826 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:29:14.623808    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6\": container with ID starting with b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6 not found: ID does not exist" containerID="b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6"
Jul 29 04:29:14.623887 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.623829    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6"} err="failed to get container status \"b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6\": rpc error: code = NotFound desc = could not find container \"b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6\": container with ID starting with b77dbc13e41ead1ea9b2ccbd6771d479f8a058d5128b3631913eb37566a8d7c6 not found: ID does not exist"
Jul 29 04:29:14.627972 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.627946    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"]
Jul 29 04:29:14.631444 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:14.631418    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a77d4166-openshift-default-6c6875688d-wlms7"]
Jul 29 04:29:15.867687 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:15.867644    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" path="/var/lib/kubelet/pods/922d7320-64e2-4d3b-897b-dc7723047bfe/volumes"
Jul 29 04:29:19.254021 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:19.253980    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:29:35.257285 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:29:35.257247    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:30:00.134072 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134034    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t"]
Jul 29 04:30:00.134485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134361    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy"
Jul 29 04:30:00.134485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134377    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy"
Jul 29 04:30:00.134485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134395    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy"
Jul 29 04:30:00.134485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134401    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4e040c-c5c9-437e-bf3d-1084e6542999" containerName="istio-proxy"
Jul 29 04:30:00.134485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134408    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy"
Jul 29 04:30:00.134485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134414    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy"
Jul 29 04:30:00.134485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134421    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy"
Jul 29 04:30:00.134485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134426    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy"
Jul 29 04:30:00.134485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134506    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy"
Jul 29 04:30:00.134797 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134516    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy"
Jul 29 04:30:00.134797 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.134527    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy"
Jul 29 04:30:00.137300 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.137283    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t"
Jul 29 04:30:00.140115 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.140092    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n8frm\""
Jul 29 04:30:00.144154 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.144127    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t"]
Jul 29 04:30:00.148130 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.148112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t"
Jul 29 04:30:00.280033 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.280000    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t"]
Jul 29 04:30:00.283075 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:30:00.283038    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeeec27b_09e9_41c1_bea0_66bde7ec20ea.slice/crio-4a361a224628d093fa5c288d49cfa1e4e8da183817883724e52de11a8c929773 WatchSource:0}: Error finding container 4a361a224628d093fa5c288d49cfa1e4e8da183817883724e52de11a8c929773: Status 404 returned error can't find the container with id 4a361a224628d093fa5c288d49cfa1e4e8da183817883724e52de11a8c929773
Jul 29 04:30:00.284886 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.284868    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:30:00.798659 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:00.798620    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t" event={"ID":"feeec27b-09e9-41c1-bea0-66bde7ec20ea","Type":"ContainerStarted","Data":"4a361a224628d093fa5c288d49cfa1e4e8da183817883724e52de11a8c929773"}
Jul 29 04:30:04.818204 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:04.818170    2573 generic.go:356] "Generic (PLEG): container finished" podID="feeec27b-09e9-41c1-bea0-66bde7ec20ea" containerID="9e35e457f98d2ddd6b456505b9ceffa9551c2b290f674206b90a7720e3c4002f" exitCode=0
Jul 29 04:30:04.818585 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:04.818255    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t" event={"ID":"feeec27b-09e9-41c1-bea0-66bde7ec20ea","Type":"ContainerDied","Data":"9e35e457f98d2ddd6b456505b9ceffa9551c2b290f674206b90a7720e3c4002f"}
Jul 29 04:30:05.963407 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:05.963384    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t"
Jul 29 04:30:06.827563 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:06.827529    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t"
Jul 29 04:30:06.827563 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:06.827537    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-f756t" event={"ID":"feeec27b-09e9-41c1-bea0-66bde7ec20ea","Type":"ContainerDied","Data":"4a361a224628d093fa5c288d49cfa1e4e8da183817883724e52de11a8c929773"}
Jul 29 04:30:06.827847 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:30:06.827634    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a361a224628d093fa5c288d49cfa1e4e8da183817883724e52de11a8c929773"
Jul 29 04:31:03.366121 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:31:03.366083    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:33:04.572233 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:04.570384    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:33:10.086125 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.086090    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"]
Jul 29 04:33:10.086504 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.086451    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feeec27b-09e9-41c1-bea0-66bde7ec20ea" containerName="cleanup"
Jul 29 04:33:10.086504 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.086463    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="feeec27b-09e9-41c1-bea0-66bde7ec20ea" containerName="cleanup"
Jul 29 04:33:10.086504 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.086483    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy"
Jul 29 04:33:10.086621 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.086516    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="922d7320-64e2-4d3b-897b-dc7723047bfe" containerName="istio-proxy"
Jul 29 04:33:10.086621 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.086571    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5451882-1e20-4c8f-a5b6-fd27f37a83d3" containerName="istio-proxy"
Jul 29 04:33:10.086621 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.086589    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="feeec27b-09e9-41c1-bea0-66bde7ec20ea" containerName="cleanup"
Jul 29 04:33:10.089404 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.089386    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.092393 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.092366    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bd62a50a-openshift-default-dockercfg-qr7bz\""
Jul 29 04:33:10.109079 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.109045    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"]
Jul 29 04:33:10.179746 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.179707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-token\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.179957 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.179758    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-credential-socket\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.179957 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.179792    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-certs\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.179957 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.179854    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-socket\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.179957 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.179930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-data\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.180198 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.179970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4j4p\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-kube-api-access-d4j4p\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.180198 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.180026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-envoy\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.180198 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.180048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istiod-ca-cert\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.180198 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.180081    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-podinfo\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.281366 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-token\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.281366 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-credential-socket\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.281590 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-certs\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.281590 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-socket\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.281655 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281609    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-data\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.281655 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281647    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4j4p\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-kube-api-access-d4j4p\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.281763 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-envoy\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.281763 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281723    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istiod-ca-cert\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.281911 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281883    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-credential-socket\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.282105 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281949    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-certs\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.282105 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.281989    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-socket\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.282282 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.282046    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-data\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.282282 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.282075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-podinfo\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.282658 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.282636    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istiod-ca-cert\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.284194 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.284165    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-envoy\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.284521 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.284483    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-podinfo\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.291736 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.291644    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4j4p\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-kube-api-access-d4j4p\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.292100 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.292076    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-token\") pod \"e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") " pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.400544 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.400433    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:10.549702 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.549651    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"]
Jul 29 04:33:10.551950 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:33:10.551921    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fca1bae_41b1_4c77_b3ea_d3cc35095519.slice/crio-f3cf28f5f93c1d61d0a0d9debe1549955fddff17f57c1c36f80760f9b5865dd3 WatchSource:0}: Error finding container f3cf28f5f93c1d61d0a0d9debe1549955fddff17f57c1c36f80760f9b5865dd3: Status 404 returned error can't find the container with id f3cf28f5f93c1d61d0a0d9debe1549955fddff17f57c1c36f80760f9b5865dd3
Jul 29 04:33:10.554061 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.554021    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:33:10.554169 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.554093    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:33:10.554169 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.554144    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:33:10.618731 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.618702    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" event={"ID":"4fca1bae-41b1-4c77-b3ea-d3cc35095519","Type":"ContainerStarted","Data":"4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f"}
Jul 29 04:33:10.618858 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.618760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" event={"ID":"4fca1bae-41b1-4c77-b3ea-d3cc35095519","Type":"ContainerStarted","Data":"f3cf28f5f93c1d61d0a0d9debe1549955fddff17f57c1c36f80760f9b5865dd3"}
Jul 29 04:33:10.643435 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:10.643370    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" podStartSLOduration=0.643346744 podStartE2EDuration="643.346744ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:33:10.639637343 +0000 UTC m=+2271.234738059" watchObservedRunningTime="2026-07-29 04:33:10.643346744 +0000 UTC m=+2271.238447462"
Jul 29 04:33:11.400772 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:11.400733    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:11.405693 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:11.405655    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:11.623203 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:11.623169    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:11.624280 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:11.624260    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:19.265697 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:19.265657    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:33:27.082831 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:27.081741    2573 patch_prober.go:28] interesting pod/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:59224->10.133.0.36:15021: read: connection reset by peer" start-of-body=
Jul 29 04:33:27.082831 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:27.081812    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:59224->10.133.0.36:15021: read: connection reset by peer"
Jul 29 04:33:27.701121 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:27.701085    2573 generic.go:356] "Generic (PLEG): container finished" podID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerID="4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f" exitCode=0
Jul 29 04:33:27.701299 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:27.701158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" event={"ID":"4fca1bae-41b1-4c77-b3ea-d3cc35095519","Type":"ContainerDied","Data":"4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f"}
Jul 29 04:33:27.701570 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:27.701556    2573 scope.go:117] "RemoveContainer" containerID="4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f"
Jul 29 04:33:27.702579 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:27.702549    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:33:27.702692 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:27.702637    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:33:27.702692 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:27.702682    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:33:28.710068 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:28.710031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" event={"ID":"4fca1bae-41b1-4c77-b3ea-d3cc35095519","Type":"ContainerStarted","Data":"837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97"}
Jul 29 04:33:29.401456 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:29.401414    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:29.401821 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:29.401795    2573 patch_prober.go:28] interesting pod/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 29 04:33:29.401875 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:29.401851    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 29 04:33:30.401480 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:30.401443    2573 patch_prober.go:28] interesting pod/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 29 04:33:30.401480 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:30.401530    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 29 04:33:31.400926 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:31.400884    2573 patch_prober.go:28] interesting pod/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 29 04:33:31.401117 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:31.400943    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 29 04:33:32.401129 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:32.401076    2573 patch_prober.go:28] interesting pod/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 29 04:33:32.401557 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:32.401159    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 29 04:33:33.404313 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:33.404283    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:33.404734 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:33.404532    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:33.405207 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:33.405190    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:33:58.565804 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:33:58.565770    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:34:02.370294 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:02.370250    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"]
Jul 29 04:34:02.370729 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:02.370477    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy" containerID="cri-o://837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97" gracePeriod=30
Jul 29 04:34:03.406912 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:03.406876    2573 patch_prober.go:28] interesting pod/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 04:34:03.407292 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:03.406965    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:34:07.617798 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.617770    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:34:07.689823 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.689732    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-podinfo\") pod \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") "
Jul 29 04:34:07.689823 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.689790    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-token\") pod \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") "
Jul 29 04:34:07.690040 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.689835    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-certs\") pod \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") "
Jul 29 04:34:07.690040 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.689944    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-credential-socket\") pod \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") "
Jul 29 04:34:07.690040 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690010    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-data\") pod \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") "
Jul 29 04:34:07.690040 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690039    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-envoy\") pod \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") "
Jul 29 04:34:07.690257 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690078    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-socket\") pod \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") "
Jul 29 04:34:07.690257 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690111    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4j4p\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-kube-api-access-d4j4p\") pod \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") "
Jul 29 04:34:07.690257 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690113    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4fca1bae-41b1-4c77-b3ea-d3cc35095519" (UID: "4fca1bae-41b1-4c77-b3ea-d3cc35095519"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:07.690257 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690192    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istiod-ca-cert\") pod \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\" (UID: \"4fca1bae-41b1-4c77-b3ea-d3cc35095519\") "
Jul 29 04:34:07.690257 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690237    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4fca1bae-41b1-4c77-b3ea-d3cc35095519" (UID: "4fca1bae-41b1-4c77-b3ea-d3cc35095519"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:07.690542 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690442    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4fca1bae-41b1-4c77-b3ea-d3cc35095519" (UID: "4fca1bae-41b1-4c77-b3ea-d3cc35095519"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:07.690542 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690521    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.690659 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690543    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.690866 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4fca1bae-41b1-4c77-b3ea-d3cc35095519" (UID: "4fca1bae-41b1-4c77-b3ea-d3cc35095519"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:34:07.691003 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.690963    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-data" (OuterVolumeSpecName: "istio-data") pod "4fca1bae-41b1-4c77-b3ea-d3cc35095519" (UID: "4fca1bae-41b1-4c77-b3ea-d3cc35095519"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:07.692187 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.692163    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-token" (OuterVolumeSpecName: "istio-token") pod "4fca1bae-41b1-4c77-b3ea-d3cc35095519" (UID: "4fca1bae-41b1-4c77-b3ea-d3cc35095519"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:07.692294 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.692271    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4fca1bae-41b1-4c77-b3ea-d3cc35095519" (UID: "4fca1bae-41b1-4c77-b3ea-d3cc35095519"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:07.692672 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.692648    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4fca1bae-41b1-4c77-b3ea-d3cc35095519" (UID: "4fca1bae-41b1-4c77-b3ea-d3cc35095519"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:34:07.692759 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.692652    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-kube-api-access-d4j4p" (OuterVolumeSpecName: "kube-api-access-d4j4p") pod "4fca1bae-41b1-4c77-b3ea-d3cc35095519" (UID: "4fca1bae-41b1-4c77-b3ea-d3cc35095519"). InnerVolumeSpecName "kube-api-access-d4j4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:07.791268 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.791228    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.791268 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.791260    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.791268 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.791268    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fca1bae-41b1-4c77-b3ea-d3cc35095519-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.791268 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.791277    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4j4p\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-kube-api-access-d4j4p\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.791585 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.791286    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.791585 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.791295    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.791585 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.791302    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fca1bae-41b1-4c77-b3ea-d3cc35095519-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.881752 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.881720    2573 generic.go:356] "Generic (PLEG): container finished" podID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerID="837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97" exitCode=0
Jul 29 04:34:07.881895 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.881773    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"
Jul 29 04:34:07.881895 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.881808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" event={"ID":"4fca1bae-41b1-4c77-b3ea-d3cc35095519","Type":"ContainerDied","Data":"837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97"}
Jul 29 04:34:07.881895 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.881860    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz" event={"ID":"4fca1bae-41b1-4c77-b3ea-d3cc35095519","Type":"ContainerDied","Data":"f3cf28f5f93c1d61d0a0d9debe1549955fddff17f57c1c36f80760f9b5865dd3"}
Jul 29 04:34:07.881895 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.881884    2573 scope.go:117] "RemoveContainer" containerID="837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97"
Jul 29 04:34:07.890480 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.890433    2573 scope.go:117] "RemoveContainer" containerID="4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f"
Jul 29 04:34:07.899043 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.899015    2573 scope.go:117] "RemoveContainer" containerID="837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97"
Jul 29 04:34:07.899575 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:34:07.899539    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97\": container with ID starting with 837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97 not found: ID does not exist" containerID="837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97"
Jul 29 04:34:07.899758 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.899585    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97"} err="failed to get container status \"837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97\": rpc error: code = NotFound desc = could not find container \"837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97\": container with ID starting with 837e64760fea62038bfccc90f3767d03b58909858df139546772c6dd5ed92e97 not found: ID does not exist"
Jul 29 04:34:07.899758 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.899609    2573 scope.go:117] "RemoveContainer" containerID="4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f"
Jul 29 04:34:07.899876 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:34:07.899857    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f\": container with ID starting with 4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f not found: ID does not exist" containerID="4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f"
Jul 29 04:34:07.899913 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.899879    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f"} err="failed to get container status \"4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f\": rpc error: code = NotFound desc = could not find container \"4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f\": container with ID starting with 4942154f72e131ad7b4cd17205cba8be6765fedf3bea5054411fb0022f31b48f not found: ID does not exist"
Jul 29 04:34:07.900807 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.900790    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"]
Jul 29 04:34:07.904970 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:07.904946    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bd62a50a-openshift-default-56f58c9d56-zvwxz"]
Jul 29 04:34:09.866813 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:09.866782    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" path="/var/lib/kubelet/pods/4fca1bae-41b1-4c77-b3ea-d3cc35095519/volumes"
Jul 29 04:34:34.774233 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:34:34.774189    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:36:17.477963 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.477930    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"]
Jul 29 04:36:17.478558 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.478232    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy"
Jul 29 04:36:17.478558 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.478243    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy"
Jul 29 04:36:17.478558 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.478301    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy"
Jul 29 04:36:17.478558 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.478309    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy"
Jul 29 04:36:17.481282 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.481260    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.484024 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.484003    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-34b95582-openshift-default-dockercfg-zxvxc\""
Jul 29 04:36:17.493975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.493945    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"]
Jul 29 04:36:17.580958 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.580925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-certs\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.580958 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.580957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-podinfo\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.581165 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.580988    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12debd31-7fd5-4cc7-aade-4e638b12209a-istiod-ca-cert\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.581165 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.581022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-envoy\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.581165 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.581050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-socket\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.581165 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.581064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-token\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.581165 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.581085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-credential-socket\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.581165 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.581118    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jmn4\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-kube-api-access-9jmn4\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.581165 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.581138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-data\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.682433 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-certs\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.682433 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-podinfo\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.682727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12debd31-7fd5-4cc7-aade-4e638b12209a-istiod-ca-cert\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.682727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-envoy\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.682727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-socket\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.682727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-token\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.682727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682712    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-credential-socket\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.683001 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682766    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jmn4\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-kube-api-access-9jmn4\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.683001 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-data\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.683001 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.682917    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-certs\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.683157 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.683108    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-credential-socket\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.683157 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.683115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-data\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.683262 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.683150    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-socket\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.683319 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.683265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12debd31-7fd5-4cc7-aade-4e638b12209a-istiod-ca-cert\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.685396 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.685375    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-envoy\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.685570 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.685553    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-podinfo\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.690873 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.690853    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-token\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.691112 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.691096    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jmn4\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-kube-api-access-9jmn4\") pod \"e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") " pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.791092 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.791058    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:17.931722 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.931698    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"]
Jul 29 04:36:17.934225 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:36:17.934196    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12debd31_7fd5_4cc7_aade_4e638b12209a.slice/crio-f0fa53e5c21ff6d7f2516bf521c9c4ab85f740946788aa80830a8ef4c06c4a7e WatchSource:0}: Error finding container f0fa53e5c21ff6d7f2516bf521c9c4ab85f740946788aa80830a8ef4c06c4a7e: Status 404 returned error can't find the container with id f0fa53e5c21ff6d7f2516bf521c9c4ab85f740946788aa80830a8ef4c06c4a7e
Jul 29 04:36:17.936324 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.936290    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:36:17.936432 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.936370    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:36:17.936432 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:17.936417    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:36:18.449510 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:18.449456    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" event={"ID":"12debd31-7fd5-4cc7-aade-4e638b12209a","Type":"ContainerStarted","Data":"f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029"}
Jul 29 04:36:18.449691 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:18.449520    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" event={"ID":"12debd31-7fd5-4cc7-aade-4e638b12209a","Type":"ContainerStarted","Data":"f0fa53e5c21ff6d7f2516bf521c9c4ab85f740946788aa80830a8ef4c06c4a7e"}
Jul 29 04:36:18.488292 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:18.488240    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" podStartSLOduration=1.488223314 podStartE2EDuration="1.488223314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:36:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:36:18.487437957 +0000 UTC m=+2459.082538674" watchObservedRunningTime="2026-07-29 04:36:18.488223314 +0000 UTC m=+2459.083324030"
Jul 29 04:36:18.792269 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:18.792229    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:18.797164 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:18.797139    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:19.453400 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:19.453367    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:19.454471 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:19.454452    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:20.668187 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:20.668149    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:36:30.562356 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:30.562316    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:36:34.455329 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:34.455242    2573 patch_prober.go:28] interesting pod/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 29 04:36:34.455329 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:34.455307    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 29 04:36:34.526633 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:34.526600    2573 generic.go:356] "Generic (PLEG): container finished" podID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerID="f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029" exitCode=0
Jul 29 04:36:34.526809 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:34.526681    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" event={"ID":"12debd31-7fd5-4cc7-aade-4e638b12209a","Type":"ContainerDied","Data":"f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029"}
Jul 29 04:36:34.527115 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:34.527095    2573 scope.go:117] "RemoveContainer" containerID="f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029"
Jul 29 04:36:34.528173 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:34.528139    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:36:34.528247 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:34.528233    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:36:34.528301 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:34.528283    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:36:35.535865 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:35.535829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" event={"ID":"12debd31-7fd5-4cc7-aade-4e638b12209a","Type":"ContainerStarted","Data":"f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80"}
Jul 29 04:36:35.792294 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:35.791774    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:35.792294 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:35.791907    2573 patch_prober.go:28] interesting pod/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 29 04:36:35.792294 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:35.791961    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 29 04:36:36.791851 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:36.791810    2573 patch_prober.go:28] interesting pod/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 29 04:36:36.792458 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:36.792426    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 29 04:36:37.792174 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:37.792120    2573 patch_prober.go:28] interesting pod/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 29 04:36:37.792698 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:37.792192    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 29 04:36:38.791993 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:38.791954    2573 patch_prober.go:28] interesting pod/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 29 04:36:38.792576 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:38.792290    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 29 04:36:39.796206 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:39.796170    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:39.796621 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:39.796533    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:39.797219 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:39.797202    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:36:48.729405 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.729370    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"]
Jul 29 04:36:48.729923 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.729735    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy"
Jul 29 04:36:48.729923 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.729749    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fca1bae-41b1-4c77-b3ea-d3cc35095519" containerName="istio-proxy"
Jul 29 04:36:48.733062 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.733039    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.735872 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.735842    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-34b95582\"/\"kube-root-ca.crt\""
Jul 29 04:36:48.737295 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.737275    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-34b95582\"/\"openshift-service-ca.crt\""
Jul 29 04:36:48.737428 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.737323    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-34b95582\"/\"default-dockercfg-c8lf5\""
Jul 29 04:36:48.737428 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.737358    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-34b95582\"/\"e2e-lifecycle-model-34b95582-kserve-self-signed-certs\""
Jul 29 04:36:48.745159 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.745135    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"]
Jul 29 04:36:48.833413 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.833381    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tmp-dir\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.833622 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.833433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4thsp\" (UniqueName: \"kubernetes.io/projected/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-kube-api-access-4thsp\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.833622 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.833529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-home\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.833622 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.833566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-dshm\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.833622 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.833582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tls-certs\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.833772 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.833649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-model-cache\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.934846 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.934806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4thsp\" (UniqueName: \"kubernetes.io/projected/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-kube-api-access-4thsp\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.935036 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.934862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-home\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.935036 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.934889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-dshm\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.935036 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.934904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tls-certs\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.935036 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.934935    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-model-cache\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.935036 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.934976    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tmp-dir\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.935380 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.935354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-model-cache\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.935451 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.935415    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-home\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.935515 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.935477    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tmp-dir\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.937483 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.937463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-dshm\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.937686 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.937667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tls-certs\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:48.951045 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:48.951023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4thsp\" (UniqueName: \"kubernetes.io/projected/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-kube-api-access-4thsp\") pod \"e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") " pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:49.042273 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:49.042238    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:49.178338 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:49.178301    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"]
Jul 29 04:36:49.182529 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:36:49.182483    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8cbb768_7e5f_4481_9dcd_89bcb212f5a2.slice/crio-bd0c8494acddf164ef0f1632489e6e8e94d9b762174ea2dedff2ad99589f98cb WatchSource:0}: Error finding container bd0c8494acddf164ef0f1632489e6e8e94d9b762174ea2dedff2ad99589f98cb: Status 404 returned error can't find the container with id bd0c8494acddf164ef0f1632489e6e8e94d9b762174ea2dedff2ad99589f98cb
Jul 29 04:36:49.594985 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:49.594950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r" event={"ID":"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2","Type":"ContainerStarted","Data":"3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35"}
Jul 29 04:36:49.595189 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:49.594993    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r" event={"ID":"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2","Type":"ContainerStarted","Data":"bd0c8494acddf164ef0f1632489e6e8e94d9b762174ea2dedff2ad99589f98cb"}
Jul 29 04:36:49.613291 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:49.613239    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r" podStartSLOduration=1.61322521 podStartE2EDuration="1.61322521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:36:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:36:49.61244845 +0000 UTC m=+2490.207549169" watchObservedRunningTime="2026-07-29 04:36:49.61322521 +0000 UTC m=+2490.208325972"
Jul 29 04:36:52.061228 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:52.061192    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:36:59.042565 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:59.042525    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:59.042565 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:59.042574    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:59.055172 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:59.055150    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:36:59.649559 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:36:59.649530    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:37:06.768921 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:06.768880    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:37:33.466411 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:33.466371    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:37:43.167721 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:43.167684    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:37:43.455441 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:43.455347    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"]
Jul 29 04:37:58.474904 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.474840    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r" podUID="a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" containerName="main" containerID="cri-o://3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35" gracePeriod=45
Jul 29 04:37:58.718330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.718302    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:37:58.819842 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.819792    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-home\") pod \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") "
Jul 29 04:37:58.820046 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.819873    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-model-cache\") pod \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") "
Jul 29 04:37:58.820046 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.819906    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4thsp\" (UniqueName: \"kubernetes.io/projected/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-kube-api-access-4thsp\") pod \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") "
Jul 29 04:37:58.820046 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.819940    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-dshm\") pod \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") "
Jul 29 04:37:58.820046 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.819958    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tls-certs\") pod \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") "
Jul 29 04:37:58.820270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.820075    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tmp-dir\") pod \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\" (UID: \"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2\") "
Jul 29 04:37:58.820270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.820124    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-home" (OuterVolumeSpecName: "home") pod "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" (UID: "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:37:58.820270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.820172    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" (UID: "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:37:58.820399 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.820325    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" (UID: "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:37:58.820449 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.820400    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-model-cache\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:37:58.820449 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.820421    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tmp-dir\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:37:58.820449 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.820431    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-home\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:37:58.822277 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.822250    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-dshm" (OuterVolumeSpecName: "dshm") pod "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" (UID: "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:37:58.822640 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.822619    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" (UID: "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:37:58.822640 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.822624    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-kube-api-access-4thsp" (OuterVolumeSpecName: "kube-api-access-4thsp") pod "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" (UID: "a8cbb768-7e5f-4481-9dcd-89bcb212f5a2"). InnerVolumeSpecName "kube-api-access-4thsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:37:58.888196 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.888166    2573 generic.go:356] "Generic (PLEG): container finished" podID="a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" containerID="3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35" exitCode=0
Jul 29 04:37:58.888363 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.888218    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"
Jul 29 04:37:58.888363 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.888253    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r" event={"ID":"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2","Type":"ContainerDied","Data":"3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35"}
Jul 29 04:37:58.888363 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.888289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r" event={"ID":"a8cbb768-7e5f-4481-9dcd-89bcb212f5a2","Type":"ContainerDied","Data":"bd0c8494acddf164ef0f1632489e6e8e94d9b762174ea2dedff2ad99589f98cb"}
Jul 29 04:37:58.888363 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.888312    2573 scope.go:117] "RemoveContainer" containerID="3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35"
Jul 29 04:37:58.897018 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.896997    2573 scope.go:117] "RemoveContainer" containerID="3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35"
Jul 29 04:37:58.897294 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:37:58.897275    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35\": container with ID starting with 3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35 not found: ID does not exist" containerID="3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35"
Jul 29 04:37:58.897364 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.897300    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35"} err="failed to get container status \"3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35\": rpc error: code = NotFound desc = could not find container \"3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35\": container with ID starting with 3344b6ecdccde6c3f4c4afdb25931f3e76be66a5b82f052627d0af888f8d4f35 not found: ID does not exist"
Jul 29 04:37:58.909046 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.909024    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"]
Jul 29 04:37:58.913530 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.913509    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-34b95582/e2e-lifecycle-model-34b95582-kserve-5dc699d96c-ksp5r"]
Jul 29 04:37:58.920990 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.920975    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4thsp\" (UniqueName: \"kubernetes.io/projected/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-kube-api-access-4thsp\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:37:58.921053 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.920993    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-dshm\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:37:58.921053 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:58.921004    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2-tls-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:37:59.867668 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:37:59.867638    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" path="/var/lib/kubelet/pods/a8cbb768-7e5f-4481-9dcd-89bcb212f5a2/volumes"
Jul 29 04:38:49.793814 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:49.793730    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"]
Jul 29 04:38:49.794329 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:49.793954    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy" containerID="cri-o://f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80" gracePeriod=30
Jul 29 04:38:52.595443 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:52.595407    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:38:54.801199 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:54.801167    2573 patch_prober.go:28] interesting pod/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": EOF" start-of-body=
Jul 29 04:38:54.801996 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:54.801245    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": EOF"
Jul 29 04:38:55.037438 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.037412    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:38:55.077961 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.077876    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-certs\") pod \"12debd31-7fd5-4cc7-aade-4e638b12209a\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") "
Jul 29 04:38:55.077961 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.077906    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-data\") pod \"12debd31-7fd5-4cc7-aade-4e638b12209a\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") "
Jul 29 04:38:55.077961 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.077927    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-credential-socket\") pod \"12debd31-7fd5-4cc7-aade-4e638b12209a\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") "
Jul 29 04:38:55.078234 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.077974    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-socket\") pod \"12debd31-7fd5-4cc7-aade-4e638b12209a\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") "
Jul 29 04:38:55.078234 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.077995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jmn4\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-kube-api-access-9jmn4\") pod \"12debd31-7fd5-4cc7-aade-4e638b12209a\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") "
Jul 29 04:38:55.078234 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078041    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-podinfo\") pod \"12debd31-7fd5-4cc7-aade-4e638b12209a\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") "
Jul 29 04:38:55.078234 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078086    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12debd31-7fd5-4cc7-aade-4e638b12209a-istiod-ca-cert\") pod \"12debd31-7fd5-4cc7-aade-4e638b12209a\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") "
Jul 29 04:38:55.078234 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078170    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12debd31-7fd5-4cc7-aade-4e638b12209a" (UID: "12debd31-7fd5-4cc7-aade-4e638b12209a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:38:55.078234 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078228    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-envoy\") pod \"12debd31-7fd5-4cc7-aade-4e638b12209a\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") "
Jul 29 04:38:55.078545 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078289    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-token\") pod \"12debd31-7fd5-4cc7-aade-4e638b12209a\" (UID: \"12debd31-7fd5-4cc7-aade-4e638b12209a\") "
Jul 29 04:38:55.078545 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078312    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12debd31-7fd5-4cc7-aade-4e638b12209a" (UID: "12debd31-7fd5-4cc7-aade-4e638b12209a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:38:55.078545 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078343    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12debd31-7fd5-4cc7-aade-4e638b12209a" (UID: "12debd31-7fd5-4cc7-aade-4e638b12209a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:38:55.078545 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078453    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12debd31-7fd5-4cc7-aade-4e638b12209a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12debd31-7fd5-4cc7-aade-4e638b12209a" (UID: "12debd31-7fd5-4cc7-aade-4e638b12209a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:38:55.078735 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078607    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:38:55.078735 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078625    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:38:55.078735 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078635    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:38:55.078735 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.078643    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12debd31-7fd5-4cc7-aade-4e638b12209a-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:38:55.079228 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.079199    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-data" (OuterVolumeSpecName: "istio-data") pod "12debd31-7fd5-4cc7-aade-4e638b12209a" (UID: "12debd31-7fd5-4cc7-aade-4e638b12209a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:38:55.080601 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.080567    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12debd31-7fd5-4cc7-aade-4e638b12209a" (UID: "12debd31-7fd5-4cc7-aade-4e638b12209a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:38:55.080698 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.080617    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12debd31-7fd5-4cc7-aade-4e638b12209a" (UID: "12debd31-7fd5-4cc7-aade-4e638b12209a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:38:55.080941 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.080922    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-kube-api-access-9jmn4" (OuterVolumeSpecName: "kube-api-access-9jmn4") pod "12debd31-7fd5-4cc7-aade-4e638b12209a" (UID: "12debd31-7fd5-4cc7-aade-4e638b12209a"). InnerVolumeSpecName "kube-api-access-9jmn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:38:55.081072 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.081052    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-token" (OuterVolumeSpecName: "istio-token") pod "12debd31-7fd5-4cc7-aade-4e638b12209a" (UID: "12debd31-7fd5-4cc7-aade-4e638b12209a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:38:55.130747 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.130710    2573 generic.go:356] "Generic (PLEG): container finished" podID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerID="f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80" exitCode=0
Jul 29 04:38:55.130901 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.130767    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"
Jul 29 04:38:55.130901 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.130800    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" event={"ID":"12debd31-7fd5-4cc7-aade-4e638b12209a","Type":"ContainerDied","Data":"f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80"}
Jul 29 04:38:55.130901 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.130869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24" event={"ID":"12debd31-7fd5-4cc7-aade-4e638b12209a","Type":"ContainerDied","Data":"f0fa53e5c21ff6d7f2516bf521c9c4ab85f740946788aa80830a8ef4c06c4a7e"}
Jul 29 04:38:55.131062 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.130901    2573 scope.go:117] "RemoveContainer" containerID="f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80"
Jul 29 04:38:55.140064 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.140045    2573 scope.go:117] "RemoveContainer" containerID="f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029"
Jul 29 04:38:55.147889 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.147875    2573 scope.go:117] "RemoveContainer" containerID="f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80"
Jul 29 04:38:55.148138 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:38:55.148114    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80\": container with ID starting with f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80 not found: ID does not exist" containerID="f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80"
Jul 29 04:38:55.148190 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.148149    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80"} err="failed to get container status \"f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80\": rpc error: code = NotFound desc = could not find container \"f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80\": container with ID starting with f4e55bed2e383bd7874983cb531de00b77cc2844c7c13eb9c05d4a8480120f80 not found: ID does not exist"
Jul 29 04:38:55.148190 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.148168    2573 scope.go:117] "RemoveContainer" containerID="f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029"
Jul 29 04:38:55.148447 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:38:55.148429    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029\": container with ID starting with f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029 not found: ID does not exist" containerID="f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029"
Jul 29 04:38:55.148553 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.148453    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029"} err="failed to get container status \"f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029\": rpc error: code = NotFound desc = could not find container \"f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029\": container with ID starting with f9f1da67ff7d91148d2d9dcb52e2239262e1c68ad228098489b81eebddf2d029 not found: ID does not exist"
Jul 29 04:38:55.152443 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.152419    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"]
Jul 29 04:38:55.155936 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.155910    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-34b95582-openshift-default-6cbf4b77c6-c6l24"]
Jul 29 04:38:55.179618 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.179594    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:38:55.179618 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.179615    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:38:55.179618 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.179623    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:38:55.179798 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.179632    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jmn4\" (UniqueName: \"kubernetes.io/projected/12debd31-7fd5-4cc7-aade-4e638b12209a-kube-api-access-9jmn4\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:38:55.179798 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.179641    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12debd31-7fd5-4cc7-aade-4e638b12209a-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:38:55.867108 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:38:55.867073    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" path="/var/lib/kubelet/pods/12debd31-7fd5-4cc7-aade-4e638b12209a/volumes"
Jul 29 04:39:15.365696 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:39:15.365658    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:39:25.659487 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:39:25.659452    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:39:33.766436 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:39:33.766389    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:40:26.928773 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.928733    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"]
Jul 29 04:40:26.929285 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.929056    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy"
Jul 29 04:40:26.929285 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.929067    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy"
Jul 29 04:40:26.929285 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.929077    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" containerName="main"
Jul 29 04:40:26.929285 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.929082    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" containerName="main"
Jul 29 04:40:26.929285 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.929141    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy"
Jul 29 04:40:26.929285 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.929149    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cbb768-7e5f-4481-9dcd-89bcb212f5a2" containerName="main"
Jul 29 04:40:26.931969 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.931953    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:26.934684 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.934661    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1fcfbd-openshift-default-dockercfg-xhvtg\""
Jul 29 04:40:26.952095 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:26.952073    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"]
Jul 29 04:40:27.051330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.051291    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-credential-socket\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.051483 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.051346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9wkn\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-kube-api-access-s9wkn\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.051483 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.051373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-podinfo\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.051661 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.051479    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-certs\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.051661 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.051532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istiod-ca-cert\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.051661 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.051616    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-socket\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.051771 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.051665    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-token\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.051771 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.051708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-envoy\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.051771 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.051753    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-data\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153069 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-token\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153069 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-envoy\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-data\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-credential-socket\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9wkn\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-kube-api-access-s9wkn\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-podinfo\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153598 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153347    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-certs\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153598 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istiod-ca-cert\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153598 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-socket\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153769 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153705    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-credential-socket\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.153982 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.153960    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-data\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.154091 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.154068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-certs\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.154199 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.154182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istiod-ca-cert\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.154241 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.154217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-socket\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.155724 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.155695    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-envoy\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.156043 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.156014    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-podinfo\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.163519 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.163479    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-token\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.163642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.163620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9wkn\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-kube-api-access-s9wkn\") pod \"e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") " pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.245145 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.245057    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:27.380767 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.380742    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"]
Jul 29 04:40:27.383165 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:40:27.383135    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2e1628_fd55_4201_92a5_ed0f085f79f7.slice/crio-d45cb774973db5d16ce0a3aac468091761dee8cb3536c74f0b880fc1288a8eea WatchSource:0}: Error finding container d45cb774973db5d16ce0a3aac468091761dee8cb3536c74f0b880fc1288a8eea: Status 404 returned error can't find the container with id d45cb774973db5d16ce0a3aac468091761dee8cb3536c74f0b880fc1288a8eea
Jul 29 04:40:27.385656 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.385623    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:40:27.385747 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.385686    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:40:27.385747 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.385717    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:40:27.529284 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.529246    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" event={"ID":"cd2e1628-fd55-4201-92a5-ed0f085f79f7","Type":"ContainerStarted","Data":"7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83"}
Jul 29 04:40:27.529522 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.529345    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" event={"ID":"cd2e1628-fd55-4201-92a5-ed0f085f79f7","Type":"ContainerStarted","Data":"d45cb774973db5d16ce0a3aac468091761dee8cb3536c74f0b880fc1288a8eea"}
Jul 29 04:40:27.552794 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:27.552736    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" podStartSLOduration=1.552718807 podStartE2EDuration="1.552718807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:40:27.551122853 +0000 UTC m=+2708.146223757" watchObservedRunningTime="2026-07-29 04:40:27.552718807 +0000 UTC m=+2708.147819521"
Jul 29 04:40:28.245553 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:28.245512    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:28.250418 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:28.250391    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:28.534003 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:28.533970    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:28.534931 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:28.534913    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:35.366553 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:35.366510    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:40:43.536047 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:43.536008    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 04:40:43.536479 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:43.536068    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 04:40:43.607371 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:43.607338    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerID="7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83" exitCode=0
Jul 29 04:40:43.607557 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:43.607400    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" event={"ID":"cd2e1628-fd55-4201-92a5-ed0f085f79f7","Type":"ContainerDied","Data":"7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83"}
Jul 29 04:40:43.607800 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:43.607786    2573 scope.go:117] "RemoveContainer" containerID="7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83"
Jul 29 04:40:43.608748 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:43.608717    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:40:43.608866 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:43.608789    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:40:43.608866 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:43.608827    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:40:44.612969 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:44.612931    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" event={"ID":"cd2e1628-fd55-4201-92a5-ed0f085f79f7","Type":"ContainerStarted","Data":"31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f"}
Jul 29 04:40:45.245251 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:45.245217    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:45.245580 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:45.245555    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 04:40:45.245639 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:45.245608    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 04:40:46.245994 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:46.245957    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 04:40:46.246392 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:46.246024    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 04:40:47.245577 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:47.245534    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 04:40:47.245771 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:47.245605    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 04:40:48.246355 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:48.246313    2573 patch_prober.go:28] interesting pod/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 04:40:48.246845 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:48.246375    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 04:40:49.249989 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:49.249959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:49.250351 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:49.250289    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:49.250919 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:49.250902    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:40:55.074411 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.074377    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"]
Jul 29 04:40:55.074885 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.074869    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy"
Jul 29 04:40:55.074930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.074889    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy"
Jul 29 04:40:55.075003 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.074991    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="12debd31-7fd5-4cc7-aade-4e638b12209a" containerName="istio-proxy"
Jul 29 04:40:55.079008 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.078986    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.081974 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.081955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a32259-openshift-default-dockercfg-ch5fb\""
Jul 29 04:40:55.090835 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.090816    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"]
Jul 29 04:40:55.217218 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.217186    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-certs\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.217397 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.217223    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-socket\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.217397 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.217248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d980474-b147-4308-81db-86317c089d34-istiod-ca-cert\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.217397 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.217299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d980474-b147-4308-81db-86317c089d34-istio-podinfo\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.217397 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.217353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzx66\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-kube-api-access-nzx66\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.217397 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.217389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-credential-socket\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.217586 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.217414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-data\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.217586 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.217445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-envoy\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.217586 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.217478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-istio-token\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318095 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-certs\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318095 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-socket\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318337 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d980474-b147-4308-81db-86317c089d34-istiod-ca-cert\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318337 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d980474-b147-4308-81db-86317c089d34-istio-podinfo\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318337 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318186    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzx66\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-kube-api-access-nzx66\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318337 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-credential-socket\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318337 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-data\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318337 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318275    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-envoy\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318337 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-istio-token\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318729 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-certs\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318729 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318576    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-socket\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318729 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318653    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-data\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.318886 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.318836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-credential-socket\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.319245 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.319221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d980474-b147-4308-81db-86317c089d34-istiod-ca-cert\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.320819 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.320787    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-envoy\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.321238 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.321221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d980474-b147-4308-81db-86317c089d34-istio-podinfo\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.327554 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.327463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-istio-token\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.327787 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.327765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzx66\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-kube-api-access-nzx66\") pod \"e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") " pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.392002 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.391958    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:55.533967 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.533940    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"]
Jul 29 04:40:55.536345 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:40:55.536316    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d980474_b147_4308_81db_86317c089d34.slice/crio-ba1d8487a7f5eb1ad4db72cd6128a595a099fc4eea2164557dce52bcfaea8934 WatchSource:0}: Error finding container ba1d8487a7f5eb1ad4db72cd6128a595a099fc4eea2164557dce52bcfaea8934: Status 404 returned error can't find the container with id ba1d8487a7f5eb1ad4db72cd6128a595a099fc4eea2164557dce52bcfaea8934
Jul 29 04:40:55.538887 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.538856    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:40:55.538971 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.538925    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:40:55.539018 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.538990    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:40:55.661760 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.661722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" event={"ID":"0d980474-b147-4308-81db-86317c089d34","Type":"ContainerStarted","Data":"9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799"}
Jul 29 04:40:55.661947 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.661787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" event={"ID":"0d980474-b147-4308-81db-86317c089d34","Type":"ContainerStarted","Data":"ba1d8487a7f5eb1ad4db72cd6128a595a099fc4eea2164557dce52bcfaea8934"}
Jul 29 04:40:55.684282 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:55.684224    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" podStartSLOduration=0.684208892 podStartE2EDuration="684.208892ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:40:55.682671848 +0000 UTC m=+2736.277772565" watchObservedRunningTime="2026-07-29 04:40:55.684208892 +0000 UTC m=+2736.279309609"
Jul 29 04:40:56.392374 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:56.392339    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:56.397075 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:56.397054    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:56.666717 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:56.666635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:40:56.667523 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:40:56.667482    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:41:02.567672 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:02.567632    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:41:10.733477 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:10.733355    2573 generic.go:356] "Generic (PLEG): container finished" podID="0d980474-b147-4308-81db-86317c089d34" containerID="9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799" exitCode=0
Jul 29 04:41:10.733477 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:10.733411    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" event={"ID":"0d980474-b147-4308-81db-86317c089d34","Type":"ContainerDied","Data":"9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799"}
Jul 29 04:41:10.734076 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:10.733907    2573 scope.go:117] "RemoveContainer" containerID="9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799"
Jul 29 04:41:10.735015 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:10.734984    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:41:10.735128 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:10.735075    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:41:10.735191 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:10.735124    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:41:11.667352 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:11.667313    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:41:11.739254 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:11.739220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" event={"ID":"0d980474-b147-4308-81db-86317c089d34","Type":"ContainerStarted","Data":"c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa"}
Jul 29 04:41:12.392621 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:12.392582    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:41:12.393212 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:12.393191    2573 patch_prober.go:28] interesting pod/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 29 04:41:12.393272 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:12.393236    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 29 04:41:13.395643 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:13.395601    2573 patch_prober.go:28] interesting pod/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 29 04:41:13.396125 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:13.395671    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 29 04:41:14.392670 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:14.392628    2573 patch_prober.go:28] interesting pod/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 29 04:41:14.392859 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:14.392711    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 29 04:41:15.392772 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:15.392730    2573 patch_prober.go:28] interesting pod/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 29 04:41:15.393174 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:15.392805    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 29 04:41:16.396756 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:16.396726    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:41:16.397169 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:16.397147    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:41:16.397863 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:16.397844    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:41:26.333933 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.333895    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"]
Jul 29 04:41:26.337327 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.337311    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.341405 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.341382    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1fcfbd\"/\"kube-root-ca.crt\""
Jul 29 04:41:26.341561 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.341385    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1fcfbd\"/\"openshift-service-ca.crt\""
Jul 29 04:41:26.341561 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.341429    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1fcfbd\"/\"test-model-1fcfbd-kserve-self-signed-certs\""
Jul 29 04:41:26.341561 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.341469    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1fcfbd\"/\"default-dockercfg-8f6x8\""
Jul 29 04:41:26.345460 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.345439    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"]
Jul 29 04:41:26.388337 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.388304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99fhh\" (UniqueName: \"kubernetes.io/projected/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-kube-api-access-99fhh\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.388479 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.388361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tls-certs\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.388479 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.388394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-dshm\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.388479 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.388427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-model-cache\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.388618 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.388531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-home\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.388618 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.388570    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tmp-dir\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.489558 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.489519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-home\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.489558 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.489561    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tmp-dir\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.489815 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.489613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99fhh\" (UniqueName: \"kubernetes.io/projected/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-kube-api-access-99fhh\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.489815 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.489667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tls-certs\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.489815 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.489698    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-dshm\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.489815 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.489750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-model-cache\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.490018 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.489913    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-home\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.490077 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.490021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tmp-dir\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.490159 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.490139    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-model-cache\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.492165 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.492137    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-dshm\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.492287 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.492265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tls-certs\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.497833 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.497810    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99fhh\" (UniqueName: \"kubernetes.io/projected/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-kube-api-access-99fhh\") pod \"test-model-1fcfbd-kserve-7699cdb45-cbk5n\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") " pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.648024 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.647942    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:26.781024 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.780983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"]
Jul 29 04:41:26.784616 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:41:26.784586    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5ac7c04_8ce8_43ad_82f7_b2e6ecae668e.slice/crio-91d564d0c1e63e071aded7a2239bccf687f7f0b13bce7a410187ded73f23ff42 WatchSource:0}: Error finding container 91d564d0c1e63e071aded7a2239bccf687f7f0b13bce7a410187ded73f23ff42: Status 404 returned error can't find the container with id 91d564d0c1e63e071aded7a2239bccf687f7f0b13bce7a410187ded73f23ff42
Jul 29 04:41:26.814108 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:26.814081    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n" event={"ID":"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e","Type":"ContainerStarted","Data":"91d564d0c1e63e071aded7a2239bccf687f7f0b13bce7a410187ded73f23ff42"}
Jul 29 04:41:27.820431 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:27.820395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n" event={"ID":"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e","Type":"ContainerStarted","Data":"b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9"}
Jul 29 04:41:27.838685 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:27.838621    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n" podStartSLOduration=1.8386027 podStartE2EDuration="1.8386027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:41:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:41:27.837341168 +0000 UTC m=+2768.432441887" watchObservedRunningTime="2026-07-29 04:41:27.8386027 +0000 UTC m=+2768.433703416"
Jul 29 04:41:29.967006 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:29.966967    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:41:36.649100 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:36.649059    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:36.649527 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:36.649119    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:36.661485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:36.661463    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:36.873484 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:36.873451    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:41:40.958411 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:40.958332    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:41:58.761025 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:41:58.760983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:42:32.140590 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:32.140556    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"]
Jul 29 04:42:33.192087 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.192047    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"]
Jul 29 04:42:33.195271 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.195248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"
Jul 29 04:42:33.198041 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.198010    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:42:33.198172 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.198081    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n8frm\""
Jul 29 04:42:33.202225 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.202194    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"]
Jul 29 04:42:33.272953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.272923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c396fc10-3412-4ba5-b96a-eadbe685d3d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74\" (UID: \"c396fc10-3412-4ba5-b96a-eadbe685d3d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"
Jul 29 04:42:33.374309 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.374275    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c396fc10-3412-4ba5-b96a-eadbe685d3d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74\" (UID: \"c396fc10-3412-4ba5-b96a-eadbe685d3d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"
Jul 29 04:42:33.374915 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.374894    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c396fc10-3412-4ba5-b96a-eadbe685d3d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74\" (UID: \"c396fc10-3412-4ba5-b96a-eadbe685d3d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"
Jul 29 04:42:33.507550 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.507469    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"
Jul 29 04:42:33.641819 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:33.641791    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"]
Jul 29 04:42:33.644767 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:42:33.644733    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc396fc10_3412_4ba5_b96a_eadbe685d3d4.slice/crio-c283ae7b29045464483d72756a86310d98fa7ae609807e1a279e2d655e050f54 WatchSource:0}: Error finding container c283ae7b29045464483d72756a86310d98fa7ae609807e1a279e2d655e050f54: Status 404 returned error can't find the container with id c283ae7b29045464483d72756a86310d98fa7ae609807e1a279e2d655e050f54
Jul 29 04:42:34.123423 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:34.123370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74" event={"ID":"c396fc10-3412-4ba5-b96a-eadbe685d3d4","Type":"ContainerStarted","Data":"7580269aafce798e12b3b9cbf8a3128cfb7cf3e247950608a65ab76bb344c49b"}
Jul 29 04:42:34.123649 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:34.123441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74" event={"ID":"c396fc10-3412-4ba5-b96a-eadbe685d3d4","Type":"ContainerStarted","Data":"c283ae7b29045464483d72756a86310d98fa7ae609807e1a279e2d655e050f54"}
Jul 29 04:42:34.138636 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:34.138585    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74" podStartSLOduration=1.138569637 podStartE2EDuration="1.138569637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:42:34.136861522 +0000 UTC m=+2834.731962241" watchObservedRunningTime="2026-07-29 04:42:34.138569637 +0000 UTC m=+2834.733670354"
Jul 29 04:42:35.130185 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:35.130154    2573 generic.go:356] "Generic (PLEG): container finished" podID="c396fc10-3412-4ba5-b96a-eadbe685d3d4" containerID="7580269aafce798e12b3b9cbf8a3128cfb7cf3e247950608a65ab76bb344c49b" exitCode=0
Jul 29 04:42:35.130609 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:35.130218    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74" event={"ID":"c396fc10-3412-4ba5-b96a-eadbe685d3d4","Type":"ContainerDied","Data":"7580269aafce798e12b3b9cbf8a3128cfb7cf3e247950608a65ab76bb344c49b"}
Jul 29 04:42:36.263330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:36.263307    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"
Jul 29 04:42:36.403780 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:36.403696    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c396fc10-3412-4ba5-b96a-eadbe685d3d4-maas-api-service-ca\") pod \"c396fc10-3412-4ba5-b96a-eadbe685d3d4\" (UID: \"c396fc10-3412-4ba5-b96a-eadbe685d3d4\") "
Jul 29 04:42:36.404061 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:36.404036    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c396fc10-3412-4ba5-b96a-eadbe685d3d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c396fc10-3412-4ba5-b96a-eadbe685d3d4" (UID: "c396fc10-3412-4ba5-b96a-eadbe685d3d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:42:36.505219 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:36.505180    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c396fc10-3412-4ba5-b96a-eadbe685d3d4-maas-api-service-ca\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:36.854812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:36.854769    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:42:37.141047 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:37.140971    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"
Jul 29 04:42:37.141047 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:37.140997    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74" event={"ID":"c396fc10-3412-4ba5-b96a-eadbe685d3d4","Type":"ContainerDied","Data":"c283ae7b29045464483d72756a86310d98fa7ae609807e1a279e2d655e050f54"}
Jul 29 04:42:37.141227 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:37.141062    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c283ae7b29045464483d72756a86310d98fa7ae609807e1a279e2d655e050f54"
Jul 29 04:42:43.931818 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:43.931771    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"]
Jul 29 04:42:43.933016 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:43.932992    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fcfbd-8sw74"]
Jul 29 04:42:45.867177 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:45.867142    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c396fc10-3412-4ba5-b96a-eadbe685d3d4" path="/var/lib/kubelet/pods/c396fc10-3412-4ba5-b96a-eadbe685d3d4/volumes"
Jul 29 04:42:47.161766 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.161718    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n" podUID="a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" containerName="main" containerID="cri-o://b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9" gracePeriod=45
Jul 29 04:42:47.421664 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.421601    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:42:47.499242 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499213    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-home\") pod \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") "
Jul 29 04:42:47.499404 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499249    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-model-cache\") pod \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") "
Jul 29 04:42:47.499404 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499292    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tmp-dir\") pod \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") "
Jul 29 04:42:47.499404 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499309    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tls-certs\") pod \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") "
Jul 29 04:42:47.499404 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499328    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99fhh\" (UniqueName: \"kubernetes.io/projected/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-kube-api-access-99fhh\") pod \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") "
Jul 29 04:42:47.499404 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499345    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-dshm\") pod \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\" (UID: \"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e\") "
Jul 29 04:42:47.499812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499551    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" (UID: "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:42:47.499812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499558    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-home" (OuterVolumeSpecName: "home") pod "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" (UID: "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:42:47.499812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499574    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" (UID: "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:42:47.499812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499702    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-home\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:47.499812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499720    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-model-cache\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:47.499812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.499736    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tmp-dir\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:47.501823 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.501797    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-kube-api-access-99fhh" (OuterVolumeSpecName: "kube-api-access-99fhh") pod "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" (UID: "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e"). InnerVolumeSpecName "kube-api-access-99fhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:42:47.501951 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.501887    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" (UID: "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:42:47.501951 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.501905    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-dshm" (OuterVolumeSpecName: "dshm") pod "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" (UID: "a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:42:47.600663 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.600626    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-tls-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:47.600663 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.600660    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99fhh\" (UniqueName: \"kubernetes.io/projected/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-kube-api-access-99fhh\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:47.600849 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:47.600674    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e-dshm\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:48.191794 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:48.191700    2573 generic.go:356] "Generic (PLEG): container finished" podID="a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" containerID="b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9" exitCode=0
Jul 29 04:42:48.191794 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:48.191753    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"
Jul 29 04:42:48.191794 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:48.191777    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n" event={"ID":"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e","Type":"ContainerDied","Data":"b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9"}
Jul 29 04:42:48.192326 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:48.191831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n" event={"ID":"a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e","Type":"ContainerDied","Data":"91d564d0c1e63e071aded7a2239bccf687f7f0b13bce7a410187ded73f23ff42"}
Jul 29 04:42:48.192326 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:48.191853    2573 scope.go:117] "RemoveContainer" containerID="b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9"
Jul 29 04:42:48.200707 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:48.200690    2573 scope.go:117] "RemoveContainer" containerID="b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9"
Jul 29 04:42:48.200954 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:42:48.200936    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9\": container with ID starting with b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9 not found: ID does not exist" containerID="b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9"
Jul 29 04:42:48.201003 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:48.200966    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9"} err="failed to get container status \"b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9\": rpc error: code = NotFound desc = could not find container \"b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9\": container with ID starting with b126f0bcdef070949a483174d7853a12e66e15384860e1557e46a289252ff5e9 not found: ID does not exist"
Jul 29 04:42:48.208119 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:48.208098    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"]
Jul 29 04:42:48.212173 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:48.212154    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1fcfbd/test-model-1fcfbd-kserve-7699cdb45-cbk5n"]
Jul 29 04:42:49.867767 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:49.867731    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" path="/var/lib/kubelet/pods/a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e/volumes"
Jul 29 04:42:50.318684 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:50.318653    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"]
Jul 29 04:42:50.318901 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:50.318874    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy" containerID="cri-o://31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f" gracePeriod=30
Jul 29 04:42:52.261826 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:52.261793    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:42:55.577826 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.577801    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:42:55.665371 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665286    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-envoy\") pod \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") "
Jul 29 04:42:55.665371 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istiod-ca-cert\") pod \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") "
Jul 29 04:42:55.665371 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665366    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9wkn\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-kube-api-access-s9wkn\") pod \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") "
Jul 29 04:42:55.665669 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665382    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-token\") pod \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") "
Jul 29 04:42:55.665669 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665412    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-credential-socket\") pod \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") "
Jul 29 04:42:55.665669 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665428    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-data\") pod \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") "
Jul 29 04:42:55.665669 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665450    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-certs\") pod \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") "
Jul 29 04:42:55.665669 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665512    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-podinfo\") pod \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") "
Jul 29 04:42:55.665919 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665868    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd2e1628-fd55-4201-92a5-ed0f085f79f7" (UID: "cd2e1628-fd55-4201-92a5-ed0f085f79f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:42:55.665919 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665894    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd2e1628-fd55-4201-92a5-ed0f085f79f7" (UID: "cd2e1628-fd55-4201-92a5-ed0f085f79f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:42:55.666042 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.665973    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd2e1628-fd55-4201-92a5-ed0f085f79f7" (UID: "cd2e1628-fd55-4201-92a5-ed0f085f79f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:42:55.666099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.666038    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-socket\") pod \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\" (UID: \"cd2e1628-fd55-4201-92a5-ed0f085f79f7\") "
Jul 29 04:42:55.666639 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.666581    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd2e1628-fd55-4201-92a5-ed0f085f79f7" (UID: "cd2e1628-fd55-4201-92a5-ed0f085f79f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:42:55.666639 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.666604    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:55.666639 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.666627    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:55.666639 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.666642    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:55.666945 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.666867    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd2e1628-fd55-4201-92a5-ed0f085f79f7" (UID: "cd2e1628-fd55-4201-92a5-ed0f085f79f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:42:55.667892 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.667852    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd2e1628-fd55-4201-92a5-ed0f085f79f7" (UID: "cd2e1628-fd55-4201-92a5-ed0f085f79f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:42:55.668012 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.667940    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-kube-api-access-s9wkn" (OuterVolumeSpecName: "kube-api-access-s9wkn") pod "cd2e1628-fd55-4201-92a5-ed0f085f79f7" (UID: "cd2e1628-fd55-4201-92a5-ed0f085f79f7"). InnerVolumeSpecName "kube-api-access-s9wkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:42:55.668012 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.667941    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd2e1628-fd55-4201-92a5-ed0f085f79f7" (UID: "cd2e1628-fd55-4201-92a5-ed0f085f79f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:42:55.668012 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.667978    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd2e1628-fd55-4201-92a5-ed0f085f79f7" (UID: "cd2e1628-fd55-4201-92a5-ed0f085f79f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:42:55.767689 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.767655    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:55.767689 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.767686    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9wkn\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-kube-api-access-s9wkn\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:55.767870 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.767699    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:55.767870 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.767710    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:55.767870 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.767722    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2e1628-fd55-4201-92a5-ed0f085f79f7-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:55.767870 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:55.767733    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2e1628-fd55-4201-92a5-ed0f085f79f7-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:42:56.230141 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.230104    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerID="31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f" exitCode=0
Jul 29 04:42:56.230339 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.230149    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"
Jul 29 04:42:56.230339 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.230182    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" event={"ID":"cd2e1628-fd55-4201-92a5-ed0f085f79f7","Type":"ContainerDied","Data":"31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f"}
Jul 29 04:42:56.230339 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.230236    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r" event={"ID":"cd2e1628-fd55-4201-92a5-ed0f085f79f7","Type":"ContainerDied","Data":"d45cb774973db5d16ce0a3aac468091761dee8cb3536c74f0b880fc1288a8eea"}
Jul 29 04:42:56.230339 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.230260    2573 scope.go:117] "RemoveContainer" containerID="31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f"
Jul 29 04:42:56.241410 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.241392    2573 scope.go:117] "RemoveContainer" containerID="7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83"
Jul 29 04:42:56.249586 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.249558    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"]
Jul 29 04:42:56.250193 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.250175    2573 scope.go:117] "RemoveContainer" containerID="31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f"
Jul 29 04:42:56.250440 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:42:56.250421    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f\": container with ID starting with 31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f not found: ID does not exist" containerID="31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f"
Jul 29 04:42:56.250518 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.250448    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f"} err="failed to get container status \"31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f\": rpc error: code = NotFound desc = could not find container \"31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f\": container with ID starting with 31dfc721c016a97880087e70ebddbb154174db86075a3021c3c057482c99206f not found: ID does not exist"
Jul 29 04:42:56.250518 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.250468    2573 scope.go:117] "RemoveContainer" containerID="7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83"
Jul 29 04:42:56.250755 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:42:56.250736    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83\": container with ID starting with 7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83 not found: ID does not exist" containerID="7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83"
Jul 29 04:42:56.250796 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.250762    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83"} err="failed to get container status \"7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83\": rpc error: code = NotFound desc = could not find container \"7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83\": container with ID starting with 7f59c272768bf933179f282564c99ec81c87f1cfbaeef808fc1b3c84f0bb7a83 not found: ID does not exist"
Jul 29 04:42:56.253090 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:56.253070    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1fcfbd-openshift-default-5894c6d76b-8tc7r"]
Jul 29 04:42:57.866506 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:42:57.866463    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" path="/var/lib/kubelet/pods/cd2e1628-fd55-4201-92a5-ed0f085f79f7/volumes"
Jul 29 04:43:04.161922 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:04.161887    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:43:07.763676 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:07.763640    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"]
Jul 29 04:43:07.764071 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:07.763937    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy" containerID="cri-o://c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa" gracePeriod=30
Jul 29 04:43:08.605509 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.605458    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"]
Jul 29 04:43:08.605946 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.605927    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" containerName="main"
Jul 29 04:43:08.605989 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.605952    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" containerName="main"
Jul 29 04:43:08.605989 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.605984    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy"
Jul 29 04:43:08.606075 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.605992    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy"
Jul 29 04:43:08.606075 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.606002    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c396fc10-3412-4ba5-b96a-eadbe685d3d4" containerName="revoke-keys"
Jul 29 04:43:08.606075 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.606010    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c396fc10-3412-4ba5-b96a-eadbe685d3d4" containerName="revoke-keys"
Jul 29 04:43:08.606189 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.606087    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy"
Jul 29 04:43:08.606189 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.606096    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5ac7c04-8ce8-43ad-82f7-b2e6ecae668e" containerName="main"
Jul 29 04:43:08.606189 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.606102    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c396fc10-3412-4ba5-b96a-eadbe685d3d4" containerName="revoke-keys"
Jul 29 04:43:08.606189 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.606109    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy"
Jul 29 04:43:08.609274 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.609257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.612032 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.612008    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-fec70b-openshift-default-dockercfg-b69jp\""
Jul 29 04:43:08.620746 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.620722    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"]
Jul 29 04:43:08.673453 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.673423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-certs\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.673453 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.673454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-credential-socket\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.673671 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.673474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3774a4e-501d-42e2-b589-cb5a6533a40c-istiod-ca-cert\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.673671 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.673519    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-podinfo\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.673671 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.673555    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-socket\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.673671 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.673589    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-token\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.673671 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.673610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-envoy\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.673671 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.673650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grmfd\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-kube-api-access-grmfd\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.673671 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.673675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-data\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775065 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-certs\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775065 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-credential-socket\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775193    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3774a4e-501d-42e2-b589-cb5a6533a40c-istiod-ca-cert\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-podinfo\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-socket\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775313    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-token\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775369    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-envoy\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grmfd\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-kube-api-access-grmfd\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-data\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775542    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-certs\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.775642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775604    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-credential-socket\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.776168 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775696    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-socket\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.776168 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-data\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.776168 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.775930    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3774a4e-501d-42e2-b589-cb5a6533a40c-istiod-ca-cert\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.777911 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.777886    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-envoy\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.778088 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.778070    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-podinfo\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.784115 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.784087    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-token\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.784548 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.784518    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grmfd\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-kube-api-access-grmfd\") pod \"e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") " pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:08.920528 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:08.920425    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:09.062801 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:09.062775    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"]
Jul 29 04:43:09.065746 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:43:09.065715    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3774a4e_501d_42e2_b589_cb5a6533a40c.slice/crio-b2b0ee3e28a8899c9026e47164d9dc6ffe7686a5012f5a15cb8641d5d266e4aa WatchSource:0}: Error finding container b2b0ee3e28a8899c9026e47164d9dc6ffe7686a5012f5a15cb8641d5d266e4aa: Status 404 returned error can't find the container with id b2b0ee3e28a8899c9026e47164d9dc6ffe7686a5012f5a15cb8641d5d266e4aa
Jul 29 04:43:09.068130 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:09.068096    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:09.068215 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:09.068181    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:09.068256 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:09.068222    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:09.288848 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:09.288809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" event={"ID":"a3774a4e-501d-42e2-b589-cb5a6533a40c","Type":"ContainerStarted","Data":"76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44"}
Jul 29 04:43:09.289034 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:09.288876    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" event={"ID":"a3774a4e-501d-42e2-b589-cb5a6533a40c","Type":"ContainerStarted","Data":"b2b0ee3e28a8899c9026e47164d9dc6ffe7686a5012f5a15cb8641d5d266e4aa"}
Jul 29 04:43:09.308968 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:09.308911    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" podStartSLOduration=1.308893051 podStartE2EDuration="1.308893051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:43:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:43:09.307079283 +0000 UTC m=+2869.902180000" watchObservedRunningTime="2026-07-29 04:43:09.308893051 +0000 UTC m=+2869.903993767"
Jul 29 04:43:09.920784 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:09.920750    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:10.926614 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:10.926540    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:11.300540 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:11.300484    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:11.301625 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:11.301607    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:13.017664 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.017641    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:43:13.118133 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118051    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzx66\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-kube-api-access-nzx66\") pod \"0d980474-b147-4308-81db-86317c089d34\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") "
Jul 29 04:43:13.118133 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118115    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-certs\") pod \"0d980474-b147-4308-81db-86317c089d34\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") "
Jul 29 04:43:13.118344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118154    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-socket\") pod \"0d980474-b147-4308-81db-86317c089d34\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") "
Jul 29 04:43:13.118344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118193    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d980474-b147-4308-81db-86317c089d34-istio-podinfo\") pod \"0d980474-b147-4308-81db-86317c089d34\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") "
Jul 29 04:43:13.118344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118216    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-istio-token\") pod \"0d980474-b147-4308-81db-86317c089d34\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") "
Jul 29 04:43:13.118344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118246    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d980474-b147-4308-81db-86317c089d34-istiod-ca-cert\") pod \"0d980474-b147-4308-81db-86317c089d34\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") "
Jul 29 04:43:13.118344 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118278    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-credential-socket\") pod \"0d980474-b147-4308-81db-86317c089d34\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") "
Jul 29 04:43:13.118649 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118437    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d980474-b147-4308-81db-86317c089d34" (UID: "0d980474-b147-4308-81db-86317c089d34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:43:13.118649 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118455    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d980474-b147-4308-81db-86317c089d34" (UID: "0d980474-b147-4308-81db-86317c089d34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:43:13.118649 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118569    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-data\") pod \"0d980474-b147-4308-81db-86317c089d34\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") "
Jul 29 04:43:13.118649 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118584    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d980474-b147-4308-81db-86317c089d34" (UID: "0d980474-b147-4308-81db-86317c089d34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:43:13.118649 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118649    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-envoy\") pod \"0d980474-b147-4308-81db-86317c089d34\" (UID: \"0d980474-b147-4308-81db-86317c089d34\") "
Jul 29 04:43:13.118890 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118689    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d980474-b147-4308-81db-86317c089d34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d980474-b147-4308-81db-86317c089d34" (UID: "0d980474-b147-4308-81db-86317c089d34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:43:13.118956 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118903    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:43:13.118956 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118919    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:43:13.118956 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118932    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d980474-b147-4308-81db-86317c089d34-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:43:13.118956 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.118941    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:43:13.119586 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.119560    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d980474-b147-4308-81db-86317c089d34" (UID: "0d980474-b147-4308-81db-86317c089d34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:43:13.120737 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.120708    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d980474-b147-4308-81db-86317c089d34" (UID: "0d980474-b147-4308-81db-86317c089d34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:43:13.120821 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.120740    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d980474-b147-4308-81db-86317c089d34" (UID: "0d980474-b147-4308-81db-86317c089d34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:43:13.121035 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.121015    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d980474-b147-4308-81db-86317c089d34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d980474-b147-4308-81db-86317c089d34" (UID: "0d980474-b147-4308-81db-86317c089d34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:43:13.121104 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.121070    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-kube-api-access-nzx66" (OuterVolumeSpecName: "kube-api-access-nzx66") pod "0d980474-b147-4308-81db-86317c089d34" (UID: "0d980474-b147-4308-81db-86317c089d34"). InnerVolumeSpecName "kube-api-access-nzx66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:43:13.219928 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.219896    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:43:13.219928 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.219924    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d980474-b147-4308-81db-86317c089d34-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:43:13.219928 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.219934    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzx66\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-kube-api-access-nzx66\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:43:13.220207 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.219943    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d980474-b147-4308-81db-86317c089d34-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:43:13.220207 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.219951    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d980474-b147-4308-81db-86317c089d34-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:43:13.310776 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.310738    2573 generic.go:356] "Generic (PLEG): container finished" podID="0d980474-b147-4308-81db-86317c089d34" containerID="c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa" exitCode=0
Jul 29 04:43:13.310930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.310784    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"
Jul 29 04:43:13.310930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.310819    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" event={"ID":"0d980474-b147-4308-81db-86317c089d34","Type":"ContainerDied","Data":"c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa"}
Jul 29 04:43:13.310930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.310869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85" event={"ID":"0d980474-b147-4308-81db-86317c089d34","Type":"ContainerDied","Data":"ba1d8487a7f5eb1ad4db72cd6128a595a099fc4eea2164557dce52bcfaea8934"}
Jul 29 04:43:13.310930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.310899    2573 scope.go:117] "RemoveContainer" containerID="c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa"
Jul 29 04:43:13.320391 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.320372    2573 scope.go:117] "RemoveContainer" containerID="9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799"
Jul 29 04:43:13.328266 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.328247    2573 scope.go:117] "RemoveContainer" containerID="c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa"
Jul 29 04:43:13.328558 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:43:13.328511    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa\": container with ID starting with c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa not found: ID does not exist" containerID="c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa"
Jul 29 04:43:13.328558 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.328542    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa"} err="failed to get container status \"c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa\": rpc error: code = NotFound desc = could not find container \"c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa\": container with ID starting with c86a656a5854f4689f1348ee0739a3780a5c86cd9e7246b3ce6df4479703acfa not found: ID does not exist"
Jul 29 04:43:13.328558 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.328559    2573 scope.go:117] "RemoveContainer" containerID="9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799"
Jul 29 04:43:13.328824 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:43:13.328803    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799\": container with ID starting with 9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799 not found: ID does not exist" containerID="9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799"
Jul 29 04:43:13.328870 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.328830    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799"} err="failed to get container status \"9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799\": rpc error: code = NotFound desc = could not find container \"9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799\": container with ID starting with 9562f402ad5ecce5d152ad4cb415e957f1fb10002f60dd46af1ffaad21cb7799 not found: ID does not exist"
Jul 29 04:43:13.334006 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.333986    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"]
Jul 29 04:43:13.337603 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.337581    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a32259-openshift-default-6d4cbd8464-tdv85"]
Jul 29 04:43:13.867650 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:13.867611    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d980474-b147-4308-81db-86317c089d34" path="/var/lib/kubelet/pods/0d980474-b147-4308-81db-86317c089d34/volumes"
Jul 29 04:43:16.069021 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:16.068986    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:43:24.364239 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:24.364206    2573 generic.go:356] "Generic (PLEG): container finished" podID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerID="76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44" exitCode=0
Jul 29 04:43:24.364754 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:24.364291    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" event={"ID":"a3774a4e-501d-42e2-b589-cb5a6533a40c","Type":"ContainerDied","Data":"76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44"}
Jul 29 04:43:24.364754 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:24.364719    2573 scope.go:117] "RemoveContainer" containerID="76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44"
Jul 29 04:43:24.365737 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:24.365705    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:24.365839 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:24.365775    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:24.365839 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:24.365806    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:25.372625 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:25.371696    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" event={"ID":"a3774a4e-501d-42e2-b589-cb5a6533a40c","Type":"ContainerStarted","Data":"a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f"}
Jul 29 04:43:25.921325 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:25.921289    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:25.922367 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:25.922338    2573 patch_prober.go:28] interesting pod/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 04:43:25.922482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:25.922402    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 04:43:26.301158 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:26.301125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:26.921693 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:26.921653    2573 patch_prober.go:28] interesting pod/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 04:43:26.922086 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:26.921714    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 04:43:27.921552 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:27.921517    2573 patch_prober.go:28] interesting pod/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 04:43:27.921727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:27.921575    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 04:43:28.921772 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:28.921635    2573 patch_prober.go:28] interesting pod/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 04:43:28.921772 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:28.921689    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 04:43:29.925562 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:29.925532    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:29.926662 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:29.926645    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:43:36.894883 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.894847    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"]
Jul 29 04:43:36.895469 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.895335    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy"
Jul 29 04:43:36.895469 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.895352    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd2e1628-fd55-4201-92a5-ed0f085f79f7" containerName="istio-proxy"
Jul 29 04:43:36.895469 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.895365    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy"
Jul 29 04:43:36.895469 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.895374    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy"
Jul 29 04:43:36.895469 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.895388    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy"
Jul 29 04:43:36.895469 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.895397    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy"
Jul 29 04:43:36.895768 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.895517    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy"
Jul 29 04:43:36.895768 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.895532    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d980474-b147-4308-81db-86317c089d34" containerName="istio-proxy"
Jul 29 04:43:36.898787 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.898763    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:36.901330 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.901316    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a099ac-openshift-default-dockercfg-tcpkj\""
Jul 29 04:43:36.909785 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:36.909761    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"]
Jul 29 04:43:37.031758 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.031712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrdpd\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-kube-api-access-nrdpd\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.031967 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.031765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-podinfo\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.031967 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.031798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-credential-socket\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.031967 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.031858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-envoy\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.031967 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.031923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-token\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.031967 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.031953    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28aec7a-f38f-4f9d-8b90-cfb371534195-istiod-ca-cert\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.032138 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.031982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-certs\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.032138 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.031999    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-data\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.032138 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.032022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-socket\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.132716 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.132674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-socket\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.132927 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.132729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdpd\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-kube-api-access-nrdpd\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.132927 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.132749    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-podinfo\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.132927 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.132771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-credential-socket\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.132927 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.132819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-envoy\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.132927 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.132847    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-token\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.132927 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.132875    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28aec7a-f38f-4f9d-8b90-cfb371534195-istiod-ca-cert\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.132927 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.132905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-certs\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.132927 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.132930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-data\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.133365 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.133158    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-socket\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.133365 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.133188    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-credential-socket\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.133365 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.133247    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-certs\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.133530 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.133420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-data\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.133756 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.133737    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28aec7a-f38f-4f9d-8b90-cfb371534195-istiod-ca-cert\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.135862 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.135836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-envoy\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.136016 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.135999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-podinfo\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.140833 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.140806    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrdpd\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-kube-api-access-nrdpd\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.141023 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.141004    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-token\") pod \"e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") " pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.209288 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.209202    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:37.359465 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.359438    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"]
Jul 29 04:43:37.361968 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:43:37.361939    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28aec7a_f38f_4f9d_8b90_cfb371534195.slice/crio-a02e626d0cb2aaa022da8c258ef8e9e60bc54d66267369138f6c1c9535b40c1b WatchSource:0}: Error finding container a02e626d0cb2aaa022da8c258ef8e9e60bc54d66267369138f6c1c9535b40c1b: Status 404 returned error can't find the container with id a02e626d0cb2aaa022da8c258ef8e9e60bc54d66267369138f6c1c9535b40c1b
Jul 29 04:43:37.364158 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.364125    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:37.364260 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.364190    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:37.364260 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.364215    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:37.448598 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.448534    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" event={"ID":"c28aec7a-f38f-4f9d-8b90-cfb371534195","Type":"ContainerStarted","Data":"bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69"}
Jul 29 04:43:37.448774 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.448616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" event={"ID":"c28aec7a-f38f-4f9d-8b90-cfb371534195","Type":"ContainerStarted","Data":"a02e626d0cb2aaa022da8c258ef8e9e60bc54d66267369138f6c1c9535b40c1b"}
Jul 29 04:43:37.466383 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:37.466272    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" podStartSLOduration=1.466252817 podStartE2EDuration="1.466252817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:43:37.465532296 +0000 UTC m=+2898.060633015" watchObservedRunningTime="2026-07-29 04:43:37.466252817 +0000 UTC m=+2898.061353535"
Jul 29 04:43:38.209715 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:38.209677    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:38.214756 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:38.214733    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:38.453548 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:38.453521    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:38.454474 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:38.454451    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:47.757847 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:47.757813    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:43:54.495700 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:54.495657    2573 patch_prober.go:28] interesting pod/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 04:43:54.496114 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:54.495755    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 04:43:56.539924 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:56.539888    2573 generic.go:356] "Generic (PLEG): container finished" podID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerID="bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69" exitCode=0
Jul 29 04:43:56.540345 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:56.539951    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" event={"ID":"c28aec7a-f38f-4f9d-8b90-cfb371534195","Type":"ContainerDied","Data":"bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69"}
Jul 29 04:43:56.540345 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:56.540307    2573 scope.go:117] "RemoveContainer" containerID="bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69"
Jul 29 04:43:56.541505 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:56.541456    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:56.541583 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:56.541567    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:56.541623 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:56.541608    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:43:57.546348 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:57.546311    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" event={"ID":"c28aec7a-f38f-4f9d-8b90-cfb371534195","Type":"ContainerStarted","Data":"68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916"}
Jul 29 04:43:58.209382 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:58.209349    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:43:58.209601 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:58.209576    2573 patch_prober.go:28] interesting pod/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 29 04:43:58.209660 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:58.209640    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 29 04:43:59.209731 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:59.209691    2573 patch_prober.go:28] interesting pod/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 29 04:43:59.210220 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:43:59.209770    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 29 04:44:00.209797 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:00.209765    2573 patch_prober.go:28] interesting pod/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 29 04:44:00.210196 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:00.209829    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 29 04:44:01.209936 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:01.209880    2573 patch_prober.go:28] interesting pod/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 29 04:44:01.210399 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:01.209952    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 29 04:44:02.213472 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:02.213442    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:44:02.213923 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:02.213744    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:44:02.214380 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:02.214364    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:44:07.149692 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.149661    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"]
Jul 29 04:44:07.152825 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.152806    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"
Jul 29 04:44:07.155417 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.155394    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:44:07.155560 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.155413    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n8frm\""
Jul 29 04:44:07.160112 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.160083    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"]
Jul 29 04:44:07.184770 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.184735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f2bfe-2bee-4ab5-b677-86e90165030c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7\" (UID: \"778f2bfe-2bee-4ab5-b677-86e90165030c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"
Jul 29 04:44:07.285917 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.285878    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f2bfe-2bee-4ab5-b677-86e90165030c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7\" (UID: \"778f2bfe-2bee-4ab5-b677-86e90165030c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"
Jul 29 04:44:07.286466 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.286448    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f2bfe-2bee-4ab5-b677-86e90165030c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7\" (UID: \"778f2bfe-2bee-4ab5-b677-86e90165030c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"
Jul 29 04:44:07.465203 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.465113    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"
Jul 29 04:44:07.597946 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:07.597853    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"]
Jul 29 04:44:07.600827 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:44:07.600796    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778f2bfe_2bee_4ab5_b677_86e90165030c.slice/crio-8f01a723561f7ad24c7320572fad23d774acf54e6a0bca2209025edacbfefcf1 WatchSource:0}: Error finding container 8f01a723561f7ad24c7320572fad23d774acf54e6a0bca2209025edacbfefcf1: Status 404 returned error can't find the container with id 8f01a723561f7ad24c7320572fad23d774acf54e6a0bca2209025edacbfefcf1
Jul 29 04:44:08.598535 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:08.598479    2573 generic.go:356] "Generic (PLEG): container finished" podID="778f2bfe-2bee-4ab5-b677-86e90165030c" containerID="b3564bf3474e2c588d21a9856e0911137d173a4f63837abd1e902a799f694ccb" exitCode=0
Jul 29 04:44:08.598932 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:08.598567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7" event={"ID":"778f2bfe-2bee-4ab5-b677-86e90165030c","Type":"ContainerDied","Data":"b3564bf3474e2c588d21a9856e0911137d173a4f63837abd1e902a799f694ccb"}
Jul 29 04:44:08.598932 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:08.598621    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7" event={"ID":"778f2bfe-2bee-4ab5-b677-86e90165030c","Type":"ContainerStarted","Data":"8f01a723561f7ad24c7320572fad23d774acf54e6a0bca2209025edacbfefcf1"}
Jul 29 04:44:09.732679 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:09.732656    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"
Jul 29 04:44:09.799571 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:09.799536    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f2bfe-2bee-4ab5-b677-86e90165030c-maas-api-service-ca\") pod \"778f2bfe-2bee-4ab5-b677-86e90165030c\" (UID: \"778f2bfe-2bee-4ab5-b677-86e90165030c\") "
Jul 29 04:44:09.799889 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:09.799864    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/778f2bfe-2bee-4ab5-b677-86e90165030c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "778f2bfe-2bee-4ab5-b677-86e90165030c" (UID: "778f2bfe-2bee-4ab5-b677-86e90165030c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:44:09.900308 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:09.900278    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f2bfe-2bee-4ab5-b677-86e90165030c-maas-api-service-ca\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:10.608838 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:10.608807    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"
Jul 29 04:44:10.609021 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:10.608835    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7" event={"ID":"778f2bfe-2bee-4ab5-b677-86e90165030c","Type":"ContainerDied","Data":"8f01a723561f7ad24c7320572fad23d774acf54e6a0bca2209025edacbfefcf1"}
Jul 29 04:44:10.609021 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:10.608884    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f01a723561f7ad24c7320572fad23d774acf54e6a0bca2209025edacbfefcf1"
Jul 29 04:44:22.810596 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:22.810562    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"]
Jul 29 04:44:22.813870 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:22.813845    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fec70b-jtzx7"]
Jul 29 04:44:23.867287 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:23.867255    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="778f2bfe-2bee-4ab5-b677-86e90165030c" path="/var/lib/kubelet/pods/778f2bfe-2bee-4ab5-b677-86e90165030c/volumes"
Jul 29 04:44:24.955905 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:24.955871    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:44:29.211595 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:29.211556    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"]
Jul 29 04:44:29.212047 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:29.211814    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy" containerID="cri-o://a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f" gracePeriod=30
Jul 29 04:44:29.928191 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:29.928152    2573 patch_prober.go:28] interesting pod/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 04:44:29.928357 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:29.928215    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:44:34.469309 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.469278    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:44:34.599054 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599016    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grmfd\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-kube-api-access-grmfd\") pod \"a3774a4e-501d-42e2-b589-cb5a6533a40c\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") "
Jul 29 04:44:34.599270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599076    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3774a4e-501d-42e2-b589-cb5a6533a40c-istiod-ca-cert\") pod \"a3774a4e-501d-42e2-b589-cb5a6533a40c\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") "
Jul 29 04:44:34.599270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599103    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-data\") pod \"a3774a4e-501d-42e2-b589-cb5a6533a40c\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") "
Jul 29 04:44:34.599270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599128    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-credential-socket\") pod \"a3774a4e-501d-42e2-b589-cb5a6533a40c\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") "
Jul 29 04:44:34.599270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599172    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-socket\") pod \"a3774a4e-501d-42e2-b589-cb5a6533a40c\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") "
Jul 29 04:44:34.599270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599206    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-certs\") pod \"a3774a4e-501d-42e2-b589-cb5a6533a40c\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") "
Jul 29 04:44:34.599270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599234    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-token\") pod \"a3774a4e-501d-42e2-b589-cb5a6533a40c\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") "
Jul 29 04:44:34.599270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599254    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-envoy\") pod \"a3774a4e-501d-42e2-b589-cb5a6533a40c\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") "
Jul 29 04:44:34.599659 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599317    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-podinfo\") pod \"a3774a4e-501d-42e2-b589-cb5a6533a40c\" (UID: \"a3774a4e-501d-42e2-b589-cb5a6533a40c\") "
Jul 29 04:44:34.599659 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599483    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3774a4e-501d-42e2-b589-cb5a6533a40c" (UID: "a3774a4e-501d-42e2-b589-cb5a6533a40c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:34.599659 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599563    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3774a4e-501d-42e2-b589-cb5a6533a40c" (UID: "a3774a4e-501d-42e2-b589-cb5a6533a40c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:34.599659 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599550    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3774a4e-501d-42e2-b589-cb5a6533a40c" (UID: "a3774a4e-501d-42e2-b589-cb5a6533a40c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:34.599659 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.599630    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3774a4e-501d-42e2-b589-cb5a6533a40c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3774a4e-501d-42e2-b589-cb5a6533a40c" (UID: "a3774a4e-501d-42e2-b589-cb5a6533a40c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:44:34.600309 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.600279    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3774a4e-501d-42e2-b589-cb5a6533a40c" (UID: "a3774a4e-501d-42e2-b589-cb5a6533a40c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:34.601553 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.601473    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-kube-api-access-grmfd" (OuterVolumeSpecName: "kube-api-access-grmfd") pod "a3774a4e-501d-42e2-b589-cb5a6533a40c" (UID: "a3774a4e-501d-42e2-b589-cb5a6533a40c"). InnerVolumeSpecName "kube-api-access-grmfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:44:34.601740 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.601725    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3774a4e-501d-42e2-b589-cb5a6533a40c" (UID: "a3774a4e-501d-42e2-b589-cb5a6533a40c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:34.601801 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.601759    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3774a4e-501d-42e2-b589-cb5a6533a40c" (UID: "a3774a4e-501d-42e2-b589-cb5a6533a40c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:44:34.601893 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.601879    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3774a4e-501d-42e2-b589-cb5a6533a40c" (UID: "a3774a4e-501d-42e2-b589-cb5a6533a40c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:44:34.700321 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.700291    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:34.700321 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.700316    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:34.700321 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.700326    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:34.700591 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.700334    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:34.700591 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.700342    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:34.700591 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.700349    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grmfd\" (UniqueName: \"kubernetes.io/projected/a3774a4e-501d-42e2-b589-cb5a6533a40c-kube-api-access-grmfd\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:34.700591 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.700357    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3774a4e-501d-42e2-b589-cb5a6533a40c-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:34.700591 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.700365    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:34.700591 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.700372    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3774a4e-501d-42e2-b589-cb5a6533a40c-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:34.722432 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.722402    2573 generic.go:356] "Generic (PLEG): container finished" podID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerID="a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f" exitCode=0
Jul 29 04:44:34.722610 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.722454    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"
Jul 29 04:44:34.722610 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.722514    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" event={"ID":"a3774a4e-501d-42e2-b589-cb5a6533a40c","Type":"ContainerDied","Data":"a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f"}
Jul 29 04:44:34.722610 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.722567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d" event={"ID":"a3774a4e-501d-42e2-b589-cb5a6533a40c","Type":"ContainerDied","Data":"b2b0ee3e28a8899c9026e47164d9dc6ffe7686a5012f5a15cb8641d5d266e4aa"}
Jul 29 04:44:34.722610 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.722597    2573 scope.go:117] "RemoveContainer" containerID="a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f"
Jul 29 04:44:34.732048 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.732028    2573 scope.go:117] "RemoveContainer" containerID="76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44"
Jul 29 04:44:34.739981 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.739957    2573 scope.go:117] "RemoveContainer" containerID="a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f"
Jul 29 04:44:34.740268 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:44:34.740248    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f\": container with ID starting with a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f not found: ID does not exist" containerID="a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f"
Jul 29 04:44:34.740357 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.740274    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f"} err="failed to get container status \"a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f\": rpc error: code = NotFound desc = could not find container \"a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f\": container with ID starting with a628007a668b051bb5b92f69dc638d09e5bf297c3868b7925325859dd863a14f not found: ID does not exist"
Jul 29 04:44:34.740357 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.740291    2573 scope.go:117] "RemoveContainer" containerID="76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44"
Jul 29 04:44:34.740554 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:44:34.740539    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44\": container with ID starting with 76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44 not found: ID does not exist" containerID="76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44"
Jul 29 04:44:34.740601 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.740561    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44"} err="failed to get container status \"76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44\": rpc error: code = NotFound desc = could not find container \"76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44\": container with ID starting with 76e8d9b8832f4e8dc0265c6aa90632f4452e03479b7153844603159962eeec44 not found: ID does not exist"
Jul 29 04:44:34.743629 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.743607    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"]
Jul 29 04:44:34.746977 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:34.746959    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-fec70b-openshift-default-758cf6bf4-2cz5d"]
Jul 29 04:44:35.868215 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:35.868181    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" path="/var/lib/kubelet/pods/a3774a4e-501d-42e2-b589-cb5a6533a40c/volumes"
Jul 29 04:44:50.254881 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:50.254804    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:44:51.783699 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:51.783652    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"]
Jul 29 04:44:51.784170 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:51.783918    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy" containerID="cri-o://68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916" gracePeriod=30
Jul 29 04:44:52.646901 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.646867    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"]
Jul 29 04:44:52.647199 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.647187    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy"
Jul 29 04:44:52.647199 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.647200    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy"
Jul 29 04:44:52.647317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.647209    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy"
Jul 29 04:44:52.647317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.647215    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy"
Jul 29 04:44:52.647317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.647228    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="778f2bfe-2bee-4ab5-b677-86e90165030c" containerName="revoke-keys"
Jul 29 04:44:52.647317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.647233    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="778f2bfe-2bee-4ab5-b677-86e90165030c" containerName="revoke-keys"
Jul 29 04:44:52.647317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.647287    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy"
Jul 29 04:44:52.647317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.647294    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3774a4e-501d-42e2-b589-cb5a6533a40c" containerName="istio-proxy"
Jul 29 04:44:52.647317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.647301    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="778f2bfe-2bee-4ab5-b677-86e90165030c" containerName="revoke-keys"
Jul 29 04:44:52.651744 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.651728    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.654285 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.654264    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-b70f7c-openshift-default-dockercfg-z9qmd\""
Jul 29 04:44:52.662038 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.662016    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"]
Jul 29 04:44:52.758267 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.758228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-socket\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.758267 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.758266    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-envoy\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.758482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.758299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6lq2\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-kube-api-access-f6lq2\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.758482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.758389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-certs\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.758482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.758446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-credential-socket\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.758613 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.758520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-data\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.758613 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.758577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40431e0-1605-42aa-8f9d-097fafb10375-istiod-ca-cert\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.758613 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.758609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40431e0-1605-42aa-8f9d-097fafb10375-istio-podinfo\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.758713 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.758632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-istio-token\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.859405 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-socket\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.859405 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-envoy\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.859975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6lq2\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-kube-api-access-f6lq2\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.859975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-certs\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.859975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-credential-socket\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.859975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-data\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.859975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40431e0-1605-42aa-8f9d-097fafb10375-istiod-ca-cert\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.859975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40431e0-1605-42aa-8f9d-097fafb10375-istio-podinfo\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.859975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-istio-token\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.860359 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.859984    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-credential-socket\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.860359 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.860063    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-data\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.860359 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.860130    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-socket\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.860537 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.860362    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-certs\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.860537 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.860461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40431e0-1605-42aa-8f9d-097fafb10375-istiod-ca-cert\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.861919 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.861900    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-envoy\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.862311 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.862291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40431e0-1605-42aa-8f9d-097fafb10375-istio-podinfo\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.878462 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.878440    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-istio-token\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.878611 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.878595    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6lq2\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-kube-api-access-f6lq2\") pod \"e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") " pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:52.963557 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:52.963434    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:53.108099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:53.107936    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"]
Jul 29 04:44:53.111125 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:44:53.111096    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40431e0_1605_42aa_8f9d_097fafb10375.slice/crio-cdc8e051a6e64d4a332bfbecb9c4343231ccaca83e308b0a2df5ff2de6d690a8 WatchSource:0}: Error finding container cdc8e051a6e64d4a332bfbecb9c4343231ccaca83e308b0a2df5ff2de6d690a8: Status 404 returned error can't find the container with id cdc8e051a6e64d4a332bfbecb9c4343231ccaca83e308b0a2df5ff2de6d690a8
Jul 29 04:44:53.113654 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:53.113621    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:44:53.113757 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:53.113691    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:44:53.113757 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:53.113720    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:44:53.809995 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:53.809959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" event={"ID":"e40431e0-1605-42aa-8f9d-097fafb10375","Type":"ContainerStarted","Data":"b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7"}
Jul 29 04:44:53.810173 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:53.810009    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" event={"ID":"e40431e0-1605-42aa-8f9d-097fafb10375","Type":"ContainerStarted","Data":"cdc8e051a6e64d4a332bfbecb9c4343231ccaca83e308b0a2df5ff2de6d690a8"}
Jul 29 04:44:53.829599 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:53.829546    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" podStartSLOduration=1.8295302850000001 podStartE2EDuration="1.829530285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:44:53.827762452 +0000 UTC m=+2974.422863169" watchObservedRunningTime="2026-07-29 04:44:53.829530285 +0000 UTC m=+2974.424631001"
Jul 29 04:44:53.963572 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:53.963541    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:54.969040 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:54.969010    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:55.820054 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:55.820023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:55.820955 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:55.820934    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:44:57.048784 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.048721    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:44:57.193827 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.193795    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrdpd\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-kube-api-access-nrdpd\") pod \"c28aec7a-f38f-4f9d-8b90-cfb371534195\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") "
Jul 29 04:44:57.193827 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.193828    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28aec7a-f38f-4f9d-8b90-cfb371534195-istiod-ca-cert\") pod \"c28aec7a-f38f-4f9d-8b90-cfb371534195\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") "
Jul 29 04:44:57.194091 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.193859    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-token\") pod \"c28aec7a-f38f-4f9d-8b90-cfb371534195\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") "
Jul 29 04:44:57.194091 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.193897    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-data\") pod \"c28aec7a-f38f-4f9d-8b90-cfb371534195\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") "
Jul 29 04:44:57.194091 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.193955    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-envoy\") pod \"c28aec7a-f38f-4f9d-8b90-cfb371534195\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") "
Jul 29 04:44:57.194091 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.193990    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-credential-socket\") pod \"c28aec7a-f38f-4f9d-8b90-cfb371534195\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") "
Jul 29 04:44:57.194091 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.194014    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-socket\") pod \"c28aec7a-f38f-4f9d-8b90-cfb371534195\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") "
Jul 29 04:44:57.194091 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.194038    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-certs\") pod \"c28aec7a-f38f-4f9d-8b90-cfb371534195\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") "
Jul 29 04:44:57.194091 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.194064    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-podinfo\") pod \"c28aec7a-f38f-4f9d-8b90-cfb371534195\" (UID: \"c28aec7a-f38f-4f9d-8b90-cfb371534195\") "
Jul 29 04:44:57.194479 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.194331    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c28aec7a-f38f-4f9d-8b90-cfb371534195-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c28aec7a-f38f-4f9d-8b90-cfb371534195" (UID: "c28aec7a-f38f-4f9d-8b90-cfb371534195"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:44:57.194751 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.194667    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c28aec7a-f38f-4f9d-8b90-cfb371534195" (UID: "c28aec7a-f38f-4f9d-8b90-cfb371534195"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:57.194751 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.194764    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c28aec7a-f38f-4f9d-8b90-cfb371534195" (UID: "c28aec7a-f38f-4f9d-8b90-cfb371534195"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:57.194751 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.194775    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c28aec7a-f38f-4f9d-8b90-cfb371534195" (UID: "c28aec7a-f38f-4f9d-8b90-cfb371534195"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:57.195259 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.195229    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-data" (OuterVolumeSpecName: "istio-data") pod "c28aec7a-f38f-4f9d-8b90-cfb371534195" (UID: "c28aec7a-f38f-4f9d-8b90-cfb371534195"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:57.196402 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.196380    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-kube-api-access-nrdpd" (OuterVolumeSpecName: "kube-api-access-nrdpd") pod "c28aec7a-f38f-4f9d-8b90-cfb371534195" (UID: "c28aec7a-f38f-4f9d-8b90-cfb371534195"). InnerVolumeSpecName "kube-api-access-nrdpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:44:57.196545 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.196521    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-token" (OuterVolumeSpecName: "istio-token") pod "c28aec7a-f38f-4f9d-8b90-cfb371534195" (UID: "c28aec7a-f38f-4f9d-8b90-cfb371534195"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:44:57.196611 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.196551    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c28aec7a-f38f-4f9d-8b90-cfb371534195" (UID: "c28aec7a-f38f-4f9d-8b90-cfb371534195"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:44:57.196947 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.196929    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c28aec7a-f38f-4f9d-8b90-cfb371534195" (UID: "c28aec7a-f38f-4f9d-8b90-cfb371534195"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:44:57.295559 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.295515    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:57.295559 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.295549    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:57.295559 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.295558    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:57.295559 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.295567    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:57.295828 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.295578    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28aec7a-f38f-4f9d-8b90-cfb371534195-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:57.295828 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.295586    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:57.295828 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.295595    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrdpd\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-kube-api-access-nrdpd\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:57.295828 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.295603    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28aec7a-f38f-4f9d-8b90-cfb371534195-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:57.295828 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.295611    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28aec7a-f38f-4f9d-8b90-cfb371534195-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:44:57.831082 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.831049    2573 generic.go:356] "Generic (PLEG): container finished" podID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerID="68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916" exitCode=0
Jul 29 04:44:57.831263 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.831099    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"
Jul 29 04:44:57.831263 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.831136    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" event={"ID":"c28aec7a-f38f-4f9d-8b90-cfb371534195","Type":"ContainerDied","Data":"68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916"}
Jul 29 04:44:57.831263 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.831219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt" event={"ID":"c28aec7a-f38f-4f9d-8b90-cfb371534195","Type":"ContainerDied","Data":"a02e626d0cb2aaa022da8c258ef8e9e60bc54d66267369138f6c1c9535b40c1b"}
Jul 29 04:44:57.831263 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.831248    2573 scope.go:117] "RemoveContainer" containerID="68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916"
Jul 29 04:44:57.840523 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.840482    2573 scope.go:117] "RemoveContainer" containerID="bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69"
Jul 29 04:44:57.848061 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.848042    2573 scope.go:117] "RemoveContainer" containerID="68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916"
Jul 29 04:44:57.848316 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:44:57.848301    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916\": container with ID starting with 68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916 not found: ID does not exist" containerID="68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916"
Jul 29 04:44:57.848362 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.848322    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916"} err="failed to get container status \"68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916\": rpc error: code = NotFound desc = could not find container \"68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916\": container with ID starting with 68e993e21de97cce24078c9f94736c44720996c52317a9d405bc9580bc52a916 not found: ID does not exist"
Jul 29 04:44:57.848362 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.848337    2573 scope.go:117] "RemoveContainer" containerID="bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69"
Jul 29 04:44:57.848620 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:44:57.848601    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69\": container with ID starting with bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69 not found: ID does not exist" containerID="bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69"
Jul 29 04:44:57.848670 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.848627    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69"} err="failed to get container status \"bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69\": rpc error: code = NotFound desc = could not find container \"bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69\": container with ID starting with bb80e2a993f511a83a77da081c681ab6bc4b176878a7fd74ef79a61017da4b69 not found: ID does not exist"
Jul 29 04:44:57.851869 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.851847    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"]
Jul 29 04:44:57.855301 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.855281    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a099ac-openshift-default-776dc46d7b-rfvkt"]
Jul 29 04:44:57.867919 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:44:57.867894    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" path="/var/lib/kubelet/pods/c28aec7a-f38f-4f9d-8b90-cfb371534195/volumes"
Jul 29 04:45:00.130911 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.130863    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"]
Jul 29 04:45:00.131412 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.131331    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy"
Jul 29 04:45:00.131412 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.131350    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy"
Jul 29 04:45:00.131412 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.131374    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy"
Jul 29 04:45:00.131412 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.131383    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy"
Jul 29 04:45:00.131757 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.131471    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy"
Jul 29 04:45:00.131757 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.131486    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c28aec7a-f38f-4f9d-8b90-cfb371534195" containerName="istio-proxy"
Jul 29 04:45:00.134362 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.134340    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td"]
Jul 29 04:45:00.134515 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.134450    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"
Jul 29 04:45:00.137241 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.137222    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n8frm\""
Jul 29 04:45:00.137426 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.137409    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td"
Jul 29 04:45:00.144608 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.144569    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td"]
Jul 29 04:45:00.146815 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.146790    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"]
Jul 29 04:45:00.148165 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.148147    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"
Jul 29 04:45:00.154653 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.154634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td"
Jul 29 04:45:00.294213 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.294186    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"]
Jul 29 04:45:00.297335 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:45:00.297304    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda39cb97_d2be_4974_a016_a1e9c51d792d.slice/crio-e9bb9b84fb358c473b88a7e513a3edb343319660aedd1162f2cabdc383592e11 WatchSource:0}: Error finding container e9bb9b84fb358c473b88a7e513a3edb343319660aedd1162f2cabdc383592e11: Status 404 returned error can't find the container with id e9bb9b84fb358c473b88a7e513a3edb343319660aedd1162f2cabdc383592e11
Jul 29 04:45:00.317923 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.317884    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td"]
Jul 29 04:45:00.320003 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:45:00.319969    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d4ae30_2014_47e4_b870_a59a4bd6a136.slice/crio-8cc74a9470de131279d612091bce6e0288575a24a4135a15eb077df4599b6395 WatchSource:0}: Error finding container 8cc74a9470de131279d612091bce6e0288575a24a4135a15eb077df4599b6395: Status 404 returned error can't find the container with id 8cc74a9470de131279d612091bce6e0288575a24a4135a15eb077df4599b6395
Jul 29 04:45:00.848230 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.848191    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td" event={"ID":"30d4ae30-2014-47e4-b870-a59a4bd6a136","Type":"ContainerStarted","Data":"3d04afb346603ed4f572892ab113b583b6598aca80a774a8cf0603d140f99dc7"}
Jul 29 04:45:00.848438 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.848262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td" event={"ID":"30d4ae30-2014-47e4-b870-a59a4bd6a136","Type":"ContainerStarted","Data":"8cc74a9470de131279d612091bce6e0288575a24a4135a15eb077df4599b6395"}
Jul 29 04:45:00.849678 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.849645    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4" event={"ID":"da39cb97-d2be-4974-a016-a1e9c51d792d","Type":"ContainerStarted","Data":"e7a04fab6cb0f16cf4af3f234226f089e516cc194a384ef9378d6e91e7acf518"}
Jul 29 04:45:00.849809 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.849687    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4" event={"ID":"da39cb97-d2be-4974-a016-a1e9c51d792d","Type":"ContainerStarted","Data":"e9bb9b84fb358c473b88a7e513a3edb343319660aedd1162f2cabdc383592e11"}
Jul 29 04:45:00.863615 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.863567    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td" podStartSLOduration=0.863552467 podStartE2EDuration="863.552467ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:45:00.861070627 +0000 UTC m=+2981.456171343" watchObservedRunningTime="2026-07-29 04:45:00.863552467 +0000 UTC m=+2981.458653184"
Jul 29 04:45:00.875004 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:00.874962    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4" podStartSLOduration=0.874948789 podStartE2EDuration="874.948789ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:45:00.873467098 +0000 UTC m=+2981.468567816" watchObservedRunningTime="2026-07-29 04:45:00.874948789 +0000 UTC m=+2981.470049507"
Jul 29 04:45:01.357534 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:01.357477    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:45:01.855881 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:01.855845    2573 generic.go:356] "Generic (PLEG): container finished" podID="30d4ae30-2014-47e4-b870-a59a4bd6a136" containerID="3d04afb346603ed4f572892ab113b583b6598aca80a774a8cf0603d140f99dc7" exitCode=0
Jul 29 04:45:01.856085 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:01.855923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td" event={"ID":"30d4ae30-2014-47e4-b870-a59a4bd6a136","Type":"ContainerDied","Data":"3d04afb346603ed4f572892ab113b583b6598aca80a774a8cf0603d140f99dc7"}
Jul 29 04:45:01.857376 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:01.857347    2573 generic.go:356] "Generic (PLEG): container finished" podID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerID="e7a04fab6cb0f16cf4af3f234226f089e516cc194a384ef9378d6e91e7acf518" exitCode=7
Jul 29 04:45:01.857515 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:01.857425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4" event={"ID":"da39cb97-d2be-4974-a016-a1e9c51d792d","Type":"ContainerDied","Data":"e7a04fab6cb0f16cf4af3f234226f089e516cc194a384ef9378d6e91e7acf518"}
Jul 29 04:45:01.857576 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:01.857563    2573 scope.go:117] "RemoveContainer" containerID="e7a04fab6cb0f16cf4af3f234226f089e516cc194a384ef9378d6e91e7acf518"
Jul 29 04:45:02.866024 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:02.865926    2573 generic.go:356] "Generic (PLEG): container finished" podID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerID="3322a33437f0b3bfdc2d41ca1a9199cccc9f9fd49cce92575fa7b3970df4259d" exitCode=7
Jul 29 04:45:02.866466 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:02.866012    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4" event={"ID":"da39cb97-d2be-4974-a016-a1e9c51d792d","Type":"ContainerDied","Data":"3322a33437f0b3bfdc2d41ca1a9199cccc9f9fd49cce92575fa7b3970df4259d"}
Jul 29 04:45:02.866466 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:02.866078    2573 scope.go:117] "RemoveContainer" containerID="e7a04fab6cb0f16cf4af3f234226f089e516cc194a384ef9378d6e91e7acf518"
Jul 29 04:45:02.866466 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:02.866138    2573 scope.go:117] "RemoveContainer" containerID="3322a33437f0b3bfdc2d41ca1a9199cccc9f9fd49cce92575fa7b3970df4259d"
Jul 29 04:45:02.866466 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:45:02.866340    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4_odh-ai-gateway-infra(da39cb97-d2be-4974-a016-a1e9c51d792d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d"
Jul 29 04:45:03.045015 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:03.044990    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td"
Jul 29 04:45:03.873906 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:03.873863    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td" event={"ID":"30d4ae30-2014-47e4-b870-a59a4bd6a136","Type":"ContainerDied","Data":"8cc74a9470de131279d612091bce6e0288575a24a4135a15eb077df4599b6395"}
Jul 29 04:45:03.874392 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:03.873931    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cc74a9470de131279d612091bce6e0288575a24a4135a15eb077df4599b6395"
Jul 29 04:45:03.874392 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:03.874024    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-ns4td"
Jul 29 04:45:03.887466 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:03.886869    2573 scope.go:117] "RemoveContainer" containerID="3322a33437f0b3bfdc2d41ca1a9199cccc9f9fd49cce92575fa7b3970df4259d"
Jul 29 04:45:03.887466 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:45:03.887127    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4_odh-ai-gateway-infra(da39cb97-d2be-4974-a016-a1e9c51d792d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d"
Jul 29 04:45:09.918454 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:09.918422    2573 generic.go:356] "Generic (PLEG): container finished" podID="e40431e0-1605-42aa-8f9d-097fafb10375" containerID="b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7" exitCode=0
Jul 29 04:45:09.918887 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:09.918523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" event={"ID":"e40431e0-1605-42aa-8f9d-097fafb10375","Type":"ContainerDied","Data":"b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7"}
Jul 29 04:45:09.918938 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:09.918916    2573 scope.go:117] "RemoveContainer" containerID="b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7"
Jul 29 04:45:09.920028 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:09.919998    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:45:09.920102 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:09.920084    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:45:09.920145 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:09.920136    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:45:10.820829 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:10.820778    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:45:10.925032 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:10.924994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" event={"ID":"e40431e0-1605-42aa-8f9d-097fafb10375","Type":"ContainerStarted","Data":"457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6"}
Jul 29 04:45:10.963946 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:10.963914    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:45:10.964971 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:10.964950    2573 patch_prober.go:28] interesting pod/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 04:45:10.965032 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:10.964997    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 04:45:11.964369 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:11.964331    2573 patch_prober.go:28] interesting pod/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 04:45:11.964824 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:11.964401    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 04:45:12.964252 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:12.964213    2573 patch_prober.go:28] interesting pod/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 04:45:12.964427 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:12.964291    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 04:45:13.964216 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:13.964181    2573 patch_prober.go:28] interesting pod/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 04:45:13.964391 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:13.964232    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 04:45:14.967904 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:14.967874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:45:14.968305 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:14.968151    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:45:14.968820 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:14.968801    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 04:45:17.862291 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:17.862253    2573 scope.go:117] "RemoveContainer" containerID="3322a33437f0b3bfdc2d41ca1a9199cccc9f9fd49cce92575fa7b3970df4259d"
Jul 29 04:45:18.963233 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:18.963146    2573 generic.go:356] "Generic (PLEG): container finished" podID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerID="729272c9ced8c542534c7f0e2aa6f2dfff6161736e4761d117f08448d8295cef" exitCode=0
Jul 29 04:45:18.963233 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:18.963222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4" event={"ID":"da39cb97-d2be-4974-a016-a1e9c51d792d","Type":"ContainerDied","Data":"729272c9ced8c542534c7f0e2aa6f2dfff6161736e4761d117f08448d8295cef"}
Jul 29 04:45:18.963731 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:18.963285    2573 scope.go:117] "RemoveContainer" containerID="3322a33437f0b3bfdc2d41ca1a9199cccc9f9fd49cce92575fa7b3970df4259d"
Jul 29 04:45:19.992191 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:19.992162    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"]
Jul 29 04:45:20.109053 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:20.109032    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"
Jul 29 04:45:20.974306 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:20.974276    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"
Jul 29 04:45:20.974306 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:20.974300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4" event={"ID":"da39cb97-d2be-4974-a016-a1e9c51d792d","Type":"ContainerDied","Data":"e9bb9b84fb358c473b88a7e513a3edb343319660aedd1162f2cabdc383592e11"}
Jul 29 04:45:20.974602 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:20.974345    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9bb9b84fb358c473b88a7e513a3edb343319660aedd1162f2cabdc383592e11"
Jul 29 04:45:21.003424 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.003393    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"]
Jul 29 04:45:21.008928 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.008903    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b70f7c-29755005-7hmr4"]
Jul 29 04:45:21.286179 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286150    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"]
Jul 29 04:45:21.286611 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286596    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerName="cleanup"
Jul 29 04:45:21.286673 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286614    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerName="cleanup"
Jul 29 04:45:21.286673 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286642    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d4ae30-2014-47e4-b870-a59a4bd6a136" containerName="cleanup"
Jul 29 04:45:21.286673 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286651    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d4ae30-2014-47e4-b870-a59a4bd6a136" containerName="cleanup"
Jul 29 04:45:21.286673 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286671    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerName="cleanup"
Jul 29 04:45:21.286810 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286680    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerName="cleanup"
Jul 29 04:45:21.286810 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286750    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="30d4ae30-2014-47e4-b870-a59a4bd6a136" containerName="cleanup"
Jul 29 04:45:21.286810 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286765    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerName="cleanup"
Jul 29 04:45:21.286810 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286773    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerName="cleanup"
Jul 29 04:45:21.286810 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.286780    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerName="cleanup"
Jul 29 04:45:21.289969 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.289950    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.292756 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.292736    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b550f6-openshift-default-dockercfg-4vs8v\""
Jul 29 04:45:21.299085 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.299061    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"]
Jul 29 04:45:21.403704 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.403662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-token\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.403704 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.403710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-data\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.403960 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.403737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-credential-socket\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.403960 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.403756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-certs\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.403960 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.403780    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-envoy\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.403960 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.403793    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-podinfo\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.403960 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.403893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-socket\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.403960 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.403933    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmxtv\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-kube-api-access-xmxtv\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.404195 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.403970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istiod-ca-cert\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.504483 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.504448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-envoy\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.504727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.504517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-podinfo\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.504727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.504573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-socket\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.504727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.504601    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmxtv\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-kube-api-access-xmxtv\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.504727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.504647    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istiod-ca-cert\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.504727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.504715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-token\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.505012 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.504754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-data\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.505012 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.504798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-credential-socket\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.505012 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.504828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-certs\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.505231 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.505206    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-certs\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.505579 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.505530    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-data\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.505697 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.505615    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istiod-ca-cert\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.505840 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.505697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-credential-socket\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.505840 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.505846    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-socket\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.507557 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.507537    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-envoy\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.507847 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.507816    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-podinfo\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.512178 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.512151    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-token\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.512327 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.512310    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmxtv\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-kube-api-access-xmxtv\") pod \"e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") " pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.601890 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.601802    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:21.761644 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.761618    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"]
Jul 29 04:45:21.763399 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:45:21.763371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6d8955_f4c9_4631_a80a_6367a0ec9523.slice/crio-18f8e870a288ea660fa6dad5e600304d3c47dccb879f4c50881183f8d8b54187 WatchSource:0}: Error finding container 18f8e870a288ea660fa6dad5e600304d3c47dccb879f4c50881183f8d8b54187: Status 404 returned error can't find the container with id 18f8e870a288ea660fa6dad5e600304d3c47dccb879f4c50881183f8d8b54187
Jul 29 04:45:21.765572 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.765538    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:45:21.765666 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.765603    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:45:21.765666 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.765633    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:45:21.867938 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.867854    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" path="/var/lib/kubelet/pods/da39cb97-d2be-4974-a016-a1e9c51d792d/volumes"
Jul 29 04:45:21.981111 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.981070    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" event={"ID":"8b6d8955-f4c9-4631-a80a-6367a0ec9523","Type":"ContainerStarted","Data":"481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa"}
Jul 29 04:45:21.981308 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:21.981136    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" event={"ID":"8b6d8955-f4c9-4631-a80a-6367a0ec9523","Type":"ContainerStarted","Data":"18f8e870a288ea660fa6dad5e600304d3c47dccb879f4c50881183f8d8b54187"}
Jul 29 04:45:22.001305 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:22.001245    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" podStartSLOduration=1.001214327 podStartE2EDuration="1.001214327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:45:21.999424159 +0000 UTC m=+3002.594524902" watchObservedRunningTime="2026-07-29 04:45:22.001214327 +0000 UTC m=+3002.596315046"
Jul 29 04:45:22.602577 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:22.602531    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:22.607181 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:22.607156    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:22.985808 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:22.985721    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:22.987224 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:22.987201    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:31.460285 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:31.460255    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:45:39.026685 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:39.026636    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 04:45:39.027193 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:39.026731    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 04:45:40.065027 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:40.064992    2573 generic.go:356] "Generic (PLEG): container finished" podID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerID="481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa" exitCode=0
Jul 29 04:45:40.065477 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:40.065070    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" event={"ID":"8b6d8955-f4c9-4631-a80a-6367a0ec9523","Type":"ContainerDied","Data":"481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa"}
Jul 29 04:45:40.065477 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:40.065462    2573 scope.go:117] "RemoveContainer" containerID="481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa"
Jul 29 04:45:40.066626 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:40.066595    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:45:40.066735 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:40.066680    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:45:40.066735 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:40.066727    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:45:41.073093 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:41.073049    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" event={"ID":"8b6d8955-f4c9-4631-a80a-6367a0ec9523","Type":"ContainerStarted","Data":"d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15"}
Jul 29 04:45:41.602699 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:41.602667    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:41.602935 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:41.602913    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 29 04:45:41.602992 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:41.602964    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 29 04:45:42.603154 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:42.603116    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 29 04:45:42.603597 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:42.603189    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 29 04:45:43.602423 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:43.602380    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 29 04:45:43.602658 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:43.602443    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 29 04:45:44.602615 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:44.602576    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 29 04:45:44.603017 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:44.602648    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 29 04:45:45.606280 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:45.606248    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:45.606702 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:45.606615    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:45:45.607452 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:45:45.607433    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 04:46:06.953064 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:06.953032    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:46:34.437178 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.437144    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"]
Jul 29 04:46:34.437625 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.437450    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerName="cleanup"
Jul 29 04:46:34.437625 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.437460    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da39cb97-d2be-4974-a016-a1e9c51d792d" containerName="cleanup"
Jul 29 04:46:34.440479 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.440458    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.443190 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.443162    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b550f6\"/\"kube-root-ca.crt\""
Jul 29 04:46:34.443190 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.443176    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b550f6\"/\"openshift-service-ca.crt\""
Jul 29 04:46:34.443364 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.443227    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b550f6\"/\"default-dockercfg-95cjw\""
Jul 29 04:46:34.444286 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.444270    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b550f6\"/\"auth-test-model-b550f6-kserve-self-signed-certs\""
Jul 29 04:46:34.447792 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.447768    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"]
Jul 29 04:46:34.560461 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.560428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-home\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.560461 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.560460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-model-cache\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.560703 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.560486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60aa963f-04a3-4276-a7f9-fc730a75a925-tls-certs\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.560703 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.560563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndk44\" (UniqueName: \"kubernetes.io/projected/60aa963f-04a3-4276-a7f9-fc730a75a925-kube-api-access-ndk44\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.560703 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.560597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-tmp-dir\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.560703 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.560634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-dshm\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.661764 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.661726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndk44\" (UniqueName: \"kubernetes.io/projected/60aa963f-04a3-4276-a7f9-fc730a75a925-kube-api-access-ndk44\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.661930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.661773    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-tmp-dir\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.661930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.661810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-dshm\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.661930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.661844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-home\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.661930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.661859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-model-cache\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.661930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.661882    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60aa963f-04a3-4276-a7f9-fc730a75a925-tls-certs\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.662297 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.662275    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-home\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.662369 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.662323    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-model-cache\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.662420 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.662372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-tmp-dir\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.664342 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.664322    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-dshm\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.664614 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.664596    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60aa963f-04a3-4276-a7f9-fc730a75a925-tls-certs\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.669521 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.669474    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndk44\" (UniqueName: \"kubernetes.io/projected/60aa963f-04a3-4276-a7f9-fc730a75a925-kube-api-access-ndk44\") pod \"auth-test-model-b550f6-kserve-64b4d6d855-qkq9j\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") " pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.751340 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.751252    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:34.878975 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:34.878952    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"]
Jul 29 04:46:34.881136 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:46:34.881105    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60aa963f_04a3_4276_a7f9_fc730a75a925.slice/crio-1570e284214502e6d4dc43600204009aaefb6674f8e5c017c95294b365ca0a6e WatchSource:0}: Error finding container 1570e284214502e6d4dc43600204009aaefb6674f8e5c017c95294b365ca0a6e: Status 404 returned error can't find the container with id 1570e284214502e6d4dc43600204009aaefb6674f8e5c017c95294b365ca0a6e
Jul 29 04:46:35.326791 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:35.326757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j" event={"ID":"60aa963f-04a3-4276-a7f9-fc730a75a925","Type":"ContainerStarted","Data":"3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9"}
Jul 29 04:46:35.326791 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:35.326799    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j" event={"ID":"60aa963f-04a3-4276-a7f9-fc730a75a925","Type":"ContainerStarted","Data":"1570e284214502e6d4dc43600204009aaefb6674f8e5c017c95294b365ca0a6e"}
Jul 29 04:46:35.345438 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:35.345389    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j" podStartSLOduration=1.34537431 podStartE2EDuration="1.34537431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:46:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:46:35.343355098 +0000 UTC m=+3075.938455814" watchObservedRunningTime="2026-07-29 04:46:35.34537431 +0000 UTC m=+3075.940475027"
Jul 29 04:46:37.757642 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:37.757605    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:46:44.751776 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:44.751723    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:44.751776 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:44.751789    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:44.764321 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:44.764299    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:46:45.386102 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:46:45.386074    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:47:10.063553 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:47:10.063519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:47:36.553369 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:47:36.553333    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:47:53.156440 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:47:53.156349    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:48:05.163472 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:48:05.163434    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:48:30.260647 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:48:30.260616    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:48:47.557017 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:48:47.556976    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:49:14.160867 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:49:14.160781    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:49:20.087437 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:49:20.087399    2573 scope.go:117] "RemoveContainer" containerID="7580269aafce798e12b3b9cbf8a3128cfb7cf3e247950608a65ab76bb344c49b"
Jul 29 04:49:30.953692 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:49:30.953656    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:49:56.355413 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:49:56.355375    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:50:15.957106 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:50:15.957071    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:50:20.106882 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:50:20.106846    2573 scope.go:117] "RemoveContainer" containerID="b3564bf3474e2c588d21a9856e0911137d173a4f63837abd1e902a799f694ccb"
Jul 29 04:50:42.357911 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:50:42.357826    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:50:59.859787 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:50:59.859752    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:51:20.126241 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:20.126206    2573 scope.go:117] "RemoveContainer" containerID="729272c9ced8c542534c7f0e2aa6f2dfff6161736e4761d117f08448d8295cef"
Jul 29 04:51:26.258026 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:26.257986    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:51:30.337257 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:30.337224    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"]
Jul 29 04:51:42.255920 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:42.255885    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:51:45.356796 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.356755    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j" podUID="60aa963f-04a3-4276-a7f9-fc730a75a925" containerName="main" containerID="cri-o://3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9" gracePeriod=45
Jul 29 04:51:45.375582 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.375548    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j" podUID="60aa963f-04a3-4276-a7f9-fc730a75a925" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": dial tcp 10.133.0.50:8000: connect: connection refused"
Jul 29 04:51:45.611963 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.611904    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:51:45.718017 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.717971    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60aa963f-04a3-4276-a7f9-fc730a75a925-tls-certs\") pod \"60aa963f-04a3-4276-a7f9-fc730a75a925\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") "
Jul 29 04:51:45.718176 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.718061    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-model-cache\") pod \"60aa963f-04a3-4276-a7f9-fc730a75a925\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") "
Jul 29 04:51:45.718176 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.718083    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-home\") pod \"60aa963f-04a3-4276-a7f9-fc730a75a925\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") "
Jul 29 04:51:45.718176 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.718103    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndk44\" (UniqueName: \"kubernetes.io/projected/60aa963f-04a3-4276-a7f9-fc730a75a925-kube-api-access-ndk44\") pod \"60aa963f-04a3-4276-a7f9-fc730a75a925\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") "
Jul 29 04:51:45.718176 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.718154    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-dshm\") pod \"60aa963f-04a3-4276-a7f9-fc730a75a925\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") "
Jul 29 04:51:45.718393 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.718184    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-tmp-dir\") pod \"60aa963f-04a3-4276-a7f9-fc730a75a925\" (UID: \"60aa963f-04a3-4276-a7f9-fc730a75a925\") "
Jul 29 04:51:45.718393 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.718330    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-model-cache" (OuterVolumeSpecName: "model-cache") pod "60aa963f-04a3-4276-a7f9-fc730a75a925" (UID: "60aa963f-04a3-4276-a7f9-fc730a75a925"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:45.718538 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.718434    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-home" (OuterVolumeSpecName: "home") pod "60aa963f-04a3-4276-a7f9-fc730a75a925" (UID: "60aa963f-04a3-4276-a7f9-fc730a75a925"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:45.718538 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.718468    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60aa963f-04a3-4276-a7f9-fc730a75a925" (UID: "60aa963f-04a3-4276-a7f9-fc730a75a925"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:45.718538 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.718476    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-model-cache\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:51:45.720454 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.720420    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60aa963f-04a3-4276-a7f9-fc730a75a925-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60aa963f-04a3-4276-a7f9-fc730a75a925" (UID: "60aa963f-04a3-4276-a7f9-fc730a75a925"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:51:45.720567 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.720537    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60aa963f-04a3-4276-a7f9-fc730a75a925-kube-api-access-ndk44" (OuterVolumeSpecName: "kube-api-access-ndk44") pod "60aa963f-04a3-4276-a7f9-fc730a75a925" (UID: "60aa963f-04a3-4276-a7f9-fc730a75a925"). InnerVolumeSpecName "kube-api-access-ndk44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:51:45.720611 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.720572    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-dshm" (OuterVolumeSpecName: "dshm") pod "60aa963f-04a3-4276-a7f9-fc730a75a925" (UID: "60aa963f-04a3-4276-a7f9-fc730a75a925"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:45.775910 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.775881    2573 generic.go:356] "Generic (PLEG): container finished" podID="60aa963f-04a3-4276-a7f9-fc730a75a925" containerID="3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9" exitCode=0
Jul 29 04:51:45.776076 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.775927    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"
Jul 29 04:51:45.776076 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.775931    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j" event={"ID":"60aa963f-04a3-4276-a7f9-fc730a75a925","Type":"ContainerDied","Data":"3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9"}
Jul 29 04:51:45.776076 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.776046    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j" event={"ID":"60aa963f-04a3-4276-a7f9-fc730a75a925","Type":"ContainerDied","Data":"1570e284214502e6d4dc43600204009aaefb6674f8e5c017c95294b365ca0a6e"}
Jul 29 04:51:45.776076 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.776064    2573 scope.go:117] "RemoveContainer" containerID="3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9"
Jul 29 04:51:45.784911 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.784894    2573 scope.go:117] "RemoveContainer" containerID="3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9"
Jul 29 04:51:45.785195 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:51:45.785176    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9\": container with ID starting with 3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9 not found: ID does not exist" containerID="3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9"
Jul 29 04:51:45.785264 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.785203    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9"} err="failed to get container status \"3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9\": rpc error: code = NotFound desc = could not find container \"3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9\": container with ID starting with 3d4e5527913b03d5e5a9d4424e4414ff2698d1ccee6c88f16551c5f58c62c7e9 not found: ID does not exist"
Jul 29 04:51:45.796369 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.796339    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"]
Jul 29 04:51:45.799968 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.799947    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/auth-test-model-b550f6-kserve-64b4d6d855-qkq9j"]
Jul 29 04:51:45.819631 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.819610    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-home\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:51:45.819700 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.819632    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndk44\" (UniqueName: \"kubernetes.io/projected/60aa963f-04a3-4276-a7f9-fc730a75a925-kube-api-access-ndk44\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:51:45.819700 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.819644    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-dshm\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:51:45.819700 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.819653    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60aa963f-04a3-4276-a7f9-fc730a75a925-tmp-dir\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:51:45.819700 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.819671    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60aa963f-04a3-4276-a7f9-fc730a75a925-tls-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:51:45.867172 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:51:45.867100    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60aa963f-04a3-4276-a7f9-fc730a75a925" path="/var/lib/kubelet/pods/60aa963f-04a3-4276-a7f9-fc730a75a925/volumes"
Jul 29 04:52:03.429966 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.429929    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"]
Jul 29 04:52:03.430420 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.430403    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60aa963f-04a3-4276-a7f9-fc730a75a925" containerName="main"
Jul 29 04:52:03.430475 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.430424    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60aa963f-04a3-4276-a7f9-fc730a75a925" containerName="main"
Jul 29 04:52:03.430550 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.430520    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="60aa963f-04a3-4276-a7f9-fc730a75a925" containerName="main"
Jul 29 04:52:03.433764 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.433744    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.437615 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.437594    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b70f7c\"/\"openshift-service-ca.crt\""
Jul 29 04:52:03.437615 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.437613    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b70f7c\"/\"kube-root-ca.crt\""
Jul 29 04:52:03.437851 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.437687    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b70f7c\"/\"sub-test-model-b70f7c-kserve-self-signed-certs\""
Jul 29 04:52:03.437851 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.437698    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b70f7c\"/\"default-dockercfg-4rfcc\""
Jul 29 04:52:03.442481 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.442458    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"]
Jul 29 04:52:03.575271 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.575239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tls-certs\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.575482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.575294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tmp-dir\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.575482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.575311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-dshm\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.575482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.575374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhm8c\" (UniqueName: \"kubernetes.io/projected/39e1367a-a79f-4dfb-b9d9-b288a9b20506-kube-api-access-hhm8c\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.575482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.575448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-home\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.575737 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.575543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-model-cache\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.676270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.676230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tmp-dir\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.676270 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.676273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-dshm\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.676581 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.676298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhm8c\" (UniqueName: \"kubernetes.io/projected/39e1367a-a79f-4dfb-b9d9-b288a9b20506-kube-api-access-hhm8c\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.676581 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.676341    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-home\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.676581 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.676392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-model-cache\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.676581 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.676447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tls-certs\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.676812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.676713    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tmp-dir\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.676812 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.676745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-home\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.676925 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.676820    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-model-cache\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.678676 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.678655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-dshm\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.679132 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.679110    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tls-certs\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.684198 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.684134    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhm8c\" (UniqueName: \"kubernetes.io/projected/39e1367a-a79f-4dfb-b9d9-b288a9b20506-kube-api-access-hhm8c\") pod \"sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") " pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.743824 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.743791    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:03.879386 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:03.879359    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"]
Jul 29 04:52:03.881750 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:52:03.881711    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39e1367a_a79f_4dfb_b9d9_b288a9b20506.slice/crio-c12d7a8b404d11d236bf20958f9c2f1d33c88e31d651e34fd92e91e25112048b WatchSource:0}: Error finding container c12d7a8b404d11d236bf20958f9c2f1d33c88e31d651e34fd92e91e25112048b: Status 404 returned error can't find the container with id c12d7a8b404d11d236bf20958f9c2f1d33c88e31d651e34fd92e91e25112048b
Jul 29 04:52:04.865121 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:04.865085    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb" event={"ID":"39e1367a-a79f-4dfb-b9d9-b288a9b20506","Type":"ContainerStarted","Data":"b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b"}
Jul 29 04:52:04.865526 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:04.865129    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb" event={"ID":"39e1367a-a79f-4dfb-b9d9-b288a9b20506","Type":"ContainerStarted","Data":"c12d7a8b404d11d236bf20958f9c2f1d33c88e31d651e34fd92e91e25112048b"}
Jul 29 04:52:04.883685 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:04.883633    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb" podStartSLOduration=1.883618626 podStartE2EDuration="1.883618626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:52:04.882314286 +0000 UTC m=+3405.477415004" watchObservedRunningTime="2026-07-29 04:52:04.883618626 +0000 UTC m=+3405.478719321"
Jul 29 04:52:06.856390 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:06.856355    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:52:13.744599 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:13.744507    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:13.744599 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:13.744553    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:13.757216 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:13.757192    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:13.914840 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:13.914812    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:52:47.757643 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:52:47.757607    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:53:35.859024 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:53:35.858986    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:53:57.261798 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:53:57.261699    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:54:20.261379 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:20.261343    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:54:26.076535 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:26.076502    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"]
Jul 29 04:54:38.860264 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:38.860229    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:54:41.095856 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.095786    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb" podUID="39e1367a-a79f-4dfb-b9d9-b288a9b20506" containerName="main" containerID="cri-o://b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b" gracePeriod=45
Jul 29 04:54:41.346317 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.346252    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:54:41.458090 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458058    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tls-certs\") pod \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") "
Jul 29 04:54:41.458301 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458116    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhm8c\" (UniqueName: \"kubernetes.io/projected/39e1367a-a79f-4dfb-b9d9-b288a9b20506-kube-api-access-hhm8c\") pod \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") "
Jul 29 04:54:41.458301 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458181    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-model-cache\") pod \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") "
Jul 29 04:54:41.458301 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458220    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tmp-dir\") pod \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") "
Jul 29 04:54:41.458301 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458248    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-dshm\") pod \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") "
Jul 29 04:54:41.458548 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458307    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-home\") pod \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\" (UID: \"39e1367a-a79f-4dfb-b9d9-b288a9b20506\") "
Jul 29 04:54:41.458548 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458468    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "39e1367a-a79f-4dfb-b9d9-b288a9b20506" (UID: "39e1367a-a79f-4dfb-b9d9-b288a9b20506"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:54:41.458548 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458534    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-model-cache" (OuterVolumeSpecName: "model-cache") pod "39e1367a-a79f-4dfb-b9d9-b288a9b20506" (UID: "39e1367a-a79f-4dfb-b9d9-b288a9b20506"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:54:41.458724 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458645    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-model-cache\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:54:41.458783 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458725    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-home" (OuterVolumeSpecName: "home") pod "39e1367a-a79f-4dfb-b9d9-b288a9b20506" (UID: "39e1367a-a79f-4dfb-b9d9-b288a9b20506"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:54:41.458783 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.458733    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tmp-dir\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:54:41.460790 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.460764    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-dshm" (OuterVolumeSpecName: "dshm") pod "39e1367a-a79f-4dfb-b9d9-b288a9b20506" (UID: "39e1367a-a79f-4dfb-b9d9-b288a9b20506"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:54:41.461044 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.461021    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "39e1367a-a79f-4dfb-b9d9-b288a9b20506" (UID: "39e1367a-a79f-4dfb-b9d9-b288a9b20506"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:54:41.461044 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.461033    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39e1367a-a79f-4dfb-b9d9-b288a9b20506-kube-api-access-hhm8c" (OuterVolumeSpecName: "kube-api-access-hhm8c") pod "39e1367a-a79f-4dfb-b9d9-b288a9b20506" (UID: "39e1367a-a79f-4dfb-b9d9-b288a9b20506"). InnerVolumeSpecName "kube-api-access-hhm8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:54:41.560118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.560078    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39e1367a-a79f-4dfb-b9d9-b288a9b20506-tls-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:54:41.560118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.560111    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhm8c\" (UniqueName: \"kubernetes.io/projected/39e1367a-a79f-4dfb-b9d9-b288a9b20506-kube-api-access-hhm8c\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:54:41.560118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.560121    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-dshm\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:54:41.560118 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.560130    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39e1367a-a79f-4dfb-b9d9-b288a9b20506-home\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:54:41.587150 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.587118    2573 generic.go:356] "Generic (PLEG): container finished" podID="39e1367a-a79f-4dfb-b9d9-b288a9b20506" containerID="b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b" exitCode=0
Jul 29 04:54:41.587313 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.587157    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"
Jul 29 04:54:41.587313 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.587187    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb" event={"ID":"39e1367a-a79f-4dfb-b9d9-b288a9b20506","Type":"ContainerDied","Data":"b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b"}
Jul 29 04:54:41.587313 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.587224    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb" event={"ID":"39e1367a-a79f-4dfb-b9d9-b288a9b20506","Type":"ContainerDied","Data":"c12d7a8b404d11d236bf20958f9c2f1d33c88e31d651e34fd92e91e25112048b"}
Jul 29 04:54:41.587313 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.587241    2573 scope.go:117] "RemoveContainer" containerID="b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b"
Jul 29 04:54:41.597027 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.597015    2573 scope.go:117] "RemoveContainer" containerID="b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b"
Jul 29 04:54:41.597301 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:54:41.597280    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b\": container with ID starting with b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b not found: ID does not exist" containerID="b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b"
Jul 29 04:54:41.597370 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.597315    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b"} err="failed to get container status \"b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b\": rpc error: code = NotFound desc = could not find container \"b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b\": container with ID starting with b40820b6e93cfae94441270f2189679b9664da4e983a30ad0f8e74015264743b not found: ID does not exist"
Jul 29 04:54:41.608415 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.608359    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"]
Jul 29 04:54:41.610115 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.610092    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b70f7c/sub-test-model-b70f7c-kserve-7cbf97dc45-4jntb"]
Jul 29 04:54:41.868664 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:41.868584    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39e1367a-a79f-4dfb-b9d9-b288a9b20506" path="/var/lib/kubelet/pods/39e1367a-a79f-4dfb-b9d9-b288a9b20506/volumes"
Jul 29 04:54:54.628718 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.628679    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"]
Jul 29 04:54:54.629266 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.629137    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39e1367a-a79f-4dfb-b9d9-b288a9b20506" containerName="main"
Jul 29 04:54:54.629266 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.629154    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="39e1367a-a79f-4dfb-b9d9-b288a9b20506" containerName="main"
Jul 29 04:54:54.629266 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.629259    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="39e1367a-a79f-4dfb-b9d9-b288a9b20506" containerName="main"
Jul 29 04:54:54.633409 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.633394    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.636358 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.636334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b550f6\"/\"default-dockercfg-95cjw\""
Jul 29 04:54:54.636482 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.636370    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b550f6\"/\"openshift-service-ca.crt\""
Jul 29 04:54:54.641829 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.641810    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b550f6\"/\"kube-root-ca.crt\""
Jul 29 04:54:54.645617 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.645596    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"]
Jul 29 04:54:54.649572 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.649553    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b550f6\"/\"rate-test-model-b550f6-kserve-self-signed-certs\""
Jul 29 04:54:54.668221 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.668194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-model-cache\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.668331 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.668227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-home\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.668331 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.668257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tmp-dir\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.668451 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.668374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-dshm\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.668451 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.668422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zs4t\" (UniqueName: \"kubernetes.io/projected/63eb239a-7990-4aed-af1e-5d4ddbe050fb-kube-api-access-9zs4t\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.668581 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.668566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tls-certs\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.769618 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.769585    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tls-certs\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.769832 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.769635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-model-cache\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.769832 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.769670    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-home\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.769832 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.769698    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tmp-dir\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.769832 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.769767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-dshm\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.769832 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.769799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zs4t\" (UniqueName: \"kubernetes.io/projected/63eb239a-7990-4aed-af1e-5d4ddbe050fb-kube-api-access-9zs4t\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.770139 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.770115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-model-cache\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.770205 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.770148    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-home\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.770205 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.770183    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tmp-dir\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.772134 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.772109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-dshm\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.772407 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.772389    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tls-certs\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.787740 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.787716    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zs4t\" (UniqueName: \"kubernetes.io/projected/63eb239a-7990-4aed-af1e-5d4ddbe050fb-kube-api-access-9zs4t\") pod \"rate-test-model-b550f6-kserve-58b469ccf5-zzxl2\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") " pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:54.942930 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:54.942834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:54:55.076162 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:55.076134    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"]
Jul 29 04:54:55.081197 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:54:55.078613    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63eb239a_7990_4aed_af1e_5d4ddbe050fb.slice/crio-121ee32769b3dd13e060c0059db36262829a15f5725bdeefc497b4cc047c565f WatchSource:0}: Error finding container 121ee32769b3dd13e060c0059db36262829a15f5725bdeefc497b4cc047c565f: Status 404 returned error can't find the container with id 121ee32769b3dd13e060c0059db36262829a15f5725bdeefc497b4cc047c565f
Jul 29 04:54:55.654105 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:55.654068    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2" event={"ID":"63eb239a-7990-4aed-af1e-5d4ddbe050fb","Type":"ContainerStarted","Data":"1f20d32b04a1214817952059de4eb7d1f26ad0982bb8ed3f21fcf6e9e9a28d61"}
Jul 29 04:54:55.654105 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:55.654113    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2" event={"ID":"63eb239a-7990-4aed-af1e-5d4ddbe050fb","Type":"ContainerStarted","Data":"121ee32769b3dd13e060c0059db36262829a15f5725bdeefc497b4cc047c565f"}
Jul 29 04:54:55.671859 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:55.671809    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2" podStartSLOduration=1.6717939309999998 podStartE2EDuration="1.671793931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:54:55.6704399 +0000 UTC m=+3576.265540619" watchObservedRunningTime="2026-07-29 04:54:55.671793931 +0000 UTC m=+3576.266894648"
Jul 29 04:54:58.552976 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:54:58.552928    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:55:04.943283 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:55:04.943244    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:55:04.943785 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:55:04.943302    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:55:04.956295 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:55:04.956270    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:55:05.713105 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:55:05.713070    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:55:45.471835 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:55:45.471795    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:56:06.177015 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:06.176977    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:56:29.056646 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:29.056608    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:56:37.046523 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:37.046451    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"]
Jul 29 04:56:38.025967 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.025932    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7677-140502348829872"]
Jul 29 04:56:38.028850 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.028834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348829872"
Jul 29 04:56:38.037292 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.037270    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k8w2g\""
Jul 29 04:56:38.052128 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.052100    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7677-140502348829872"]
Jul 29 04:56:38.080654 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.080626    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4bd5\" (UniqueName: \"kubernetes.io/projected/c7a0192e-c539-468d-ad48-3c449fbaadc1-kube-api-access-k4bd5\") pod \"test-curl-7677-140502348829872\" (UID: \"c7a0192e-c539-468d-ad48-3c449fbaadc1\") " pod="opendatahub/test-curl-7677-140502348829872"
Jul 29 04:56:38.181272 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.181243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4bd5\" (UniqueName: \"kubernetes.io/projected/c7a0192e-c539-468d-ad48-3c449fbaadc1-kube-api-access-k4bd5\") pod \"test-curl-7677-140502348829872\" (UID: \"c7a0192e-c539-468d-ad48-3c449fbaadc1\") " pod="opendatahub/test-curl-7677-140502348829872"
Jul 29 04:56:38.192506 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.192463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4bd5\" (UniqueName: \"kubernetes.io/projected/c7a0192e-c539-468d-ad48-3c449fbaadc1-kube-api-access-k4bd5\") pod \"test-curl-7677-140502348829872\" (UID: \"c7a0192e-c539-468d-ad48-3c449fbaadc1\") " pod="opendatahub/test-curl-7677-140502348829872"
Jul 29 04:56:38.338419 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.338327    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348829872"
Jul 29 04:56:38.476875 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.476833    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7677-140502348829872"]
Jul 29 04:56:38.481433 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:56:38.481395    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7a0192e_c539_468d_ad48_3c449fbaadc1.slice/crio-6c00b5a6d9ead24f8baadc0951ca2e85631398ce85abd6d2ec142cdb554a0fd6 WatchSource:0}: Error finding container 6c00b5a6d9ead24f8baadc0951ca2e85631398ce85abd6d2ec142cdb554a0fd6: Status 404 returned error can't find the container with id 6c00b5a6d9ead24f8baadc0951ca2e85631398ce85abd6d2ec142cdb554a0fd6
Jul 29 04:56:38.482995 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:38.482980    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:56:39.118885 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:39.118838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7677-140502348829872" event={"ID":"c7a0192e-c539-468d-ad48-3c449fbaadc1","Type":"ContainerStarted","Data":"6c00b5a6d9ead24f8baadc0951ca2e85631398ce85abd6d2ec142cdb554a0fd6"}
Jul 29 04:56:40.125340 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:40.125302    2573 generic.go:356] "Generic (PLEG): container finished" podID="c7a0192e-c539-468d-ad48-3c449fbaadc1" containerID="e0eee717e8779c5f70ab250cf8bd14ca8abce60749bea86e51bb3ac6587b4ac4" exitCode=0
Jul 29 04:56:40.125971 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:40.125411    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7677-140502348829872" event={"ID":"c7a0192e-c539-468d-ad48-3c449fbaadc1","Type":"ContainerDied","Data":"e0eee717e8779c5f70ab250cf8bd14ca8abce60749bea86e51bb3ac6587b4ac4"}
Jul 29 04:56:41.268608 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.268581    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348829872"
Jul 29 04:56:41.311177 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.311149    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4bd5\" (UniqueName: \"kubernetes.io/projected/c7a0192e-c539-468d-ad48-3c449fbaadc1-kube-api-access-k4bd5\") pod \"c7a0192e-c539-468d-ad48-3c449fbaadc1\" (UID: \"c7a0192e-c539-468d-ad48-3c449fbaadc1\") "
Jul 29 04:56:41.313313 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.313284    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a0192e-c539-468d-ad48-3c449fbaadc1-kube-api-access-k4bd5" (OuterVolumeSpecName: "kube-api-access-k4bd5") pod "c7a0192e-c539-468d-ad48-3c449fbaadc1" (UID: "c7a0192e-c539-468d-ad48-3c449fbaadc1"). InnerVolumeSpecName "kube-api-access-k4bd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:56:41.326083 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.326060    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7677-140502348829872_c7a0192e-c539-468d-ad48-3c449fbaadc1/test-curl-7677-140502348829872/0.log"
Jul 29 04:56:41.360439 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.360406    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7677-140502348829872"]
Jul 29 04:56:41.370652 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.370622    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7677-140502348829872"]
Jul 29 04:56:41.411916 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.411842    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4bd5\" (UniqueName: \"kubernetes.io/projected/c7a0192e-c539-468d-ad48-3c449fbaadc1-kube-api-access-k4bd5\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:56:41.514647 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.514611    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7677-140502348829104"]
Jul 29 04:56:41.515029 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.515011    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a0192e-c539-468d-ad48-3c449fbaadc1" containerName="test-curl-7677-140502348829872"
Jul 29 04:56:41.515121 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.515032    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a0192e-c539-468d-ad48-3c449fbaadc1" containerName="test-curl-7677-140502348829872"
Jul 29 04:56:41.515121 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.515109    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a0192e-c539-468d-ad48-3c449fbaadc1" containerName="test-curl-7677-140502348829872"
Jul 29 04:56:41.518069 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.518046    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348829104"
Jul 29 04:56:41.535358 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.535332    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7677-140502348829104"]
Jul 29 04:56:41.613733 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.613702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpqhb\" (UniqueName: \"kubernetes.io/projected/72973172-a14f-450d-b924-79714e70141f-kube-api-access-kpqhb\") pod \"test-curl-7677-140502348829104\" (UID: \"72973172-a14f-450d-b924-79714e70141f\") " pod="opendatahub/test-curl-7677-140502348829104"
Jul 29 04:56:41.714621 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.714538    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpqhb\" (UniqueName: \"kubernetes.io/projected/72973172-a14f-450d-b924-79714e70141f-kube-api-access-kpqhb\") pod \"test-curl-7677-140502348829104\" (UID: \"72973172-a14f-450d-b924-79714e70141f\") " pod="opendatahub/test-curl-7677-140502348829104"
Jul 29 04:56:41.726221 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.726196    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpqhb\" (UniqueName: \"kubernetes.io/projected/72973172-a14f-450d-b924-79714e70141f-kube-api-access-kpqhb\") pod \"test-curl-7677-140502348829104\" (UID: \"72973172-a14f-450d-b924-79714e70141f\") " pod="opendatahub/test-curl-7677-140502348829104"
Jul 29 04:56:41.827265 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.827233    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348829104"
Jul 29 04:56:41.867560 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.867522    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7a0192e-c539-468d-ad48-3c449fbaadc1" path="/var/lib/kubelet/pods/c7a0192e-c539-468d-ad48-3c449fbaadc1/volumes"
Jul 29 04:56:41.973579 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:41.973479    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7677-140502348829104"]
Jul 29 04:56:41.976357 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:56:41.976319    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72973172_a14f_450d_b924_79714e70141f.slice/crio-7b105e3ec90b7d6b34c4f8c672c8bd82fc4654cbe996ab99873b7eac05601c4b WatchSource:0}: Error finding container 7b105e3ec90b7d6b34c4f8c672c8bd82fc4654cbe996ab99873b7eac05601c4b: Status 404 returned error can't find the container with id 7b105e3ec90b7d6b34c4f8c672c8bd82fc4654cbe996ab99873b7eac05601c4b
Jul 29 04:56:42.020996 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:42.020970    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:56:42.135551 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:42.135519    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348829872"
Jul 29 04:56:42.135750 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:42.135554    2573 scope.go:117] "RemoveContainer" containerID="e0eee717e8779c5f70ab250cf8bd14ca8abce60749bea86e51bb3ac6587b4ac4"
Jul 29 04:56:42.136949 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:42.136818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7677-140502348829104" event={"ID":"72973172-a14f-450d-b924-79714e70141f","Type":"ContainerStarted","Data":"7b105e3ec90b7d6b34c4f8c672c8bd82fc4654cbe996ab99873b7eac05601c4b"}
Jul 29 04:56:43.144559 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:43.144525    2573 generic.go:356] "Generic (PLEG): container finished" podID="72973172-a14f-450d-b924-79714e70141f" containerID="62a365b7b167c2d542ca85368aa6cbebd6cb8f504cc34d949bf762a7dc3f060e" exitCode=0
Jul 29 04:56:43.145042 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:43.144581    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7677-140502348829104" event={"ID":"72973172-a14f-450d-b924-79714e70141f","Type":"ContainerDied","Data":"62a365b7b167c2d542ca85368aa6cbebd6cb8f504cc34d949bf762a7dc3f060e"}
Jul 29 04:56:44.281826 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:44.281802    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348829104"
Jul 29 04:56:44.336525 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:44.336471    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpqhb\" (UniqueName: \"kubernetes.io/projected/72973172-a14f-450d-b924-79714e70141f-kube-api-access-kpqhb\") pod \"72973172-a14f-450d-b924-79714e70141f\" (UID: \"72973172-a14f-450d-b924-79714e70141f\") "
Jul 29 04:56:44.338785 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:44.338752    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72973172-a14f-450d-b924-79714e70141f-kube-api-access-kpqhb" (OuterVolumeSpecName: "kube-api-access-kpqhb") pod "72973172-a14f-450d-b924-79714e70141f" (UID: "72973172-a14f-450d-b924-79714e70141f"). InnerVolumeSpecName "kube-api-access-kpqhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:56:44.354013 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:44.353979    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7677-140502348829104_72973172-a14f-450d-b924-79714e70141f/test-curl-7677-140502348829104/0.log"
Jul 29 04:56:44.408243 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:44.408154    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7677-140502348829104"]
Jul 29 04:56:44.412280 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:44.412253    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7677-140502348829104"]
Jul 29 04:56:44.438122 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:44.438095    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpqhb\" (UniqueName: \"kubernetes.io/projected/72973172-a14f-450d-b924-79714e70141f-kube-api-access-kpqhb\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:56:45.154953 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:45.154918    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348829104"
Jul 29 04:56:45.155125 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:45.154926    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b105e3ec90b7d6b34c4f8c672c8bd82fc4654cbe996ab99873b7eac05601c4b"
Jul 29 04:56:45.165462 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:56:45.165433    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7677-140502348829104\" is forbidden: User \"system:node:ip-10-0-132-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-42.ec2.internal' and this object" podUID="72973172-a14f-450d-b924-79714e70141f" pod="opendatahub/test-curl-7677-140502348829104"
Jul 29 04:56:45.867360 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:45.867331    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72973172-a14f-450d-b924-79714e70141f" path="/var/lib/kubelet/pods/72973172-a14f-450d-b924-79714e70141f/volumes"
Jul 29 04:56:47.699365 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.699330    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7677-140502348539056"]
Jul 29 04:56:47.699782 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.699689    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72973172-a14f-450d-b924-79714e70141f" containerName="test-curl-7677-140502348829104"
Jul 29 04:56:47.699782 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.699701    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="72973172-a14f-450d-b924-79714e70141f" containerName="test-curl-7677-140502348829104"
Jul 29 04:56:47.699782 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.699751    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="72973172-a14f-450d-b924-79714e70141f" containerName="test-curl-7677-140502348829104"
Jul 29 04:56:47.702646 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.702630    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348539056"
Jul 29 04:56:47.705077 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.705058    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k8w2g\""
Jul 29 04:56:47.709820 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.709470    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7677-140502348539056"]
Jul 29 04:56:47.765894 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.765862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc5f2\" (UniqueName: \"kubernetes.io/projected/e44616b4-bd87-43cf-b744-e02bca9df43e-kube-api-access-tc5f2\") pod \"test-curl-7677-140502348539056\" (UID: \"e44616b4-bd87-43cf-b744-e02bca9df43e\") " pod="opendatahub/test-curl-7677-140502348539056"
Jul 29 04:56:47.866458 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.866426    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc5f2\" (UniqueName: \"kubernetes.io/projected/e44616b4-bd87-43cf-b744-e02bca9df43e-kube-api-access-tc5f2\") pod \"test-curl-7677-140502348539056\" (UID: \"e44616b4-bd87-43cf-b744-e02bca9df43e\") " pod="opendatahub/test-curl-7677-140502348539056"
Jul 29 04:56:47.876293 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:47.876269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc5f2\" (UniqueName: \"kubernetes.io/projected/e44616b4-bd87-43cf-b744-e02bca9df43e-kube-api-access-tc5f2\") pod \"test-curl-7677-140502348539056\" (UID: \"e44616b4-bd87-43cf-b744-e02bca9df43e\") " pod="opendatahub/test-curl-7677-140502348539056"
Jul 29 04:56:48.012241 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:48.012150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348539056"
Jul 29 04:56:48.140212 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:48.140181    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7677-140502348539056"]
Jul 29 04:56:48.143090 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:56:48.143060    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode44616b4_bd87_43cf_b744_e02bca9df43e.slice/crio-fcbf76c76bdbf23ec89e5a95bae58666e824c520daf373a358e5643772cdab3e WatchSource:0}: Error finding container fcbf76c76bdbf23ec89e5a95bae58666e824c520daf373a358e5643772cdab3e: Status 404 returned error can't find the container with id fcbf76c76bdbf23ec89e5a95bae58666e824c520daf373a358e5643772cdab3e
Jul 29 04:56:48.172037 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:48.172007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7677-140502348539056" event={"ID":"e44616b4-bd87-43cf-b744-e02bca9df43e","Type":"ContainerStarted","Data":"fcbf76c76bdbf23ec89e5a95bae58666e824c520daf373a358e5643772cdab3e"}
Jul 29 04:56:49.177878 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:49.177795    2573 generic.go:356] "Generic (PLEG): container finished" podID="e44616b4-bd87-43cf-b744-e02bca9df43e" containerID="15bd7f8d32de109dbf7a6f1511bad2396c0e51f66c3b6a05c21bc219dc007282" exitCode=0
Jul 29 04:56:49.178241 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:49.177876    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7677-140502348539056" event={"ID":"e44616b4-bd87-43cf-b744-e02bca9df43e","Type":"ContainerDied","Data":"15bd7f8d32de109dbf7a6f1511bad2396c0e51f66c3b6a05c21bc219dc007282"}
Jul 29 04:56:50.317651 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:50.317623    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348539056"
Jul 29 04:56:50.341173 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:50.341148    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7677-140502348539056_e44616b4-bd87-43cf-b744-e02bca9df43e/test-curl-7677-140502348539056/0.log"
Jul 29 04:56:50.360947 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:50.360917    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7677-140502348539056"]
Jul 29 04:56:50.366175 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:50.366145    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7677-140502348539056"]
Jul 29 04:56:50.388818 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:50.388787    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc5f2\" (UniqueName: \"kubernetes.io/projected/e44616b4-bd87-43cf-b744-e02bca9df43e-kube-api-access-tc5f2\") pod \"e44616b4-bd87-43cf-b744-e02bca9df43e\" (UID: \"e44616b4-bd87-43cf-b744-e02bca9df43e\") "
Jul 29 04:56:50.390845 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:50.390821    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e44616b4-bd87-43cf-b744-e02bca9df43e-kube-api-access-tc5f2" (OuterVolumeSpecName: "kube-api-access-tc5f2") pod "e44616b4-bd87-43cf-b744-e02bca9df43e" (UID: "e44616b4-bd87-43cf-b744-e02bca9df43e"). InnerVolumeSpecName "kube-api-access-tc5f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:56:50.489447 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:50.489359    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc5f2\" (UniqueName: \"kubernetes.io/projected/e44616b4-bd87-43cf-b744-e02bca9df43e-kube-api-access-tc5f2\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:56:51.187935 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:51.187909    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7677-140502348539056"
Jul 29 04:56:51.187935 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:51.187929    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcbf76c76bdbf23ec89e5a95bae58666e824c520daf373a358e5643772cdab3e"
Jul 29 04:56:51.197791 ip-10-0-132-42 kubenswrapper[2573]: E0729 04:56:51.197764    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7677-140502348539056\" is forbidden: User \"system:node:ip-10-0-132-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-42.ec2.internal' and this object" podUID="e44616b4-bd87-43cf-b744-e02bca9df43e" pod="opendatahub/test-curl-7677-140502348539056"
Jul 29 04:56:51.867426 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:51.867394    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e44616b4-bd87-43cf-b744-e02bca9df43e" path="/var/lib/kubelet/pods/e44616b4-bd87-43cf-b744-e02bca9df43e/volumes"
Jul 29 04:56:52.065604 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.065565    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2" podUID="63eb239a-7990-4aed-af1e-5d4ddbe050fb" containerName="main" containerID="cri-o://1f20d32b04a1214817952059de4eb7d1f26ad0982bb8ed3f21fcf6e9e9a28d61" gracePeriod=45
Jul 29 04:56:52.196327 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.196297    2573 generic.go:356] "Generic (PLEG): container finished" podID="63eb239a-7990-4aed-af1e-5d4ddbe050fb" containerID="1f20d32b04a1214817952059de4eb7d1f26ad0982bb8ed3f21fcf6e9e9a28d61" exitCode=0
Jul 29 04:56:52.196473 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.196375    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2" event={"ID":"63eb239a-7990-4aed-af1e-5d4ddbe050fb","Type":"ContainerDied","Data":"1f20d32b04a1214817952059de4eb7d1f26ad0982bb8ed3f21fcf6e9e9a28d61"}
Jul 29 04:56:52.316580 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.316553    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:56:52.406099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406068    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tmp-dir\") pod \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") "
Jul 29 04:56:52.406261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406119    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-model-cache\") pod \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") "
Jul 29 04:56:52.406261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406162    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-home\") pod \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") "
Jul 29 04:56:52.406261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406193    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-dshm\") pod \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") "
Jul 29 04:56:52.406261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406219    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zs4t\" (UniqueName: \"kubernetes.io/projected/63eb239a-7990-4aed-af1e-5d4ddbe050fb-kube-api-access-9zs4t\") pod \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") "
Jul 29 04:56:52.406443 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406290    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tls-certs\") pod \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\" (UID: \"63eb239a-7990-4aed-af1e-5d4ddbe050fb\") "
Jul 29 04:56:52.406443 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406382    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63eb239a-7990-4aed-af1e-5d4ddbe050fb" (UID: "63eb239a-7990-4aed-af1e-5d4ddbe050fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:56:52.406571 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406436    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "63eb239a-7990-4aed-af1e-5d4ddbe050fb" (UID: "63eb239a-7990-4aed-af1e-5d4ddbe050fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:56:52.406571 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406447    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-home" (OuterVolumeSpecName: "home") pod "63eb239a-7990-4aed-af1e-5d4ddbe050fb" (UID: "63eb239a-7990-4aed-af1e-5d4ddbe050fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:56:52.406700 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406590    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tmp-dir\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:56:52.406700 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406603    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-model-cache\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:56:52.406700 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.406612    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-home\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:56:52.408580 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.408548    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63eb239a-7990-4aed-af1e-5d4ddbe050fb" (UID: "63eb239a-7990-4aed-af1e-5d4ddbe050fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:56:52.408580 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.408567    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-dshm" (OuterVolumeSpecName: "dshm") pod "63eb239a-7990-4aed-af1e-5d4ddbe050fb" (UID: "63eb239a-7990-4aed-af1e-5d4ddbe050fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:56:52.408687 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.408610    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63eb239a-7990-4aed-af1e-5d4ddbe050fb-kube-api-access-9zs4t" (OuterVolumeSpecName: "kube-api-access-9zs4t") pod "63eb239a-7990-4aed-af1e-5d4ddbe050fb" (UID: "63eb239a-7990-4aed-af1e-5d4ddbe050fb"). InnerVolumeSpecName "kube-api-access-9zs4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:56:52.507274 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.507179    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63eb239a-7990-4aed-af1e-5d4ddbe050fb-tls-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:56:52.507274 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.507223    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63eb239a-7990-4aed-af1e-5d4ddbe050fb-dshm\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:56:52.507274 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:52.507234    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zs4t\" (UniqueName: \"kubernetes.io/projected/63eb239a-7990-4aed-af1e-5d4ddbe050fb-kube-api-access-9zs4t\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:56:53.202320 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:53.202286    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"
Jul 29 04:56:53.202820 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:53.202285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2" event={"ID":"63eb239a-7990-4aed-af1e-5d4ddbe050fb","Type":"ContainerDied","Data":"121ee32769b3dd13e060c0059db36262829a15f5725bdeefc497b4cc047c565f"}
Jul 29 04:56:53.202820 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:53.202444    2573 scope.go:117] "RemoveContainer" containerID="1f20d32b04a1214817952059de4eb7d1f26ad0982bb8ed3f21fcf6e9e9a28d61"
Jul 29 04:56:53.234917 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:53.234889    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"]
Jul 29 04:56:53.239539 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:53.239515    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b550f6/rate-test-model-b550f6-kserve-58b469ccf5-zzxl2"]
Jul 29 04:56:53.867512 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:53.867469    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63eb239a-7990-4aed-af1e-5d4ddbe050fb" path="/var/lib/kubelet/pods/63eb239a-7990-4aed-af1e-5d4ddbe050fb/volumes"
Jul 29 04:56:57.128124 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.128090    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"]
Jul 29 04:56:57.128620 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.128407    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44616b4-bd87-43cf-b744-e02bca9df43e" containerName="test-curl-7677-140502348539056"
Jul 29 04:56:57.128620 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.128418    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44616b4-bd87-43cf-b744-e02bca9df43e" containerName="test-curl-7677-140502348539056"
Jul 29 04:56:57.128620 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.128440    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63eb239a-7990-4aed-af1e-5d4ddbe050fb" containerName="main"
Jul 29 04:56:57.128620 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.128446    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="63eb239a-7990-4aed-af1e-5d4ddbe050fb" containerName="main"
Jul 29 04:56:57.128620 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.128517    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44616b4-bd87-43cf-b744-e02bca9df43e" containerName="test-curl-7677-140502348539056"
Jul 29 04:56:57.128620 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.128525    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="63eb239a-7990-4aed-af1e-5d4ddbe050fb" containerName="main"
Jul 29 04:56:57.132723 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.132704    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.137029 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.137007    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ec7357-openshift-default-dockercfg-q727g\""
Jul 29 04:56:57.145133 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.145108    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"]
Jul 29 04:56:57.246515 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.246450    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-certs\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.246515 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.246515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istiod-ca-cert\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.246783 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.246595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-token\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.246783 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.246642    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-socket\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.246783 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.246664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-credential-socket\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.246783 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.246685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-envoy\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.246783 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.246712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-data\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.247034 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.246788    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-podinfo\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.247034 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.246817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rscvb\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-kube-api-access-rscvb\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.347743 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.347702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-socket\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.347743 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.347745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-credential-socket\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348000 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.347769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-envoy\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348000 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.347803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-data\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348000 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.347855    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-podinfo\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348000 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.347876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rscvb\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-kube-api-access-rscvb\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348000 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.347946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-certs\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348000 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.347973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istiod-ca-cert\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348289 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.348017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-token\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348289 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.348174    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-socket\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348289 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.348201    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-credential-socket\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348513 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.348471    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-certs\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348648 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.348563    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-data\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.348906 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.348880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istiod-ca-cert\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.350355 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.350333    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-envoy\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.350547 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.350525    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-podinfo\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.356595 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.356567    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-token\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.356872 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.356853    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rscvb\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-kube-api-access-rscvb\") pod \"e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") " pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.442982 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.442887    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:57.586766 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.586734    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"]
Jul 29 04:56:57.589350 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:56:57.589320    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a431a4_cd3e_4b70_a518_d2b0541f5c0e.slice/crio-2063a68804263e501ff59df5596eaad49a204dbb20a476b7c95b8d2ea0df2943 WatchSource:0}: Error finding container 2063a68804263e501ff59df5596eaad49a204dbb20a476b7c95b8d2ea0df2943: Status 404 returned error can't find the container with id 2063a68804263e501ff59df5596eaad49a204dbb20a476b7c95b8d2ea0df2943
Jul 29 04:56:57.591623 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.591591    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:56:57.591724 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.591659    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:56:57.591724 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:57.591689    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:56:58.228850 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:58.228811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" event={"ID":"51a431a4-cd3e-4b70-a518-d2b0541f5c0e","Type":"ContainerStarted","Data":"05d431a01c6780aef8b168010ba0b9b9b9192927eb6bd67820e3e64a0ab16a7c"}
Jul 29 04:56:58.229295 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:58.228878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" event={"ID":"51a431a4-cd3e-4b70-a518-d2b0541f5c0e","Type":"ContainerStarted","Data":"2063a68804263e501ff59df5596eaad49a204dbb20a476b7c95b8d2ea0df2943"}
Jul 29 04:56:58.254200 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:58.254151    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" podStartSLOduration=1.254135681 podStartE2EDuration="1.254135681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:56:58.252852497 +0000 UTC m=+3698.847953215" watchObservedRunningTime="2026-07-29 04:56:58.254135681 +0000 UTC m=+3698.849236398"
Jul 29 04:56:58.443650 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:58.443614    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:58.448434 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:58.448409    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:59.233280 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:59.233247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:56:59.234336 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:56:59.234316    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:57:09.161969 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:09.161931    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:57:17.330252 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:17.330216    2573 generic.go:356] "Generic (PLEG): container finished" podID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerID="05d431a01c6780aef8b168010ba0b9b9b9192927eb6bd67820e3e64a0ab16a7c" exitCode=0
Jul 29 04:57:17.330669 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:17.330274    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" event={"ID":"51a431a4-cd3e-4b70-a518-d2b0541f5c0e","Type":"ContainerDied","Data":"05d431a01c6780aef8b168010ba0b9b9b9192927eb6bd67820e3e64a0ab16a7c"}
Jul 29 04:57:17.330732 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:17.330712    2573 scope.go:117] "RemoveContainer" containerID="05d431a01c6780aef8b168010ba0b9b9b9192927eb6bd67820e3e64a0ab16a7c"
Jul 29 04:57:17.331835 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:17.331804    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:57:17.331896 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:17.331876    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:57:17.331933 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:17.331909    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:57:18.336904 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:18.336871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" event={"ID":"51a431a4-cd3e-4b70-a518-d2b0541f5c0e","Type":"ContainerStarted","Data":"dd583f56ab5a42f3b73e0cc0ea174b37e256426ccc443de1ddc734426abedec7"}
Jul 29 04:57:18.443073 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:18.443034    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:57:18.443260 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:18.443216    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 29 04:57:18.443311 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:18.443264    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 29 04:57:19.443320 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:19.443284    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 29 04:57:19.443794 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:19.443345    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 29 04:57:20.444324 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:20.444225    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 29 04:57:20.444324 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:20.444295    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 29 04:57:21.443932 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:21.443897    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 29 04:57:21.444124 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:21.443956    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 29 04:57:22.447475 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:22.447442    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:57:22.448031 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:22.447903    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:57:22.448598 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:22.448575    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 04:57:38.353370 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:57:38.353336    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:58:09.635602 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.635559    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"]
Jul 29 04:58:09.639001 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.638977    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.643098 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.643072    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-ec7357\"/\"default-dockercfg-dxbx8\""
Jul 29 04:58:09.643098 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.643089    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-ec7357\"/\"kube-root-ca.crt\""
Jul 29 04:58:09.643399 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.643380    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-ec7357\"/\"openshift-service-ca.crt\""
Jul 29 04:58:09.643522 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.643383    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-ec7357\"/\"ipp-route-ec7357-kserve-self-signed-certs\""
Jul 29 04:58:09.649263 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.649237    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"]
Jul 29 04:58:09.733201 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.733165    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-tmp-dir\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.733378 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.733221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-home\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.733378 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.733255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35327d78-eedf-445f-aeb3-09dde16967a1-tls-certs\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.733378 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.733308    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-model-cache\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.733378 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.733326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hplvc\" (UniqueName: \"kubernetes.io/projected/35327d78-eedf-445f-aeb3-09dde16967a1-kube-api-access-hplvc\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.733378 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.733347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-dshm\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.834964 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.834924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-home\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.835182 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.834978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35327d78-eedf-445f-aeb3-09dde16967a1-tls-certs\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.835182 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.835065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-model-cache\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.835182 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.835091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hplvc\" (UniqueName: \"kubernetes.io/projected/35327d78-eedf-445f-aeb3-09dde16967a1-kube-api-access-hplvc\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.835182 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.835125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-dshm\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.835182 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.835161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-tmp-dir\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.835668 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.835640    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-tmp-dir\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.836178 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.836149    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-home\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.836283 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.836182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-model-cache\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.842569 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.842515    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-dshm\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.843214 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.843184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35327d78-eedf-445f-aeb3-09dde16967a1-tls-certs\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.846028 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.845977    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hplvc\" (UniqueName: \"kubernetes.io/projected/35327d78-eedf-445f-aeb3-09dde16967a1-kube-api-access-hplvc\") pod \"ipp-route-ec7357-kserve-644d649cbc-bbldr\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") " pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:09.951551 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:09.951441    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:10.086809 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:10.086766    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"]
Jul 29 04:58:10.090482 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:58:10.090456    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35327d78_eedf_445f_aeb3_09dde16967a1.slice/crio-6eb6b12cb45a095747d972f3d3d4008261d3d370982e1dd313ce122ed4d2e853 WatchSource:0}: Error finding container 6eb6b12cb45a095747d972f3d3d4008261d3d370982e1dd313ce122ed4d2e853: Status 404 returned error can't find the container with id 6eb6b12cb45a095747d972f3d3d4008261d3d370982e1dd313ce122ed4d2e853
Jul 29 04:58:10.590001 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:10.589917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr" event={"ID":"35327d78-eedf-445f-aeb3-09dde16967a1","Type":"ContainerStarted","Data":"534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02"}
Jul 29 04:58:10.590001 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:10.589962    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr" event={"ID":"35327d78-eedf-445f-aeb3-09dde16967a1","Type":"ContainerStarted","Data":"6eb6b12cb45a095747d972f3d3d4008261d3d370982e1dd313ce122ed4d2e853"}
Jul 29 04:58:10.609444 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:10.609393    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr" podStartSLOduration=1.609378146 podStartE2EDuration="1.609378146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:58:10.607308452 +0000 UTC m=+3771.202409180" watchObservedRunningTime="2026-07-29 04:58:10.609378146 +0000 UTC m=+3771.204478863"
Jul 29 04:58:13.661410 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:13.661374    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:58:19.952092 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:19.952059    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:19.952602 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:19.952106    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:19.964570 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:19.964548    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:20.646818 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:20.646786    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 04:58:39.358099 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:39.358063    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:58:49.985421 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:49.985380    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"]
Jul 29 04:58:49.989366 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:49.989347    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:49.991922 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:49.991899    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-79e09a-openshift-default-dockercfg-sv26d\""
Jul 29 04:58:49.997748 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:49.997725    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"]
Jul 29 04:58:50.008102 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.008069    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49tk6\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-kube-api-access-49tk6\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.008227 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.008159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.008227 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.008182    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-envoy\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.008351 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.008269    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-podinfo\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.008351 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.008321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-socket\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.008461 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.008353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-certs\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.008461 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.008378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-data\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.008461 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.008453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-token\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.008629 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.008478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-credential-socket\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109175 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-certs\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109175 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109178    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-data\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109422 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-token\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109485 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-credential-socket\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109562 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49tk6\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-kube-api-access-49tk6\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109618 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109591    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109671 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-envoy\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109723 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109659    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-data\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109723 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109694    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-podinfo\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109826 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-socket\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109826 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109751    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-credential-socket\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.109926 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.109694    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-certs\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.110221 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.110194    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-socket\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.110338 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.110316    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.112635 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.112604    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-envoy\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.112758 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.112708    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-podinfo\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.117170 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.117149    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-token\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.117441 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.117420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49tk6\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-kube-api-access-49tk6\") pod \"e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") " pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.300636 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.300601    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:50.450326 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.450300    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"]
Jul 29 04:58:50.452678 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:58:50.452649    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb584832a_ad87_499b_aaff_4cd9c3bf7da8.slice/crio-ae04fa24a6dcf60d55763723afb454f5bff0cc621b3084c52b7f56c49b90dc9e WatchSource:0}: Error finding container ae04fa24a6dcf60d55763723afb454f5bff0cc621b3084c52b7f56c49b90dc9e: Status 404 returned error can't find the container with id ae04fa24a6dcf60d55763723afb454f5bff0cc621b3084c52b7f56c49b90dc9e
Jul 29 04:58:50.455341 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.455308    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:58:50.455429 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.455376    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:58:50.455429 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.455404    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:58:50.774849 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.774818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" event={"ID":"b584832a-ad87-499b-aaff-4cd9c3bf7da8","Type":"ContainerStarted","Data":"f8e93b39ba1b61f3cf293ddb2edbee7238dd7d4786e2bc4678f8937ac8940777"}
Jul 29 04:58:50.775109 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.774879    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" event={"ID":"b584832a-ad87-499b-aaff-4cd9c3bf7da8","Type":"ContainerStarted","Data":"ae04fa24a6dcf60d55763723afb454f5bff0cc621b3084c52b7f56c49b90dc9e"}
Jul 29 04:58:50.795056 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:50.795002    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" podStartSLOduration=1.7949851049999999 podStartE2EDuration="1.794985105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:58:50.79355188 +0000 UTC m=+3811.388652596" watchObservedRunningTime="2026-07-29 04:58:50.794985105 +0000 UTC m=+3811.390085862"
Jul 29 04:58:51.300905 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:51.300876    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:51.306135 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:51.306104    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:51.780517 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:51.780472    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:51.781646 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:51.781628    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:58:57.054959 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:58:57.054921    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:59:05.853600 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:05.853565    2573 generic.go:356] "Generic (PLEG): container finished" podID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerID="f8e93b39ba1b61f3cf293ddb2edbee7238dd7d4786e2bc4678f8937ac8940777" exitCode=0
Jul 29 04:59:05.854090 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:05.853617    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" event={"ID":"b584832a-ad87-499b-aaff-4cd9c3bf7da8","Type":"ContainerDied","Data":"f8e93b39ba1b61f3cf293ddb2edbee7238dd7d4786e2bc4678f8937ac8940777"}
Jul 29 04:59:05.854090 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:05.853974    2573 scope.go:117] "RemoveContainer" containerID="f8e93b39ba1b61f3cf293ddb2edbee7238dd7d4786e2bc4678f8937ac8940777"
Jul 29 04:59:05.855131 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:05.855101    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:59:05.855200 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:05.855187    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:59:05.855240 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:05.855223    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 04:59:06.780742 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:06.780691    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:59:06.860119 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:06.860082    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" event={"ID":"b584832a-ad87-499b-aaff-4cd9c3bf7da8","Type":"ContainerStarted","Data":"d56f5a0f0ccadcc3b5274591e99b0dff75ea9a30794496a167647c6fbf3d398b"}
Jul 29 04:59:07.301538 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:07.301473    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:59:07.302616 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:07.302589    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 29 04:59:07.302754 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:07.302653    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 29 04:59:08.301591 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:08.301549    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 29 04:59:08.302094 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:08.301615    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 29 04:59:09.302073 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:09.302035    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 29 04:59:09.302515 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:09.302094    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 29 04:59:10.301430 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:10.301391    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 29 04:59:10.301647 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:10.301451    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 29 04:59:11.305851 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:11.305824    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:59:11.306261 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:11.306110    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:59:11.306781 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:11.306761    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:59:18.396946 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.396910    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"]
Jul 29 04:59:18.399158 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.399143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"
Jul 29 04:59:18.401666 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.401644    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:59:18.401793 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.401662    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n8frm\""
Jul 29 04:59:18.407246 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.407223    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"]
Jul 29 04:59:18.478548 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.478517    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5af497-8b6e-41e6-bd31-6c042e9220eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl\" (UID: \"4f5af497-8b6e-41e6-bd31-6c042e9220eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"
Jul 29 04:59:18.579576 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.579538    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5af497-8b6e-41e6-bd31-6c042e9220eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl\" (UID: \"4f5af497-8b6e-41e6-bd31-6c042e9220eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"
Jul 29 04:59:18.580152 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.580130    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5af497-8b6e-41e6-bd31-6c042e9220eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl\" (UID: \"4f5af497-8b6e-41e6-bd31-6c042e9220eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"
Jul 29 04:59:18.710979 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.710880    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"
Jul 29 04:59:18.845814 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.845709    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"]
Jul 29 04:59:18.848542 ip-10-0-132-42 kubenswrapper[2573]: W0729 04:59:18.848509    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5af497_8b6e_41e6_bd31_6c042e9220eb.slice/crio-ed8ab2f5936cce843a9f440136b8d0d813c02c8f69833df867ffcf86271a87b0 WatchSource:0}: Error finding container ed8ab2f5936cce843a9f440136b8d0d813c02c8f69833df867ffcf86271a87b0: Status 404 returned error can't find the container with id ed8ab2f5936cce843a9f440136b8d0d813c02c8f69833df867ffcf86271a87b0
Jul 29 04:59:18.924108 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:18.924075    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl" event={"ID":"4f5af497-8b6e-41e6-bd31-6c042e9220eb","Type":"ContainerStarted","Data":"ed8ab2f5936cce843a9f440136b8d0d813c02c8f69833df867ffcf86271a87b0"}
Jul 29 04:59:19.930304 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:19.930204    2573 generic.go:356] "Generic (PLEG): container finished" podID="4f5af497-8b6e-41e6-bd31-6c042e9220eb" containerID="1f00a8c8e5e05e59085065244acacd72923c7bf964b774940b4d0ce4ed60a02e" exitCode=0
Jul 29 04:59:19.930304 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:19.930288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl" event={"ID":"4f5af497-8b6e-41e6-bd31-6c042e9220eb","Type":"ContainerDied","Data":"1f00a8c8e5e05e59085065244acacd72923c7bf964b774940b4d0ce4ed60a02e"}
Jul 29 04:59:21.065543 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:21.065519    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"
Jul 29 04:59:21.205544 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:21.205433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5af497-8b6e-41e6-bd31-6c042e9220eb-maas-api-service-ca\") pod \"4f5af497-8b6e-41e6-bd31-6c042e9220eb\" (UID: \"4f5af497-8b6e-41e6-bd31-6c042e9220eb\") "
Jul 29 04:59:21.205876 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:21.205854    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5af497-8b6e-41e6-bd31-6c042e9220eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f5af497-8b6e-41e6-bd31-6c042e9220eb" (UID: "4f5af497-8b6e-41e6-bd31-6c042e9220eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:59:21.306586 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:21.306551    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5af497-8b6e-41e6-bd31-6c042e9220eb-maas-api-service-ca\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:21.940844 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:21.940812    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"
Jul 29 04:59:21.940844 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:21.940817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl" event={"ID":"4f5af497-8b6e-41e6-bd31-6c042e9220eb","Type":"ContainerDied","Data":"ed8ab2f5936cce843a9f440136b8d0d813c02c8f69833df867ffcf86271a87b0"}
Jul 29 04:59:21.941039 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:21.940873    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed8ab2f5936cce843a9f440136b8d0d813c02c8f69833df867ffcf86271a87b0"
Jul 29 04:59:23.562674 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:23.562634    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"]
Jul 29 04:59:23.565196 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:23.565170    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-79e09a-nmpfl"]
Jul 29 04:59:23.867923 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:23.867844    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f5af497-8b6e-41e6-bd31-6c042e9220eb" path="/var/lib/kubelet/pods/4f5af497-8b6e-41e6-bd31-6c042e9220eb/volumes"
Jul 29 04:59:28.163563 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:28.163527    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:59:29.868825 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:29.868793    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"]
Jul 29 04:59:29.869307 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:29.869001    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy" containerID="cri-o://d56f5a0f0ccadcc3b5274591e99b0dff75ea9a30794496a167647c6fbf3d398b" gracePeriod=30
Jul 29 04:59:35.006246 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.006215    2573 generic.go:356] "Generic (PLEG): container finished" podID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerID="d56f5a0f0ccadcc3b5274591e99b0dff75ea9a30794496a167647c6fbf3d398b" exitCode=0
Jul 29 04:59:35.006650 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.006286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" event={"ID":"b584832a-ad87-499b-aaff-4cd9c3bf7da8","Type":"ContainerDied","Data":"d56f5a0f0ccadcc3b5274591e99b0dff75ea9a30794496a167647c6fbf3d398b"}
Jul 29 04:59:35.006650 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.006351    2573 scope.go:117] "RemoveContainer" containerID="f8e93b39ba1b61f3cf293ddb2edbee7238dd7d4786e2bc4678f8937ac8940777"
Jul 29 04:59:35.129107 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.129042    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:59:35.229075 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229039    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-token\") pod \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") "
Jul 29 04:59:35.229258 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229093    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-podinfo\") pod \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") "
Jul 29 04:59:35.229258 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229169    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-envoy\") pod \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") "
Jul 29 04:59:35.229258 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229192    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-data\") pod \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") "
Jul 29 04:59:35.229258 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229236    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-certs\") pod \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") "
Jul 29 04:59:35.229526 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229258    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-credential-socket\") pod \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") "
Jul 29 04:59:35.229526 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229287    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49tk6\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-kube-api-access-49tk6\") pod \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") "
Jul 29 04:59:35.229526 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229322    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istiod-ca-cert\") pod \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") "
Jul 29 04:59:35.229526 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229364    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-socket\") pod \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\" (UID: \"b584832a-ad87-499b-aaff-4cd9c3bf7da8\") "
Jul 29 04:59:35.229727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229584    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b584832a-ad87-499b-aaff-4cd9c3bf7da8" (UID: "b584832a-ad87-499b-aaff-4cd9c3bf7da8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:59:35.229727 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229598    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b584832a-ad87-499b-aaff-4cd9c3bf7da8" (UID: "b584832a-ad87-499b-aaff-4cd9c3bf7da8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:59:35.229833 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229730    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:35.229833 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.229783    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:35.230038 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.230002    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b584832a-ad87-499b-aaff-4cd9c3bf7da8" (UID: "b584832a-ad87-499b-aaff-4cd9c3bf7da8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:59:35.230121 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.230084    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b584832a-ad87-499b-aaff-4cd9c3bf7da8" (UID: "b584832a-ad87-499b-aaff-4cd9c3bf7da8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:59:35.230722 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.230700    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-data" (OuterVolumeSpecName: "istio-data") pod "b584832a-ad87-499b-aaff-4cd9c3bf7da8" (UID: "b584832a-ad87-499b-aaff-4cd9c3bf7da8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:59:35.231447 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.231419    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b584832a-ad87-499b-aaff-4cd9c3bf7da8" (UID: "b584832a-ad87-499b-aaff-4cd9c3bf7da8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:59:35.231605 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.231581    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-token" (OuterVolumeSpecName: "istio-token") pod "b584832a-ad87-499b-aaff-4cd9c3bf7da8" (UID: "b584832a-ad87-499b-aaff-4cd9c3bf7da8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:59:35.232011 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.231990    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b584832a-ad87-499b-aaff-4cd9c3bf7da8" (UID: "b584832a-ad87-499b-aaff-4cd9c3bf7da8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:59:35.232095 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.232010    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-kube-api-access-49tk6" (OuterVolumeSpecName: "kube-api-access-49tk6") pod "b584832a-ad87-499b-aaff-4cd9c3bf7da8" (UID: "b584832a-ad87-499b-aaff-4cd9c3bf7da8"). InnerVolumeSpecName "kube-api-access-49tk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:59:35.331016 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.330981    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:35.331016 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.331011    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:35.331016 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.331020    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:35.331249 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.331030    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:35.331249 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.331038    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:35.331249 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.331045    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49tk6\" (UniqueName: \"kubernetes.io/projected/b584832a-ad87-499b-aaff-4cd9c3bf7da8-kube-api-access-49tk6\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:35.331249 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:35.331055    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b584832a-ad87-499b-aaff-4cd9c3bf7da8-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 04:59:36.012259 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:36.012231    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"
Jul 29 04:59:36.012715 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:36.012274    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb" event={"ID":"b584832a-ad87-499b-aaff-4cd9c3bf7da8","Type":"ContainerDied","Data":"ae04fa24a6dcf60d55763723afb454f5bff0cc621b3084c52b7f56c49b90dc9e"}
Jul 29 04:59:36.012715 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:36.012337    2573 scope.go:117] "RemoveContainer" containerID="d56f5a0f0ccadcc3b5274591e99b0dff75ea9a30794496a167647c6fbf3d398b"
Jul 29 04:59:36.030949 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:36.030920    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"]
Jul 29 04:59:36.036086 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:36.036062    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-79e09a-openshift-default-55fdf486fd-426kb"]
Jul 29 04:59:37.867173 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:37.867141    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" path="/var/lib/kubelet/pods/b584832a-ad87-499b-aaff-4cd9c3bf7da8/volumes"
Jul 29 04:59:48.457891 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:48.457854    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 04:59:54.740000 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:54.739960    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"]
Jul 29 04:59:59.653553 ip-10-0-132-42 kubenswrapper[2573]: I0729 04:59:59.653513    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 05:00:09.759628 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:09.759570    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr" podUID="35327d78-eedf-445f-aeb3-09dde16967a1" containerName="main" containerID="cri-o://534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02" gracePeriod=45
Jul 29 05:00:10.008509 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.008469    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 05:00:10.140464 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.140430    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-tmp-dir\") pod \"35327d78-eedf-445f-aeb3-09dde16967a1\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") "
Jul 29 05:00:10.140672 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.140485    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hplvc\" (UniqueName: \"kubernetes.io/projected/35327d78-eedf-445f-aeb3-09dde16967a1-kube-api-access-hplvc\") pod \"35327d78-eedf-445f-aeb3-09dde16967a1\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") "
Jul 29 05:00:10.140672 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.140615    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-model-cache\") pod \"35327d78-eedf-445f-aeb3-09dde16967a1\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") "
Jul 29 05:00:10.140672 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.140648    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-dshm\") pod \"35327d78-eedf-445f-aeb3-09dde16967a1\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") "
Jul 29 05:00:10.140831 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.140701    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35327d78-eedf-445f-aeb3-09dde16967a1-tls-certs\") pod \"35327d78-eedf-445f-aeb3-09dde16967a1\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") "
Jul 29 05:00:10.140831 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.140728    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-home\") pod \"35327d78-eedf-445f-aeb3-09dde16967a1\" (UID: \"35327d78-eedf-445f-aeb3-09dde16967a1\") "
Jul 29 05:00:10.140831 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.140775    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "35327d78-eedf-445f-aeb3-09dde16967a1" (UID: "35327d78-eedf-445f-aeb3-09dde16967a1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:10.140993 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.140823    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-model-cache" (OuterVolumeSpecName: "model-cache") pod "35327d78-eedf-445f-aeb3-09dde16967a1" (UID: "35327d78-eedf-445f-aeb3-09dde16967a1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:10.141052 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.141002    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-tmp-dir\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:10.141052 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.141015    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-model-cache\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:10.141052 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.141018    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-home" (OuterVolumeSpecName: "home") pod "35327d78-eedf-445f-aeb3-09dde16967a1" (UID: "35327d78-eedf-445f-aeb3-09dde16967a1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:10.143007 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.142976    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-dshm" (OuterVolumeSpecName: "dshm") pod "35327d78-eedf-445f-aeb3-09dde16967a1" (UID: "35327d78-eedf-445f-aeb3-09dde16967a1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:10.143007 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.142999    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35327d78-eedf-445f-aeb3-09dde16967a1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "35327d78-eedf-445f-aeb3-09dde16967a1" (UID: "35327d78-eedf-445f-aeb3-09dde16967a1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 05:00:10.143163 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.143013    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35327d78-eedf-445f-aeb3-09dde16967a1-kube-api-access-hplvc" (OuterVolumeSpecName: "kube-api-access-hplvc") pod "35327d78-eedf-445f-aeb3-09dde16967a1" (UID: "35327d78-eedf-445f-aeb3-09dde16967a1"). InnerVolumeSpecName "kube-api-access-hplvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:00:10.178347 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.178317    2573 generic.go:356] "Generic (PLEG): container finished" podID="35327d78-eedf-445f-aeb3-09dde16967a1" containerID="534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02" exitCode=0
Jul 29 05:00:10.178472 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.178360    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"
Jul 29 05:00:10.178472 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.178405    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr" event={"ID":"35327d78-eedf-445f-aeb3-09dde16967a1","Type":"ContainerDied","Data":"534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02"}
Jul 29 05:00:10.178472 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.178447    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr" event={"ID":"35327d78-eedf-445f-aeb3-09dde16967a1","Type":"ContainerDied","Data":"6eb6b12cb45a095747d972f3d3d4008261d3d370982e1dd313ce122ed4d2e853"}
Jul 29 05:00:10.178472 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.178465    2573 scope.go:117] "RemoveContainer" containerID="534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02"
Jul 29 05:00:10.187890 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.187874    2573 scope.go:117] "RemoveContainer" containerID="534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02"
Jul 29 05:00:10.188185 ip-10-0-132-42 kubenswrapper[2573]: E0729 05:00:10.188164    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02\": container with ID starting with 534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02 not found: ID does not exist" containerID="534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02"
Jul 29 05:00:10.188232 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.188196    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02"} err="failed to get container status \"534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02\": rpc error: code = NotFound desc = could not find container \"534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02\": container with ID starting with 534f231c23e9a46c3e926e08a1016ea04a9af786daa71028178f96f8b023fb02 not found: ID does not exist"
Jul 29 05:00:10.198269 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.198246    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"]
Jul 29 05:00:10.200476 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.200455    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-ec7357/ipp-route-ec7357-kserve-644d649cbc-bbldr"]
Jul 29 05:00:10.241761 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.241738    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-dshm\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:10.241761 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.241758    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35327d78-eedf-445f-aeb3-09dde16967a1-tls-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:10.241895 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.241766    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35327d78-eedf-445f-aeb3-09dde16967a1-home\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:10.241895 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:10.241776    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hplvc\" (UniqueName: \"kubernetes.io/projected/35327d78-eedf-445f-aeb3-09dde16967a1-kube-api-access-hplvc\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:11.867486 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:11.867446    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35327d78-eedf-445f-aeb3-09dde16967a1" path="/var/lib/kubelet/pods/35327d78-eedf-445f-aeb3-09dde16967a1/volumes"
Jul 29 05:00:51.243409 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.243361    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"]
Jul 29 05:00:51.243974 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.243678    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy" containerID="cri-o://dd583f56ab5a42f3b73e0cc0ea174b37e256426ccc443de1ddc734426abedec7" gracePeriod=30
Jul 29 05:00:51.621815 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.621770    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"]
Jul 29 05:00:51.622744 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.622719    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5af497-8b6e-41e6-bd31-6c042e9220eb" containerName="revoke-keys"
Jul 29 05:00:51.622906 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.622895    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5af497-8b6e-41e6-bd31-6c042e9220eb" containerName="revoke-keys"
Jul 29 05:00:51.623015 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.623005    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy"
Jul 29 05:00:51.623089 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.623080    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy"
Jul 29 05:00:51.623167 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.623158    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy"
Jul 29 05:00:51.623234 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.623226    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy"
Jul 29 05:00:51.623319 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.623310    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35327d78-eedf-445f-aeb3-09dde16967a1" containerName="main"
Jul 29 05:00:51.623387 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.623379    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="35327d78-eedf-445f-aeb3-09dde16967a1" containerName="main"
Jul 29 05:00:51.623684 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.623669    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy"
Jul 29 05:00:51.623801 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.623791    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f5af497-8b6e-41e6-bd31-6c042e9220eb" containerName="revoke-keys"
Jul 29 05:00:51.623879 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.623871    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="35327d78-eedf-445f-aeb3-09dde16967a1" containerName="main"
Jul 29 05:00:51.627810 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.627783    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"
Jul 29 05:00:51.630295 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.630266    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"]
Jul 29 05:00:51.630741 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.630720    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n8frm\""
Jul 29 05:00:51.630888 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.630786    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 05:00:51.691740 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.691703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c97b82c-6783-4b40-9c41-e41ce12e739c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9\" (UID: \"6c97b82c-6783-4b40-9c41-e41ce12e739c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"
Jul 29 05:00:51.792222 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.792182    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c97b82c-6783-4b40-9c41-e41ce12e739c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9\" (UID: \"6c97b82c-6783-4b40-9c41-e41ce12e739c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"
Jul 29 05:00:51.792879 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.792861    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c97b82c-6783-4b40-9c41-e41ce12e739c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9\" (UID: \"6c97b82c-6783-4b40-9c41-e41ce12e739c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"
Jul 29 05:00:51.940898 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:51.940806    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"
Jul 29 05:00:52.084907 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:52.084856    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"]
Jul 29 05:00:52.087781 ip-10-0-132-42 kubenswrapper[2573]: W0729 05:00:52.087754    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c97b82c_6783_4b40_9c41_e41ce12e739c.slice/crio-04e676dad4951c3acad517f5dc8139a870ff2e7b4d1dc9dba547052f929aa2ba WatchSource:0}: Error finding container 04e676dad4951c3acad517f5dc8139a870ff2e7b4d1dc9dba547052f929aa2ba: Status 404 returned error can't find the container with id 04e676dad4951c3acad517f5dc8139a870ff2e7b4d1dc9dba547052f929aa2ba
Jul 29 05:00:52.387180 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:52.387151    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9" event={"ID":"6c97b82c-6783-4b40-9c41-e41ce12e739c","Type":"ContainerStarted","Data":"961ad87ff454900feb7ebfec3fff244ac5777e73c5ea73cc9ba90ba48b31dd6d"}
Jul 29 05:00:52.387520 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:52.387201    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9" event={"ID":"6c97b82c-6783-4b40-9c41-e41ce12e739c","Type":"ContainerStarted","Data":"04e676dad4951c3acad517f5dc8139a870ff2e7b4d1dc9dba547052f929aa2ba"}
Jul 29 05:00:52.402420 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:52.402373    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9" podStartSLOduration=1.402355514 podStartE2EDuration="1.402355514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:00:52.401222749 +0000 UTC m=+3932.996323468" watchObservedRunningTime="2026-07-29 05:00:52.402355514 +0000 UTC m=+3932.997456231"
Jul 29 05:00:52.450780 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:52.450741    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 05:00:52.450939 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:52.450806    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 05:00:53.393810 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:53.393775    2573 generic.go:356] "Generic (PLEG): container finished" podID="6c97b82c-6783-4b40-9c41-e41ce12e739c" containerID="961ad87ff454900feb7ebfec3fff244ac5777e73c5ea73cc9ba90ba48b31dd6d" exitCode=0
Jul 29 05:00:53.394194 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:53.393866    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9" event={"ID":"6c97b82c-6783-4b40-9c41-e41ce12e739c","Type":"ContainerDied","Data":"961ad87ff454900feb7ebfec3fff244ac5777e73c5ea73cc9ba90ba48b31dd6d"}
Jul 29 05:00:54.534691 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:54.534665    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"
Jul 29 05:00:54.618203 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:54.618168    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c97b82c-6783-4b40-9c41-e41ce12e739c-maas-api-service-ca\") pod \"6c97b82c-6783-4b40-9c41-e41ce12e739c\" (UID: \"6c97b82c-6783-4b40-9c41-e41ce12e739c\") "
Jul 29 05:00:54.618604 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:54.618581    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c97b82c-6783-4b40-9c41-e41ce12e739c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6c97b82c-6783-4b40-9c41-e41ce12e739c" (UID: "6c97b82c-6783-4b40-9c41-e41ce12e739c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:00:54.719794 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:54.719696    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c97b82c-6783-4b40-9c41-e41ce12e739c-maas-api-service-ca\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:55.403850 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:55.403822    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"
Jul 29 05:00:55.404030 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:55.403873    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9" event={"ID":"6c97b82c-6783-4b40-9c41-e41ce12e739c","Type":"ContainerDied","Data":"04e676dad4951c3acad517f5dc8139a870ff2e7b4d1dc9dba547052f929aa2ba"}
Jul 29 05:00:55.404030 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:55.403922    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04e676dad4951c3acad517f5dc8139a870ff2e7b4d1dc9dba547052f929aa2ba"
Jul 29 05:00:56.410831 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.410794    2573 generic.go:356] "Generic (PLEG): container finished" podID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerID="dd583f56ab5a42f3b73e0cc0ea174b37e256426ccc443de1ddc734426abedec7" exitCode=0
Jul 29 05:00:56.411207 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.410862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" event={"ID":"51a431a4-cd3e-4b70-a518-d2b0541f5c0e","Type":"ContainerDied","Data":"dd583f56ab5a42f3b73e0cc0ea174b37e256426ccc443de1ddc734426abedec7"}
Jul 29 05:00:56.411207 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.410929    2573 scope.go:117] "RemoveContainer" containerID="05d431a01c6780aef8b168010ba0b9b9b9192927eb6bd67820e3e64a0ab16a7c"
Jul 29 05:00:56.507002 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.506979    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 05:00:56.638746 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.638708    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-token\") pod \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") "
Jul 29 05:00:56.638954 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.638763    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-data\") pod \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") "
Jul 29 05:00:56.638954 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.638830    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-socket\") pod \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") "
Jul 29 05:00:56.638954 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.638859    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-envoy\") pod \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") "
Jul 29 05:00:56.638954 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.638897    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rscvb\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-kube-api-access-rscvb\") pod \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") "
Jul 29 05:00:56.638954 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.638930    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-certs\") pod \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") "
Jul 29 05:00:56.638954 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.638953    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istiod-ca-cert\") pod \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") "
Jul 29 05:00:56.639269 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.638975    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-credential-socket\") pod \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") "
Jul 29 05:00:56.639269 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.638998    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-podinfo\") pod \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\" (UID: \"51a431a4-cd3e-4b70-a518-d2b0541f5c0e\") "
Jul 29 05:00:56.639269 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.639147    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51a431a4-cd3e-4b70-a518-d2b0541f5c0e" (UID: "51a431a4-cd3e-4b70-a518-d2b0541f5c0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:56.639419 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.639305    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51a431a4-cd3e-4b70-a518-d2b0541f5c0e" (UID: "51a431a4-cd3e-4b70-a518-d2b0541f5c0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:56.639419 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.639328    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:56.639419 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.639398    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51a431a4-cd3e-4b70-a518-d2b0541f5c0e" (UID: "51a431a4-cd3e-4b70-a518-d2b0541f5c0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:00:56.639692 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.639550    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51a431a4-cd3e-4b70-a518-d2b0541f5c0e" (UID: "51a431a4-cd3e-4b70-a518-d2b0541f5c0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:56.639919 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.639787    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "51a431a4-cd3e-4b70-a518-d2b0541f5c0e" (UID: "51a431a4-cd3e-4b70-a518-d2b0541f5c0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:56.641345 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.641319    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51a431a4-cd3e-4b70-a518-d2b0541f5c0e" (UID: "51a431a4-cd3e-4b70-a518-d2b0541f5c0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 05:00:56.641457 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.641418    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51a431a4-cd3e-4b70-a518-d2b0541f5c0e" (UID: "51a431a4-cd3e-4b70-a518-d2b0541f5c0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:56.641695 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.641675    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "51a431a4-cd3e-4b70-a518-d2b0541f5c0e" (UID: "51a431a4-cd3e-4b70-a518-d2b0541f5c0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:00:56.641766 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.641743    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-kube-api-access-rscvb" (OuterVolumeSpecName: "kube-api-access-rscvb") pod "51a431a4-cd3e-4b70-a518-d2b0541f5c0e" (UID: "51a431a4-cd3e-4b70-a518-d2b0541f5c0e"). InnerVolumeSpecName "kube-api-access-rscvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:00:56.740401 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.740365    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:56.740401 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.740393    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:56.740401 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.740402    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:56.740401 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.740412    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:56.740698 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.740421    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:56.740698 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.740430    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:56.740698 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.740437    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:56.740698 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:56.740444    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rscvb\" (UniqueName: \"kubernetes.io/projected/51a431a4-cd3e-4b70-a518-d2b0541f5c0e-kube-api-access-rscvb\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:00:57.416566 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:57.416535    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"
Jul 29 05:00:57.417048 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:57.416528    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh" event={"ID":"51a431a4-cd3e-4b70-a518-d2b0541f5c0e","Type":"ContainerDied","Data":"2063a68804263e501ff59df5596eaad49a204dbb20a476b7c95b8d2ea0df2943"}
Jul 29 05:00:57.417048 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:57.416686    2573 scope.go:117] "RemoveContainer" containerID="dd583f56ab5a42f3b73e0cc0ea174b37e256426ccc443de1ddc734426abedec7"
Jul 29 05:00:57.438413 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:57.438378    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"]
Jul 29 05:00:57.443686 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:57.443660    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ec7357-openshift-default-6d9dfb7c9d-ptdqh"]
Jul 29 05:00:57.867242 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:00:57.867210    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" path="/var/lib/kubelet/pods/51a431a4-cd3e-4b70-a518-d2b0541f5c0e/volumes"
Jul 29 05:01:02.290390 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:02.290354    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"]
Jul 29 05:01:02.292663 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:02.292638    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2cb3bf-xxrc9"]
Jul 29 05:01:03.866945 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:03.866917    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c97b82c-6783-4b40-9c41-e41ce12e739c" path="/var/lib/kubelet/pods/6c97b82c-6783-4b40-9c41-e41ce12e739c/volumes"
Jul 29 05:01:05.557916 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:05.557885    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 05:01:08.926420 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926384    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"]
Jul 29 05:01:08.926859 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926744    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c97b82c-6783-4b40-9c41-e41ce12e739c" containerName="revoke-keys"
Jul 29 05:01:08.926859 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926761    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c97b82c-6783-4b40-9c41-e41ce12e739c" containerName="revoke-keys"
Jul 29 05:01:08.926859 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926775    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy"
Jul 29 05:01:08.926859 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926781    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy"
Jul 29 05:01:08.926859 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926789    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy"
Jul 29 05:01:08.926859 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926794    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy"
Jul 29 05:01:08.927055 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926867    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b584832a-ad87-499b-aaff-4cd9c3bf7da8" containerName="istio-proxy"
Jul 29 05:01:08.927055 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926876    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy"
Jul 29 05:01:08.927055 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.926882    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c97b82c-6783-4b40-9c41-e41ce12e739c" containerName="revoke-keys"
Jul 29 05:01:08.929857 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.929839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"
Jul 29 05:01:08.932469 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.932445    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 05:01:08.932614 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.932445    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n8frm\""
Jul 29 05:01:08.937975 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:08.937949    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"]
Jul 29 05:01:09.050669 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:09.050635    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ab5acc-0948-4052-841e-c7f5a7306607-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45\" (UID: \"b2ab5acc-0948-4052-841e-c7f5a7306607\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"
Jul 29 05:01:09.151603 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:09.151552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ab5acc-0948-4052-841e-c7f5a7306607-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45\" (UID: \"b2ab5acc-0948-4052-841e-c7f5a7306607\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"
Jul 29 05:01:09.152232 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:09.152205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ab5acc-0948-4052-841e-c7f5a7306607-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45\" (UID: \"b2ab5acc-0948-4052-841e-c7f5a7306607\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"
Jul 29 05:01:09.241560 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:09.241455    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"
Jul 29 05:01:09.381142 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:09.381107    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"]
Jul 29 05:01:09.384023 ip-10-0-132-42 kubenswrapper[2573]: W0729 05:01:09.383991    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ab5acc_0948_4052_841e_c7f5a7306607.slice/crio-97bed938cd954b47d6c0e16e7dfa66c24cf0be37b4b01db494106859cc7c3b99 WatchSource:0}: Error finding container 97bed938cd954b47d6c0e16e7dfa66c24cf0be37b4b01db494106859cc7c3b99: Status 404 returned error can't find the container with id 97bed938cd954b47d6c0e16e7dfa66c24cf0be37b4b01db494106859cc7c3b99
Jul 29 05:01:09.477828 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:09.477797    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45" event={"ID":"b2ab5acc-0948-4052-841e-c7f5a7306607","Type":"ContainerStarted","Data":"97bed938cd954b47d6c0e16e7dfa66c24cf0be37b4b01db494106859cc7c3b99"}
Jul 29 05:01:10.483791 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:10.483665    2573 generic.go:356] "Generic (PLEG): container finished" podID="b2ab5acc-0948-4052-841e-c7f5a7306607" containerID="ba3f40caf0739d6fb972b0804af62ebc8b85db934c8febd5fb9fea7b10024ab6" exitCode=0
Jul 29 05:01:10.483791 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:10.483739    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45" event={"ID":"b2ab5acc-0948-4052-841e-c7f5a7306607","Type":"ContainerDied","Data":"ba3f40caf0739d6fb972b0804af62ebc8b85db934c8febd5fb9fea7b10024ab6"}
Jul 29 05:01:11.616648 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:11.616622    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"
Jul 29 05:01:11.776505 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:11.776449    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ab5acc-0948-4052-841e-c7f5a7306607-maas-api-service-ca\") pod \"b2ab5acc-0948-4052-841e-c7f5a7306607\" (UID: \"b2ab5acc-0948-4052-841e-c7f5a7306607\") "
Jul 29 05:01:11.776860 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:11.776832    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2ab5acc-0948-4052-841e-c7f5a7306607-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b2ab5acc-0948-4052-841e-c7f5a7306607" (UID: "b2ab5acc-0948-4052-841e-c7f5a7306607"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:01:11.877450 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:11.877426    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ab5acc-0948-4052-841e-c7f5a7306607-maas-api-service-ca\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:12.494580 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:12.494549    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"
Jul 29 05:01:12.494742 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:12.494591    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45" event={"ID":"b2ab5acc-0948-4052-841e-c7f5a7306607","Type":"ContainerDied","Data":"97bed938cd954b47d6c0e16e7dfa66c24cf0be37b4b01db494106859cc7c3b99"}
Jul 29 05:01:12.494742 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:12.494642    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97bed938cd954b47d6c0e16e7dfa66c24cf0be37b4b01db494106859cc7c3b99"
Jul 29 05:01:19.616249 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:19.616205    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"]
Jul 29 05:01:19.619422 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:19.619392    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b70f7c-5xs45"]
Jul 29 05:01:19.867907 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:19.867828    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ab5acc-0948-4052-841e-c7f5a7306607" path="/var/lib/kubelet/pods/b2ab5acc-0948-4052-841e-c7f5a7306607/volumes"
Jul 29 05:01:22.658947 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:22.658907    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 05:01:26.116726 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:26.116690    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"]
Jul 29 05:01:26.117192 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:26.116905    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy" containerID="cri-o://457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6" gracePeriod=30
Jul 29 05:01:29.970780 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:29.970739    2573 patch_prober.go:28] interesting pod/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 05:01:29.971161 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:29.970798    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 05:01:31.375200 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.375170    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 05:01:31.431427 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431323    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-certs\") pod \"e40431e0-1605-42aa-8f9d-097fafb10375\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") "
Jul 29 05:01:31.431427 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431371    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-data\") pod \"e40431e0-1605-42aa-8f9d-097fafb10375\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") "
Jul 29 05:01:31.431427 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431393    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-istio-token\") pod \"e40431e0-1605-42aa-8f9d-097fafb10375\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") "
Jul 29 05:01:31.431427 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431413    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40431e0-1605-42aa-8f9d-097fafb10375-istiod-ca-cert\") pod \"e40431e0-1605-42aa-8f9d-097fafb10375\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") "
Jul 29 05:01:31.431427 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431430    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6lq2\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-kube-api-access-f6lq2\") pod \"e40431e0-1605-42aa-8f9d-097fafb10375\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") "
Jul 29 05:01:31.431872 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431457    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-credential-socket\") pod \"e40431e0-1605-42aa-8f9d-097fafb10375\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") "
Jul 29 05:01:31.431872 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431631    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e40431e0-1605-42aa-8f9d-097fafb10375" (UID: "e40431e0-1605-42aa-8f9d-097fafb10375"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:31.431872 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431743    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-socket\") pod \"e40431e0-1605-42aa-8f9d-097fafb10375\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") "
Jul 29 05:01:31.431872 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431820    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-envoy\") pod \"e40431e0-1605-42aa-8f9d-097fafb10375\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") "
Jul 29 05:01:31.431872 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431852    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40431e0-1605-42aa-8f9d-097fafb10375-istio-podinfo\") pod \"e40431e0-1605-42aa-8f9d-097fafb10375\" (UID: \"e40431e0-1605-42aa-8f9d-097fafb10375\") "
Jul 29 05:01:31.432140 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.431976    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40431e0-1605-42aa-8f9d-097fafb10375-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e40431e0-1605-42aa-8f9d-097fafb10375" (UID: "e40431e0-1605-42aa-8f9d-097fafb10375"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:01:31.432140 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.432051    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e40431e0-1605-42aa-8f9d-097fafb10375" (UID: "e40431e0-1605-42aa-8f9d-097fafb10375"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:31.432140 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.432135    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e40431e0-1605-42aa-8f9d-097fafb10375" (UID: "e40431e0-1605-42aa-8f9d-097fafb10375"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:31.432295 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.432214    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:31.432295 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.432232    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:31.432295 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.432250    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40431e0-1605-42aa-8f9d-097fafb10375-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:31.432295 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.432276    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:31.432624 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.432595    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-data" (OuterVolumeSpecName: "istio-data") pod "e40431e0-1605-42aa-8f9d-097fafb10375" (UID: "e40431e0-1605-42aa-8f9d-097fafb10375"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:31.434049 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.434023    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e40431e0-1605-42aa-8f9d-097fafb10375-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e40431e0-1605-42aa-8f9d-097fafb10375" (UID: "e40431e0-1605-42aa-8f9d-097fafb10375"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 05:01:31.434171 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.434076    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-istio-token" (OuterVolumeSpecName: "istio-token") pod "e40431e0-1605-42aa-8f9d-097fafb10375" (UID: "e40431e0-1605-42aa-8f9d-097fafb10375"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:01:31.434171 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.434082    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-kube-api-access-f6lq2" (OuterVolumeSpecName: "kube-api-access-f6lq2") pod "e40431e0-1605-42aa-8f9d-097fafb10375" (UID: "e40431e0-1605-42aa-8f9d-097fafb10375"). InnerVolumeSpecName "kube-api-access-f6lq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:01:31.434264 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.434245    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e40431e0-1605-42aa-8f9d-097fafb10375" (UID: "e40431e0-1605-42aa-8f9d-097fafb10375"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:31.533240 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.533193    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:31.533240 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.533230    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40431e0-1605-42aa-8f9d-097fafb10375-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:31.533240 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.533239    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40431e0-1605-42aa-8f9d-097fafb10375-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:31.533240 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.533248    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:31.533562 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.533256    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6lq2\" (UniqueName: \"kubernetes.io/projected/e40431e0-1605-42aa-8f9d-097fafb10375-kube-api-access-f6lq2\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:31.594720 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.594682    2573 generic.go:356] "Generic (PLEG): container finished" podID="e40431e0-1605-42aa-8f9d-097fafb10375" containerID="457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6" exitCode=0
Jul 29 05:01:31.594920 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.594726    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" event={"ID":"e40431e0-1605-42aa-8f9d-097fafb10375","Type":"ContainerDied","Data":"457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6"}
Jul 29 05:01:31.594920 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.594731    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"
Jul 29 05:01:31.594920 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.594782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m" event={"ID":"e40431e0-1605-42aa-8f9d-097fafb10375","Type":"ContainerDied","Data":"cdc8e051a6e64d4a332bfbecb9c4343231ccaca83e308b0a2df5ff2de6d690a8"}
Jul 29 05:01:31.594920 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.594812    2573 scope.go:117] "RemoveContainer" containerID="457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6"
Jul 29 05:01:31.604260 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.604239    2573 scope.go:117] "RemoveContainer" containerID="b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7"
Jul 29 05:01:31.612362 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.612339    2573 scope.go:117] "RemoveContainer" containerID="457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6"
Jul 29 05:01:31.612646 ip-10-0-132-42 kubenswrapper[2573]: E0729 05:01:31.612624    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6\": container with ID starting with 457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6 not found: ID does not exist" containerID="457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6"
Jul 29 05:01:31.612730 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.612659    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6"} err="failed to get container status \"457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6\": rpc error: code = NotFound desc = could not find container \"457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6\": container with ID starting with 457a9ea5095740491b64c6cdbad2b9ab934118e070209b5a92af6d90ad83afc6 not found: ID does not exist"
Jul 29 05:01:31.612730 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.612687    2573 scope.go:117] "RemoveContainer" containerID="b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7"
Jul 29 05:01:31.612956 ip-10-0-132-42 kubenswrapper[2573]: E0729 05:01:31.612937    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7\": container with ID starting with b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7 not found: ID does not exist" containerID="b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7"
Jul 29 05:01:31.613000 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.612962    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7"} err="failed to get container status \"b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7\": rpc error: code = NotFound desc = could not find container \"b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7\": container with ID starting with b6c5f22bc02ce47d5cd3108f73038057a676afdf48d97abe9dad14c83ca79be7 not found: ID does not exist"
Jul 29 05:01:31.615566 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.615536    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"]
Jul 29 05:01:31.619771 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.619751    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-b70f7c-openshift-default-58644cfcb-8wv4m"]
Jul 29 05:01:31.867054 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:31.867020    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" path="/var/lib/kubelet/pods/e40431e0-1605-42aa-8f9d-097fafb10375/volumes"
Jul 29 05:01:39.758225 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:39.758176    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c28cg"]
Jul 29 05:01:43.630285 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:43.630248    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"]
Jul 29 05:01:43.630763 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:43.630485    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy" containerID="cri-o://d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15" gracePeriod=30
Jul 29 05:01:44.283208 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:44.283177    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-679f6d945d-2rp67_43fb13c2-c07f-471e-a2cf-8476d1e03225/authorino/0.log"
Jul 29 05:01:45.608794 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:45.608762    2573 patch_prober.go:28] interesting pod/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 05:01:45.609187 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:45.608814    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 05:01:48.876152 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.876126    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 05:01:48.997477 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997381    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmxtv\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-kube-api-access-xmxtv\") pod \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") "
Jul 29 05:01:48.997477 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997432    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-podinfo\") pod \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") "
Jul 29 05:01:48.997477 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997471    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-certs\") pod \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") "
Jul 29 05:01:48.997801 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997506    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-envoy\") pod \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") "
Jul 29 05:01:48.997801 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997536    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-data\") pod \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") "
Jul 29 05:01:48.997801 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997564    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istiod-ca-cert\") pod \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") "
Jul 29 05:01:48.997801 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997592    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-credential-socket\") pod \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") "
Jul 29 05:01:48.997801 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997622    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-socket\") pod \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") "
Jul 29 05:01:48.997801 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997669    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-token\") pod \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\" (UID: \"8b6d8955-f4c9-4631-a80a-6367a0ec9523\") "
Jul 29 05:01:48.998118 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.997871    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b6d8955-f4c9-4631-a80a-6367a0ec9523" (UID: "8b6d8955-f4c9-4631-a80a-6367a0ec9523"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:48.998118 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.998018    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b6d8955-f4c9-4631-a80a-6367a0ec9523" (UID: "8b6d8955-f4c9-4631-a80a-6367a0ec9523"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:48.998234 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.998201    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b6d8955-f4c9-4631-a80a-6367a0ec9523" (UID: "8b6d8955-f4c9-4631-a80a-6367a0ec9523"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:01:48.998461 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.998278    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b6d8955-f4c9-4631-a80a-6367a0ec9523" (UID: "8b6d8955-f4c9-4631-a80a-6367a0ec9523"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:48.998745 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.998714    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b6d8955-f4c9-4631-a80a-6367a0ec9523" (UID: "8b6d8955-f4c9-4631-a80a-6367a0ec9523"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:48.999989 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:48.999958    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b6d8955-f4c9-4631-a80a-6367a0ec9523" (UID: "8b6d8955-f4c9-4631-a80a-6367a0ec9523"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:01:49.000139 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.000123    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b6d8955-f4c9-4631-a80a-6367a0ec9523" (UID: "8b6d8955-f4c9-4631-a80a-6367a0ec9523"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:01:49.000440 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.000421    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b6d8955-f4c9-4631-a80a-6367a0ec9523" (UID: "8b6d8955-f4c9-4631-a80a-6367a0ec9523"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 05:01:49.000569 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.000457    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-kube-api-access-xmxtv" (OuterVolumeSpecName: "kube-api-access-xmxtv") pod "8b6d8955-f4c9-4631-a80a-6367a0ec9523" (UID: "8b6d8955-f4c9-4631-a80a-6367a0ec9523"). InnerVolumeSpecName "kube-api-access-xmxtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:01:49.099104 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.099063    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-data\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:49.099104 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.099096    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istiod-ca-cert\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:49.099104 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.099109    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-credential-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:49.099364 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.099121    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-socket\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:49.099364 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.099136    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-token\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:49.099364 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.099148    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmxtv\" (UniqueName: \"kubernetes.io/projected/8b6d8955-f4c9-4631-a80a-6367a0ec9523-kube-api-access-xmxtv\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:49.099364 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.099160    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-podinfo\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:49.099364 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.099171    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-workload-certs\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:49.099364 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.099181    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8955-f4c9-4631-a80a-6367a0ec9523-istio-envoy\") on node \"ip-10-0-132-42.ec2.internal\" DevicePath \"\""
Jul 29 05:01:49.682227 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.682195    2573 generic.go:356] "Generic (PLEG): container finished" podID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerID="d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15" exitCode=0
Jul 29 05:01:49.682449 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.682249    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"
Jul 29 05:01:49.682449 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.682262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" event={"ID":"8b6d8955-f4c9-4631-a80a-6367a0ec9523","Type":"ContainerDied","Data":"d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15"}
Jul 29 05:01:49.682449 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.682310    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m" event={"ID":"8b6d8955-f4c9-4631-a80a-6367a0ec9523","Type":"ContainerDied","Data":"18f8e870a288ea660fa6dad5e600304d3c47dccb879f4c50881183f8d8b54187"}
Jul 29 05:01:49.682449 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.682344    2573 scope.go:117] "RemoveContainer" containerID="d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15"
Jul 29 05:01:49.691962 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.691943    2573 scope.go:117] "RemoveContainer" containerID="481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa"
Jul 29 05:01:49.699789 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.699771    2573 scope.go:117] "RemoveContainer" containerID="d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15"
Jul 29 05:01:49.700035 ip-10-0-132-42 kubenswrapper[2573]: E0729 05:01:49.700017    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15\": container with ID starting with d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15 not found: ID does not exist" containerID="d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15"
Jul 29 05:01:49.700086 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.700046    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15"} err="failed to get container status \"d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15\": rpc error: code = NotFound desc = could not find container \"d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15\": container with ID starting with d2b38c22a43727bd37f80dd9733cae6f76964718244527d5a714d445de531f15 not found: ID does not exist"
Jul 29 05:01:49.700086 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.700066    2573 scope.go:117] "RemoveContainer" containerID="481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa"
Jul 29 05:01:49.700305 ip-10-0-132-42 kubenswrapper[2573]: E0729 05:01:49.700288    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa\": container with ID starting with 481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa not found: ID does not exist" containerID="481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa"
Jul 29 05:01:49.700356 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.700309    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa"} err="failed to get container status \"481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa\": rpc error: code = NotFound desc = could not find container \"481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa\": container with ID starting with 481f294f343f7f9259861a48190cc7770e0b21ba02230944adb106c7fca059fa not found: ID does not exist"
Jul 29 05:01:49.703255 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.703232    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"]
Jul 29 05:01:49.706943 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.706920    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b550f6-openshift-default-f468774fb-w6k2m"]
Jul 29 05:01:49.719656 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.719638    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8cdf94955-6wkmt_343c69d9-f68f-45cd-b710-8fe2383718f8/manager/0.log"
Jul 29 05:01:49.867706 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:49.867676    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" path="/var/lib/kubelet/pods/8b6d8955-f4c9-4631-a80a-6367a0ec9523/volumes"
Jul 29 05:01:50.292383 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:50.292353    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d56969f4b-nhlj9_8eaa5df6-517a-4f51-8830-67d326e632af/copy-manifests/0.log"
Jul 29 05:01:50.297844 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:50.297825    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d56969f4b-nhlj9_8eaa5df6-517a-4f51-8830-67d326e632af/manager/0.log"
Jul 29 05:01:50.724597 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:50.724522    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754990-f756t_feeec27b-09e9-41c1-bea0-66bde7ec20ea/cleanup/0.log"
Jul 29 05:01:50.829699 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:50.829667    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755005-ns4td_30d4ae30-2014-47e4-b870-a59a4bd6a136/cleanup/0.log"
Jul 29 05:01:52.309030 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:52.309002    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-679f6d945d-2rp67_43fb13c2-c07f-471e-a2cf-8476d1e03225/authorino/0.log"
Jul 29 05:01:52.423009 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:52.422983    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d586t_6836c4c3-a693-449b-85b9-3caf96915b16/manager/0.log"
Jul 29 05:01:52.651841 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:52.651767    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jjszq_3a18dda3-ce17-4090-9b79-54a8f979c0b8/kuadrant-console-plugin/0.log"
Jul 29 05:01:52.771622 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:52.771590    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l2hwd_6fe64710-a370-40fd-87cc-f017c87e66d6/registry-server/0.log"
Jul 29 05:01:52.999383 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:52.999295    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-c28cg_34974edb-b7a8-49fc-8a05-ca2509ba4bfe/limitador/0.log"
Jul 29 05:01:53.463788 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:53.463756    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq_39f1b5cc-0ef3-449f-9062-e6d1942f3d5e/istio-proxy/0.log"
Jul 29 05:01:53.913644 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:01:53.913610    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mwrlk_d6c1794a-60be-4274-a884-fb4c2f4df6d4/istio-proxy/1.log"
Jul 29 05:02:00.424715 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.424675    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q2sff/must-gather-fnshw"]
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.424970    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ab5acc-0948-4052-841e-c7f5a7306607" containerName="revoke-keys"
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.424980    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ab5acc-0948-4052-841e-c7f5a7306607" containerName="revoke-keys"
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425004    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy"
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425010    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy"
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425017    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy"
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425022    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy"
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425028    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy"
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425032    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy"
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425040    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy"
Jul 29 05:02:00.425095 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425045    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy"
Jul 29 05:02:00.425404 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425108    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a431a4-cd3e-4b70-a518-d2b0541f5c0e" containerName="istio-proxy"
Jul 29 05:02:00.425404 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425118    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy"
Jul 29 05:02:00.425404 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425125    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ab5acc-0948-4052-841e-c7f5a7306607" containerName="revoke-keys"
Jul 29 05:02:00.425404 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425131    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy"
Jul 29 05:02:00.425404 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425223    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40431e0-1605-42aa-8f9d-097fafb10375" containerName="istio-proxy"
Jul 29 05:02:00.425404 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.425232    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6d8955-f4c9-4631-a80a-6367a0ec9523" containerName="istio-proxy"
Jul 29 05:02:00.429585 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.429564    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2sff/must-gather-fnshw"
Jul 29 05:02:00.432418 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.432398    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q2sff\"/\"default-dockercfg-xt2ns\""
Jul 29 05:02:00.433584 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.433564    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q2sff\"/\"kube-root-ca.crt\""
Jul 29 05:02:00.435272 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.435252    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q2sff\"/\"openshift-service-ca.crt\""
Jul 29 05:02:00.449179 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.449151    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2sff/must-gather-fnshw"]
Jul 29 05:02:00.497559 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.497531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5ggc\" (UniqueName: \"kubernetes.io/projected/6b547358-5133-465c-880c-9d0215a821ab-kube-api-access-l5ggc\") pod \"must-gather-fnshw\" (UID: \"6b547358-5133-465c-880c-9d0215a821ab\") " pod="openshift-must-gather-q2sff/must-gather-fnshw"
Jul 29 05:02:00.497724 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.497595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6b547358-5133-465c-880c-9d0215a821ab-must-gather-output\") pod \"must-gather-fnshw\" (UID: \"6b547358-5133-465c-880c-9d0215a821ab\") " pod="openshift-must-gather-q2sff/must-gather-fnshw"
Jul 29 05:02:00.598894 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.598865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6b547358-5133-465c-880c-9d0215a821ab-must-gather-output\") pod \"must-gather-fnshw\" (UID: \"6b547358-5133-465c-880c-9d0215a821ab\") " pod="openshift-must-gather-q2sff/must-gather-fnshw"
Jul 29 05:02:00.599054 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.598925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5ggc\" (UniqueName: \"kubernetes.io/projected/6b547358-5133-465c-880c-9d0215a821ab-kube-api-access-l5ggc\") pod \"must-gather-fnshw\" (UID: \"6b547358-5133-465c-880c-9d0215a821ab\") " pod="openshift-must-gather-q2sff/must-gather-fnshw"
Jul 29 05:02:00.599194 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.599175    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6b547358-5133-465c-880c-9d0215a821ab-must-gather-output\") pod \"must-gather-fnshw\" (UID: \"6b547358-5133-465c-880c-9d0215a821ab\") " pod="openshift-must-gather-q2sff/must-gather-fnshw"
Jul 29 05:02:00.615202 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.615178    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5ggc\" (UniqueName: \"kubernetes.io/projected/6b547358-5133-465c-880c-9d0215a821ab-kube-api-access-l5ggc\") pod \"must-gather-fnshw\" (UID: \"6b547358-5133-465c-880c-9d0215a821ab\") " pod="openshift-must-gather-q2sff/must-gather-fnshw"
Jul 29 05:02:00.738414 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.738329    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2sff/must-gather-fnshw"
Jul 29 05:02:00.874172 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.874148    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2sff/must-gather-fnshw"]
Jul 29 05:02:00.879681 ip-10-0-132-42 kubenswrapper[2573]: W0729 05:02:00.879629    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b547358_5133_465c_880c_9d0215a821ab.slice/crio-e24b7d0416e2e4d3592ff6dda2d407f5f0cdb982d247bc47c4ec26d0bc69bc9d WatchSource:0}: Error finding container e24b7d0416e2e4d3592ff6dda2d407f5f0cdb982d247bc47c4ec26d0bc69bc9d: Status 404 returned error can't find the container with id e24b7d0416e2e4d3592ff6dda2d407f5f0cdb982d247bc47c4ec26d0bc69bc9d
Jul 29 05:02:00.881237 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:00.881216    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 05:02:01.741346 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:01.741300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2sff/must-gather-fnshw" event={"ID":"6b547358-5133-465c-880c-9d0215a821ab","Type":"ContainerStarted","Data":"e24b7d0416e2e4d3592ff6dda2d407f5f0cdb982d247bc47c4ec26d0bc69bc9d"}
Jul 29 05:02:02.750911 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:02.750872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2sff/must-gather-fnshw" event={"ID":"6b547358-5133-465c-880c-9d0215a821ab","Type":"ContainerStarted","Data":"9a8e1116e50b7dde72be10687bd960414984e5d036283df34dbd50fa3caf04de"}
Jul 29 05:02:02.751395 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:02.750922    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2sff/must-gather-fnshw" event={"ID":"6b547358-5133-465c-880c-9d0215a821ab","Type":"ContainerStarted","Data":"cc81ccc2c1bce3d5787eca2b421d065b3c677c421809d2df22e85683eb42c9a6"}
Jul 29 05:02:02.768926 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:02.768822    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q2sff/must-gather-fnshw" podStartSLOduration=1.7709621389999999 podStartE2EDuration="2.768798246s" totalImagesPullingTime="997.836107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:02:02.767652571 +0000 UTC m=+4003.362753291" watchObservedRunningTime="2026-07-29 05:02:02.768798246 +0000 UTC m=+4003.363899152"
Jul 29 05:02:03.421474 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:03.421441    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dpx6b_1d1a3a6f-876d-4412-92f6-4e350e665858/global-pull-secret-syncer/0.log"
Jul 29 05:02:03.624778 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:03.624742    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vhxjp_cce1ed7d-5e38-4a28-b342-0a3b1d808f09/konnectivity-agent/0.log"
Jul 29 05:02:03.644009 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:03.643979    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-42.ec2.internal_ba036abba3605af2a4be113b0020ec88/haproxy/0.log"
Jul 29 05:02:09.132899 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:09.132788    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-679f6d945d-2rp67_43fb13c2-c07f-471e-a2cf-8476d1e03225/authorino/0.log"
Jul 29 05:02:09.163256 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:09.163207    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d586t_6836c4c3-a693-449b-85b9-3caf96915b16/manager/0.log"
Jul 29 05:02:09.232633 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:09.232604    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jjszq_3a18dda3-ce17-4090-9b79-54a8f979c0b8/kuadrant-console-plugin/0.log"
Jul 29 05:02:09.283276 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:09.283233    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l2hwd_6fe64710-a370-40fd-87cc-f017c87e66d6/registry-server/0.log"
Jul 29 05:02:09.379017 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:09.378992    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-c28cg_34974edb-b7a8-49fc-8a05-ca2509ba4bfe/limitador/0.log"
Jul 29 05:02:11.547029 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:11.546966    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h7gpj_cad02e15-5bf6-46a1-9f28-96641bd71cf4/node-exporter/0.log"
Jul 29 05:02:11.568687 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:11.568657    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h7gpj_cad02e15-5bf6-46a1-9f28-96641bd71cf4/kube-rbac-proxy/0.log"
Jul 29 05:02:11.590863 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:11.590828    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h7gpj_cad02e15-5bf6-46a1-9f28-96641bd71cf4/init-textfile/0.log"
Jul 29 05:02:13.356507 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.356455    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"]
Jul 29 05:02:13.362590 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.362562    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.369384 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.369348    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"]
Jul 29 05:02:13.524663 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.524627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-podres\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.524866 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.524680    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqjdm\" (UniqueName: \"kubernetes.io/projected/3904db65-6805-4faf-bc45-67c0f8e22ebf-kube-api-access-fqjdm\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.524866 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.524743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-sys\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.524866 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.524778    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-lib-modules\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.524866 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.524814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-proc\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.626022 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.625921    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-proc\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.626199 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.626050    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-podres\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.626199 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.626096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqjdm\" (UniqueName: \"kubernetes.io/projected/3904db65-6805-4faf-bc45-67c0f8e22ebf-kube-api-access-fqjdm\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.626199 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.626129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-sys\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.626199 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.626164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-lib-modules\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.626443 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.626328    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-lib-modules\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.626443 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.626394    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-proc\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.626584 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.626465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-podres\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.626890 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.626860    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3904db65-6805-4faf-bc45-67c0f8e22ebf-sys\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.635000 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.634961    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqjdm\" (UniqueName: \"kubernetes.io/projected/3904db65-6805-4faf-bc45-67c0f8e22ebf-kube-api-access-fqjdm\") pod \"perf-node-gather-daemonset-6654f\" (UID: \"3904db65-6805-4faf-bc45-67c0f8e22ebf\") " pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.675825 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.675779    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:13.875346 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:13.875071    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"]
Jul 29 05:02:14.846227 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:14.846180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f" event={"ID":"3904db65-6805-4faf-bc45-67c0f8e22ebf","Type":"ContainerStarted","Data":"701abcaefe3d9f43fa1f6197e97ebb2324ad7a665a771558f4ff5d366d64cdf6"}
Jul 29 05:02:14.846730 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:14.846265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f" event={"ID":"3904db65-6805-4faf-bc45-67c0f8e22ebf","Type":"ContainerStarted","Data":"42f53d50bff6618bf19e37035a7c131b13801a359ffbbcc68c68b43c218bf312"}
Jul 29 05:02:14.846730 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:14.846547    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:14.865375 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:14.865308    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f" podStartSLOduration=1.865285852 podStartE2EDuration="1.865285852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 05:02:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:02:14.862343325 +0000 UTC m=+4015.457444046" watchObservedRunningTime="2026-07-29 05:02:14.865285852 +0000 UTC m=+4015.460386572"
Jul 29 05:02:16.256261 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:16.256233    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wfn94_a4431ead-a5f9-413e-ae26-fc3641c64ac2/dns/0.log"
Jul 29 05:02:16.274200 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:16.274171    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wfn94_a4431ead-a5f9-413e-ae26-fc3641c64ac2/kube-rbac-proxy/0.log"
Jul 29 05:02:16.294431 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:16.294403    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-87pml_b8a1f3c3-4a4e-44b3-946c-336baafa6363/dns-node-resolver/0.log"
Jul 29 05:02:16.868889 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:16.868854    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-669f6f8b9f-6k9bf_785da88f-b9f3-4f53-bf60-1c218ca9edfb/registry/0.log"
Jul 29 05:02:16.890129 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:16.890086    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gngxn_70606c53-16eb-44ad-b366-bc17f813e97c/node-ca/0.log"
Jul 29 05:02:17.832443 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:17.832416    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq_39f1b5cc-0ef3-449f-9062-e6d1942f3d5e/istio-proxy/0.log"
Jul 29 05:02:18.071074 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:18.071037    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mwrlk_d6c1794a-60be-4274-a884-fb4c2f4df6d4/istio-proxy/0.log"
Jul 29 05:02:18.106747 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:18.106675    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mwrlk_d6c1794a-60be-4274-a884-fb4c2f4df6d4/istio-proxy/1.log"
Jul 29 05:02:19.027659 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:19.027630    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zn688_5c22599f-c126-482c-96d6-5ef54026c867/serve-healthcheck-canary/0.log"
Jul 29 05:02:19.510979 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:19.510904    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-78cj8_2d3116ed-c1f9-44e5-a0e1-bb04654bec8a/kube-rbac-proxy/0.log"
Jul 29 05:02:19.531772 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:19.531743    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-78cj8_2d3116ed-c1f9-44e5-a0e1-bb04654bec8a/exporter/0.log"
Jul 29 05:02:19.550675 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:19.550646    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-78cj8_2d3116ed-c1f9-44e5-a0e1-bb04654bec8a/extractor/0.log"
Jul 29 05:02:20.865291 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:20.865258    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q2sff/perf-node-gather-daemonset-6654f"
Jul 29 05:02:22.320312 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:22.320276    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8cdf94955-6wkmt_343c69d9-f68f-45cd-b710-8fe2383718f8/manager/0.log"
Jul 29 05:02:22.611926 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:22.611849    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d56969f4b-nhlj9_8eaa5df6-517a-4f51-8830-67d326e632af/manager/0.log"
Jul 29 05:02:22.630740 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:22.630716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d56969f4b-nhlj9_8eaa5df6-517a-4f51-8830-67d326e632af/copy-manifests/0.log"
Jul 29 05:02:23.983997 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:23.983969    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86cc57cc46-nn4hm_8dd6ff74-9e6f-45d9-a514-4492a15b92a9/manager/0.log"
Jul 29 05:02:24.068347 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:24.068315    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vq2v9_be2b3ed6-606d-464b-9461-c8f0ad8e15db/openshift-lws-operator/0.log"
Jul 29 05:02:24.490347 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:24.490318    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq_39f1b5cc-0ef3-449f-9062-e6d1942f3d5e/istio-proxy/0.log"
Jul 29 05:02:24.691594 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:24.691557    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mwrlk_d6c1794a-60be-4274-a884-fb4c2f4df6d4/istio-proxy/0.log"
Jul 29 05:02:24.728777 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:24.728740    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mwrlk_d6c1794a-60be-4274-a884-fb4c2f4df6d4/istio-proxy/1.log"
Jul 29 05:02:26.098905 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:26.098867    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpl8rq_39f1b5cc-0ef3-449f-9062-e6d1942f3d5e/istio-proxy/0.log"
Jul 29 05:02:26.312304 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:26.312260    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mwrlk_d6c1794a-60be-4274-a884-fb4c2f4df6d4/istio-proxy/0.log"
Jul 29 05:02:26.352762 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:26.352681    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-mwrlk_d6c1794a-60be-4274-a884-fb4c2f4df6d4/istio-proxy/1.log"
Jul 29 05:02:29.061432 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:29.061407    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cdz5j_f37ecde0-0a5a-491c-a06d-da0087ac4de6/migrator/0.log"
Jul 29 05:02:29.079756 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:29.079731    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cdz5j_f37ecde0-0a5a-491c-a06d-da0087ac4de6/graceful-termination/0.log"
Jul 29 05:02:30.781030 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:30.780996    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cbd2t_6acb23dc-33eb-4cf7-840d-2ca5486146c4/kube-multus-additional-cni-plugins/0.log"
Jul 29 05:02:30.801838 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:30.801810    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cbd2t_6acb23dc-33eb-4cf7-840d-2ca5486146c4/egress-router-binary-copy/0.log"
Jul 29 05:02:30.821062 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:30.821038    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cbd2t_6acb23dc-33eb-4cf7-840d-2ca5486146c4/cni-plugins/0.log"
Jul 29 05:02:30.838904 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:30.838880    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cbd2t_6acb23dc-33eb-4cf7-840d-2ca5486146c4/bond-cni-plugin/0.log"
Jul 29 05:02:30.858585 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:30.858546    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cbd2t_6acb23dc-33eb-4cf7-840d-2ca5486146c4/routeoverride-cni/0.log"
Jul 29 05:02:30.879069 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:30.879037    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cbd2t_6acb23dc-33eb-4cf7-840d-2ca5486146c4/whereabouts-cni-bincopy/0.log"
Jul 29 05:02:30.897963 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:30.897937    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cbd2t_6acb23dc-33eb-4cf7-840d-2ca5486146c4/whereabouts-cni/0.log"
Jul 29 05:02:30.937316 ip-10-0-132-42 kubenswrapper[2573]: I0729 05:02:30.937292    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bl2ck_4ffa0a1d-f5e9-492f-883c-ddeb53126ade/kube-multus/0.log"