Jul 24 16:04:02.965211 ip-10-0-134-143 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 16:04:02.965224 ip-10-0-134-143 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 16:04:02.965234 ip-10-0-134-143 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 16:04:02.965677 ip-10-0-134-143 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 16:04:12.830993 ip-10-0-134-143 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 16:04:12.831435 ip-10-0-134-143 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0a7e7105302f4fc087a4d2d19fcc4aec --
Jul 24 16:06:04.404500 ip-10-0-134-143 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 16:06:04.773541 ip-10-0-134-143 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 16:06:04.773541 ip-10-0-134-143 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 16:06:04.773541 ip-10-0-134-143 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 16:06:04.773541 ip-10-0-134-143 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 16:06:04.773541 ip-10-0-134-143 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 16:06:04.775719 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.775612    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 16:06:04.782486 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782453    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:06:04.782577 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782572    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782579    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782583    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782586    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782590    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782592    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782595    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782599    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782601    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782604    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782606    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782611    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782615    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782618    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782621    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782623    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782626    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782629    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782632    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782635    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:06:04.782632 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782638    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782640    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782643    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782646    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782649    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782652    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782655    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782661    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782664    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782666    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782669    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782671    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782674    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782676    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782679    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782682    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782686    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782690    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782693    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782696    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:06:04.783160 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782699    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782702    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782704    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782707    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782710    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782714    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782717    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782720    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782722    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782725    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782728    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782731    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782733    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782737    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782739    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782742    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782752    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782755    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782758    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:06:04.783652 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782761    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782763    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782766    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782769    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782771    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782774    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782776    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782779    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782782    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782784    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782786    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782789    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782791    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782794    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782796    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782799    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782801    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782804    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782807    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782812    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:06:04.784117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782815    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782818    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782821    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782824    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782827    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782829    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782833    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782836    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782838    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782841    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782843    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782846    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782848    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782851    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782853    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782856    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782858    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782861    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.782863    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784208    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:06:04.784626 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784217    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784220    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784223    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784227    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784231    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784234    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784237    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784240    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784243    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784246    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784250    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784254    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784257    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784259    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784262    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784265    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784268    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784271    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784274    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:06:04.785092 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784277    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784280    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784282    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784284    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784287    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784290    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784292    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784295    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784297    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784299    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784302    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784304    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784307    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784309    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784312    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784314    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784316    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784319    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784321    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:06:04.785608 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784324    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784326    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784329    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784332    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784334    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784337    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784339    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784342    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784344    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784347    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784350    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784354    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784357    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784359    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784363    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784365    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784367    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784370    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784372    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784375    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:06:04.786055 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784377    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784380    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784382    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784384    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784387    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784389    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784391    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784394    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784396    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784399    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784401    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784404    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784406    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784408    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784411    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784416    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784420    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784423    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784426    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:06:04.786562 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784429    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784432    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784437    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784440    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784443    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784445    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784448    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784451    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784454    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784457    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784459    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784462    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784464    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784466    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784469    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784471    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784473    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784476    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784478    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784481    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:06:04.787101 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784484    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784852    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784857    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784859    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784862    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784864    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784867    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784869    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784872    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784875    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784878    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784880    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784883    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784885    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784890    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784892    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784895    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784898    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784900    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:06:04.787618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784903    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784906    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784908    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784910    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784913    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784915    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784918    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784920    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784923    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784925    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784928    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784930    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784934    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784938    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784942    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784945    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784948    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784950    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784952    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:06:04.788099 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784955    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784957    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784961    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784963    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784966    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784969    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784971    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784973    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784979    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784981    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784984    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784986    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784989    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784992    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784994    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784997    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.784999    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785001    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785004    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785006    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:06:04.788609 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785009    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785011    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785014    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785016    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785018    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785021    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785023    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785026    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785028    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785031    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785033    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785036    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785038    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785041    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785043    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785046    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785048    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785051    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785053    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:06:04.789127 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785056    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785059    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785062    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785064    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785067    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785069    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785074    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785077    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785080    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785083    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785086    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785089    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785091    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785094    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785097    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785099    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785102    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785105    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785107    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785110    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:06:04.789635 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785112    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785114    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785117    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785200    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785218    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785224    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785228    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785231    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785234    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785238    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785242    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785245    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785248    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785252    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785256    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785259    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785262    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785265    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785268    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785272    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785275    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785282    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785285    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785288    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 16:06:04.790105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785292    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785295    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785302    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785305    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785308    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785311    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785314    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785317    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785319    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785323    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785325    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785329    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785332    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785336    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785339    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785342    2561 flags.go:64] FLAG: --enable-server="true"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785345    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785366    2561 flags.go:64] FLAG: --event-burst="100"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785369    2561 flags.go:64] FLAG: --event-qps="50"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785373    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785376    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785380    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785384    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785386    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785389    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 16:06:04.790704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785392    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785395    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785398    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785401    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785404    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785407    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785410    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785412    2561 flags.go:64] FLAG: --feature-gates=""
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785416    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785418    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785421    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785424    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785427    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785430    2561 flags.go:64] FLAG: --help="false"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785433    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-134-143.ec2.internal"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785436    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785438    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785441    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785444    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785447    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785451    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785454    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785457    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 16:06:04.791329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785459    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785462    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785465    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785468    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785471    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785475    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785478    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785481    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785483    2561 flags.go:64] FLAG: --lock-file=""
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785486    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785489    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785491    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785497    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785500    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785503    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785506    2561 flags.go:64] FLAG: --logging-format="text"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785508    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785511    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785514    2561 flags.go:64] FLAG: --manifest-url=""
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785517    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785521    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785523    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785527    2561 flags.go:64] FLAG: --max-pods="110"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785530    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785533    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 16:06:04.791898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785535    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785538    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785541    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785544    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785547    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785554    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785557    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785560    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785563    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785565    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785570    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785573    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785576    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785580    2561 flags.go:64] FLAG: --port="10250"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785582    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785585    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0da26238ed7466d37"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785588    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785591    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785594    2561 flags.go:64] FLAG: --register-node="true"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785597    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785600    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785603    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785606    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785609    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785612    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 16:06:04.792560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785616    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785619    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785621    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785624    2561 flags.go:64] FLAG: --runonce="false"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785627    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785630    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785633    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785636    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785638    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785641    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785644    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785648    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785651    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785653    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785656    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785659    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785662    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785665    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785667    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785672    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785676    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785679    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785683    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785686    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785688    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 16:06:04.793168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785691    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785694    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785697    2561 flags.go:64] FLAG: --v="2"
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785701    2561 flags.go:64] FLAG: --version="false"
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785705    2561 flags.go:64] FLAG: --vmodule=""
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785708    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.785712    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785822    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785826    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785831    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785834    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785837    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785839    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785842    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785845    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785847    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785850    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785852    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785856    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785859    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785861    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:06:04.793832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785864    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785866    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785868    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785871    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785873    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785876    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785880    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785883    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785886    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785890    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785893    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785895    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785898    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785902    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785904    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785907    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785915    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785918    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785921    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:06:04.794374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785923    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785926    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785929    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785931    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785933    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785936    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785938    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785951    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785955    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785959    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785963    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785966    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785969    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785971    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785974    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785976    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785979    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785981    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785984    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785988    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:06:04.794845 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785990    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785993    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785995    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.785998    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786000    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786002    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786005    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786008    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786010    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786013    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786017    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786019    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786022    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786024    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786027    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786029    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786032    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786034    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786036    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786039    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:06:04.795345 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786041    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786043    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786047    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786050    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786052    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786055    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786057    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786062    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786065    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786068    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786071    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786075    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786078    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786081    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786083    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786086    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786088    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786091    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786094    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:06:04.795822 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786096    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786099    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786102    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786104    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786109    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786112    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.786115    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.786866    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.794153    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.794168    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.794205    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.794211    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794264    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794269    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794273    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:06:04.796305 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794276    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794278    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794281    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794285    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794288    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794291    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794293    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794296    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794298    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794301    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794303    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794306    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794308    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794311    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794313    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794316    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794319    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794321    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794324    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:06:04.796675 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794326    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794329    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794331    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794333    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794336    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794338    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794340    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794344    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794347    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794350    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794352    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794355    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794357    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794360    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794363    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794365    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794367    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794370    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794372    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794375    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:06:04.797121 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794377    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794380    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794383    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794385    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794388    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794392    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794395    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794398    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794400    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794403    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794406    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794408    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794411    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794413    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794415    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794418    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794422    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794426    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:06:04.797618 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794429    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794432    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794436    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794439    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794442    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794446    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794449    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794451    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794454    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794457    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794459    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794462    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794464    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794467    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794469    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794471    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794474    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794476    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794479    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794481    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:06:04.798037 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794484    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794486    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794489    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794491    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794493    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794496    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794498    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794500    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794502    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794505    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794507    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794510    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794512    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794515    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794518    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794522    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794524    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794527    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:06:04.798563 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794529    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.794534    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794640    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794644    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794648    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794652    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794655    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794657    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794660    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794664    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794667    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794670    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794673    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794677    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:06:04.799012 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794680    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794683    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794686    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794688    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794691    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794693    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794696    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794698    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794700    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794703    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794705    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794708    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794710    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794713    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794716    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794718    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794721    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794723    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794726    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794728    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794731    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:06:04.799374 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794733    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794735    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794737    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794740    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794742    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794751    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794755    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794758    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794760    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794763    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794765    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794768    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794770    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794773    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794775    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794778    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794781    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794783    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794785    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794788    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:06:04.799866 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794790    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794792    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794795    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794797    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794799    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794802    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794804    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794807    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794810    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794812    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794815    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794817    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794819    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794822    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794825    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794827    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794829    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794832    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794834    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:06:04.800371 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794836    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794839    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794841    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794844    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794846    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794849    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794852    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794854    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794857    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794859    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794862    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794864    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794866    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794869    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794871    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794873    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794876    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794878    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794881    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:06:04.800796 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794883    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794885    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794888    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794891    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794893    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794896    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794898    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:04.794902    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.794907    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.795022    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.797332    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.798742    2561 server.go:1019] "Starting client certificate rotation"
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.798853    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 16:06:04.801270 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.798894    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 16:06:04.801599 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.801519    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 16:06:04.802992 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.802975    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 16:06:04.811858 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.811839    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 24 16:06:04.816056 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.816040    2561 log.go:25] "Validated CRI v1 image API"
Jul 24 16:06:04.817545 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.817529    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 16:06:04.821448 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.821430    2561 fs.go:135] Filesystem UUIDs: map[00de1208-b669-42a5-ac31-5f632a847477:/dev/nvme0n1p4 72b2d95c-2033-4933-9597-358c5cb3d88d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 24 16:06:04.821492 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.821449    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 16:06:04.827172 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.827069    2561 manager.go:216] Machine: {Timestamp:2026-07-24 16:06:04.825759137 +0000 UTC m=+0.310901417 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101176 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e69fad174a5e489811cea7554b2cf SystemUUID:ec2e69fa-d174-a5e4-8981-1cea7554b2cf BootID:0a7e7105-302f-4fc0-87a4-d2d19fcc4aec Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:1c:35:70:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:1c:35:70:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:b2:e9:33:a2:73 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 16:06:04.827172 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.827164    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 16:06:04.827294 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.827243    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 16:06:04.829209 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.829177    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 16:06:04.829903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.829883    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 16:06:04.830029 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.829907    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 16:06:04.831084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.831073    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 16:06:04.831133 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.831086    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 16:06:04.831133 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.831093    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 16:06:04.831679 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.831669    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 16:06:04.833182 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.833172    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 16:06:04.836633 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.836622    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 16:06:04.836740 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.836731    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 16:06:04.836778 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.836759    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 16:06:04.836778 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.836773    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 16:06:04.836847 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.836786    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 16:06:04.836847 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.836795    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 24 16:06:04.836847 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.836803    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 16:06:04.837125 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.837112    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 16:06:04.837155 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.837141    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 16:06:04.839536 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.839520    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 16:06:04.841544 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.841530    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 16:06:04.841601 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.841560    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 16:06:04.843172 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843159    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 16:06:04.843239 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843175    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 16:06:04.843239 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843181    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 16:06:04.843239 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843200    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 16:06:04.843239 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843218    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 16:06:04.843239 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843224    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 16:06:04.843239 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843232    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 16:06:04.843239 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843237    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 16:06:04.843239 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843242    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 16:06:04.843463 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843248    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 16:06:04.843463 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843259    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 16:06:04.843463 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843264    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 16:06:04.843837 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843825    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 16:06:04.843837 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.843834    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 16:06:04.846794 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.846778    2561 server.go:1268] "Started kubelet"
Jul 24 16:06:04.846968 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.846879    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 16:06:04.847071 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.846882    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 16:06:04.847071 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.847016    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 16:06:04.847071 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.847033    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 16:06:04.847229 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.847142    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 16:06:04.847278 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.847259    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 16:06:04.847633 ip-10-0-134-143 systemd[1]: Started Kubernetes Kubelet.
Jul 24 16:06:04.850441 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.850418    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 16:06:04.850940 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.850924    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m62h5"
Jul 24 16:06:04.852124 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.852080    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 16:06:04.852844 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.852825    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 16:06:04.857041 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.857023    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m62h5"
Jul 24 16:06:04.858198 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.857343    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-143.ec2.internal.18c5456db70778e7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-143.ec2.internal,UID:ip-10-0-134-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-143.ec2.internal,},FirstTimestamp:2026-07-24 16:06:04.846741735 +0000 UTC m=+0.331884015,LastTimestamp:2026-07-24 16:06:04.846741735 +0000 UTC m=+0.331884015,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-143.ec2.internal,}"
Jul 24 16:06:04.861221 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.861180    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 16:06:04.861301 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.861206    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 16:06:04.861756 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.861547    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:04.861929 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.861916    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 16:06:04.862027 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.861917    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 16:06:04.862105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.862031    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 16:06:04.862105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.861991    2561 factory.go:55] Registering systemd factory
Jul 24 16:06:04.862105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.862093    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 24 16:06:04.862260 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.862135    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 16:06:04.862260 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.862144    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 16:06:04.862461 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.862440    2561 factory.go:153] Registering CRI-O factory
Jul 24 16:06:04.862461 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.862455    2561 factory.go:223] Registration of the crio container factory successfully
Jul 24 16:06:04.862614 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.862505    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 16:06:04.862614 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.862529    2561 factory.go:103] Registering Raw factory
Jul 24 16:06:04.862614 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.862543    2561 manager.go:1196] Started watching for new ooms in manager
Jul 24 16:06:04.863242 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.863215    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 16:06:04.863331 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.863275    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 16:06:04.863601 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.863586    2561 manager.go:349] Starting recovery of all containers
Jul 24 16:06:04.872446 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.872428    2561 manager.go:354] Recovery completed
Jul 24 16:06:04.876489 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.876474    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:06:04.878314 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.878298    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:06:04.878399 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.878330    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:06:04.878399 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.878346    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:06:04.878881 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.878867    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 16:06:04.878881 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.878878    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:06:04.878964 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.878881    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 16:06:04.878964 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.878909    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 16:06:04.880254 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.880238    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:06:04.880326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.880266    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:06:04.880326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.880275    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:06:04.881292 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.881279    2561 policy_none.go:49] "None policy: Start"
Jul 24 16:06:04.881358 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.881300    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 16:06:04.881358 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.881314    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 16:06:04.882394 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.882381    2561 policy_none.go:47] "Start"
Jul 24 16:06:04.920623 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.920484    2561 manager.go:337] "Starting Device Plugin manager"
Jul 24 16:06:04.920708 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.920660    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 16:06:04.920708 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.920672    2561 server.go:87] "Starting device plugin registration server"
Jul 24 16:06:04.920877 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.920867    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 16:06:04.920930 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.920878    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 16:06:04.920992 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.920971    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 16:06:04.921078 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.921062    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 16:06:04.921078 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.921077    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 16:06:04.921571 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.921549    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 16:06:04.921633 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:04.921609    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:04.999513 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:04.999484    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 16:06:05.000826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.000811    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 16:06:05.000920 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.000845    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 16:06:05.000920 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.000869    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 16:06:05.000920 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.000899    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 16:06:05.002864 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.002843    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:06:05.021853 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.021840    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:06:05.022600 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.022586    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:06:05.022676 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.022613    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:06:05.022676 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.022622    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:06:05.022676 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.022642    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.030307 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.030271    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.030307 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.030291    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-143.ec2.internal\": node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.046697 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.046676    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.101580 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.101540    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"]
Jul 24 16:06:05.101691 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.101633    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:06:05.102742 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.102717    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:06:05.102853 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.102763    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:06:05.102853 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.102780    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:06:05.104608 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.104591    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:06:05.104704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.104682    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.104759 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.104720    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:06:05.105443 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.105428    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:06:05.105534 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.105444    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:06:05.105534 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.105455    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:06:05.105534 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.105464    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:06:05.105534 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.105470    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:06:05.105534 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.105474    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:06:05.106760 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.106736    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.106816 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.106768    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:06:05.107489 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.107470    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:06:05.107583 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.107506    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:06:05.107583 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.107521    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:06:05.132710 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.132693    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-143.ec2.internal\" not found" node="ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.136834 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.136817    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-143.ec2.internal\" not found" node="ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.146871 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.146858    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.163595 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.163575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c29e302b1338537410b67bb59e7a33e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"3c29e302b1338537410b67bb59e7a33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.163665 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.163597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c29e302b1338537410b67bb59e7a33e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"3c29e302b1338537410b67bb59e7a33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.163665 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.163615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/10f0c28ca9cd19ab7159a10a4ec7a08a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-143.ec2.internal\" (UID: \"10f0c28ca9cd19ab7159a10a4ec7a08a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.247945 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.247912    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.264310 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.264284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c29e302b1338537410b67bb59e7a33e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"3c29e302b1338537410b67bb59e7a33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.264427 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.264319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c29e302b1338537410b67bb59e7a33e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"3c29e302b1338537410b67bb59e7a33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.264427 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.264349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/10f0c28ca9cd19ab7159a10a4ec7a08a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-143.ec2.internal\" (UID: \"10f0c28ca9cd19ab7159a10a4ec7a08a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.264427 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.264398    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/10f0c28ca9cd19ab7159a10a4ec7a08a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-143.ec2.internal\" (UID: \"10f0c28ca9cd19ab7159a10a4ec7a08a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.264546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.264401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c29e302b1338537410b67bb59e7a33e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"3c29e302b1338537410b67bb59e7a33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.264546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.264400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c29e302b1338537410b67bb59e7a33e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"3c29e302b1338537410b67bb59e7a33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.348746 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.348665    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.436287 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.436262    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.442738 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.442722    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:05.448968 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.448948    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.549489 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.549461    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.650058 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.650005    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.697634 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.697614    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:06:05.750394 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.750373    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.798020 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.797992    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 16:06:05.798408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.798148    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 16:06:05.798408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.798175    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 16:06:05.850448 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.850422    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:05.862380 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.862353    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 16:01:06 +0000 UTC" deadline="2028-02-03 12:29:03.471056919 +0000 UTC"
Jul 24 16:06:05.862380 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.862378    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13412h22m57.608681761s"
Jul 24 16:06:05.886190 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:05.886173    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:06:05.951295 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:05.951244    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:06.051620 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:06.051588    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:07.652550 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:07.652524    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
Jul 24 16:06:07.690792 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:07.690764    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c29e302b1338537410b67bb59e7a33e.slice/crio-af8ad4f33b365e8d56a0d0cdb24a099f9148bce5937baa870e1c096c4748896a WatchSource:0}: Error finding container af8ad4f33b365e8d56a0d0cdb24a099f9148bce5937baa870e1c096c4748896a: Status 404 returned error can't find the container with id af8ad4f33b365e8d56a0d0cdb24a099f9148bce5937baa870e1c096c4748896a
Jul 24 16:06:07.694859 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:07.694844    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:06:07.715059 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:07.715016    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:06:07.762706 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:07.762686    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:07.771049 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:07.771026    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 16:06:07.772060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:07.772046    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
Jul 24 16:06:07.781452 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:07.781438    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 16:06:08.338287 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.338261    2561 apiserver.go:52] "Watching apiserver"
Jul 24 16:06:08.348587 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.348566    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 16:06:08.350539 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.350512    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-qhhzj","openshift-multus/network-metrics-daemon-qswb4","openshift-network-operator/iptables-alerter-w8wct","kube-system/global-pull-secret-syncer-dscj2","kube-system/konnectivity-agent-swswd","kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz","openshift-cluster-node-tuning-operator/tuned-n6h26","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal","openshift-network-diagnostics/network-check-target-p6ljc","openshift-ovn-kubernetes/ovnkube-node-2jcjx","openshift-dns/node-resolver-9nhx7","openshift-image-registry/node-ca-hgm4t","openshift-multus/multus-7gq5q"]
Jul 24 16:06:08.352420 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.352402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.353505 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.353488    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.354509 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.354493    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 16:06:08.354831 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.354811    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 16:06:08.354935 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.354821    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 16:06:08.354998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.354873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.354998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.354917    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bbfzs\""
Jul 24 16:06:08.355697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.355679    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 16:06:08.355771 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.355701    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 16:06:08.355819 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.355798    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 16:06:08.355916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.355901    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9k9zm\""
Jul 24 16:06:08.356280 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.356265    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.356369 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.356345    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:08.356975 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.356948    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:06:08.356975 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.356971    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wph7q\""
Jul 24 16:06:08.357092 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.356949    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 16:06:08.357500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.357449    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 16:06:08.358361 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.358344    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:08.359730 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.359714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.360445 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.360141    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 16:06:08.360445 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.360232    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6pqng\""
Jul 24 16:06:08.360445 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.360321    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 16:06:08.361299 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.361282    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.361491 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.361467    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 16:06:08.361896 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.361879    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 16:06:08.362015 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.361997    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 16:06:08.362086 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.362002    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zgc57\""
Jul 24 16:06:08.362086 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.362033    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 16:06:08.362086 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.361997    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 16:06:08.362456 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.362440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.363094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.363078    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cvrq5\""
Jul 24 16:06:08.363370 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.363356    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:06:08.363701 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.363624    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 16:06:08.363971 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.363957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:08.364067 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.364029    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:08.364289 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.364272    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 16:06:08.364380 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.364302    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mhk85\""
Jul 24 16:06:08.364380 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.364325    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 16:06:08.365360 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.365345    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:08.365439 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.365401    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:08.366882 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.366868    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.370098 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.369343    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 16:06:08.370098 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.370068    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 16:06:08.370236 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.370079    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 16:06:08.370236 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.370166    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 16:06:08.370236 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.370091    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 16:06:08.370359 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.370292    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.370593 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.370477    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bl26r\""
Jul 24 16:06:08.370707 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.370586    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 16:06:08.372210 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-sysctl-d\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.372210 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-run\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.372210 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-var-lib-cni-multus\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.372381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-var-lib-kubelet\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.372381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29617d35-46b4-4fa4-aa91-c048ca5b9889-dbus\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.372381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac-konnectivity-ca\") pod \"konnectivity-agent-swswd\" (UID: \"2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac\") " pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:08.372381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq9sn\" (UniqueName: \"kubernetes.io/projected/3ac647c5-5c98-4ea5-9db0-3f167aebd396-kube-api-access-rq9sn\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.372381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.372381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-systemd\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.372671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-cni-dir\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.372671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372442    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-run-netns\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.372671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8z7m\" (UniqueName: \"kubernetes.io/projected/e8c1aa89-7d46-4c9c-8e7a-93155b733e35-kube-api-access-d8z7m\") pod \"node-ca-hgm4t\" (UID: \"e8c1aa89-7d46-4c9c-8e7a-93155b733e35\") " pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.372671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-sysctl-conf\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.372671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-sys\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.372671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372564    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 16:06:08.372671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372572    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 16:06:08.372671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-tuned\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.372671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trhz9\" (UniqueName: \"kubernetes.io/projected/b943eabe-3fe7-4b72-b432-acb2e0a999f4-kube-api-access-trhz9\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-sys-fs\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-var-lib-kubelet\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372742    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-host\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-device-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42810a30-7721-4ff6-bbcd-51db8e069a5d-host-slash\") pod \"iptables-alerter-w8wct\" (UID: \"42810a30-7721-4ff6-bbcd-51db8e069a5d\") " pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372825    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bc7wh\""
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-os-release\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372857    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-hostroot\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-etc-kubernetes\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-registration-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-run-k8s-cni-cncf-io\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/773b8c84-0c85-4980-b49e-f79e426c17f5-tmp\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-system-cni-dir\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.372998    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-run-multus-certs\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373011    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-os-release\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.373083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32537f3f-042f-4d3f-9b9d-722cb26ef475-cni-binary-copy\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373047    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac-agent-certs\") pod \"konnectivity-agent-swswd\" (UID: \"2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac\") " pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-var-lib-cni-bin\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-conf-dir\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42810a30-7721-4ff6-bbcd-51db8e069a5d-iptables-alerter-script\") pod \"iptables-alerter-w8wct\" (UID: \"42810a30-7721-4ff6-bbcd-51db8e069a5d\") " pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-modprobe-d\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-cnibin\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-cni-binary-copy\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-socket-dir-parent\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373290    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32537f3f-042f-4d3f-9b9d-722cb26ef475-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-lib-modules\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-system-cni-dir\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njqsl\" (UniqueName: \"kubernetes.io/projected/32537f3f-042f-4d3f-9b9d-722cb26ef475-kube-api-access-njqsl\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e8c1aa89-7d46-4c9c-8e7a-93155b733e35-serviceca\") pod \"node-ca-hgm4t\" (UID: \"e8c1aa89-7d46-4c9c-8e7a-93155b733e35\") " pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-kubelet-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.373893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-socket-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-726mw\" (UniqueName: \"kubernetes.io/projected/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-kube-api-access-726mw\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29617d35-46b4-4fa4-aa91-c048ca5b9889-kubelet-config\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-kubernetes\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373516    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v459\" (UniqueName: \"kubernetes.io/projected/773b8c84-0c85-4980-b49e-f79e426c17f5-kube-api-access-6v459\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373538    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-etc-selinux\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8c1aa89-7d46-4c9c-8e7a-93155b733e35-host\") pod \"node-ca-hgm4t\" (UID: \"e8c1aa89-7d46-4c9c-8e7a-93155b733e35\") " pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc59r\" (UniqueName: \"kubernetes.io/projected/42810a30-7721-4ff6-bbcd-51db8e069a5d-kube-api-access-lc59r\") pod \"iptables-alerter-w8wct\" (UID: \"42810a30-7721-4ff6-bbcd-51db8e069a5d\") " pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-daemon-config\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-cnibin\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32537f3f-042f-4d3f-9b9d-722cb26ef475-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.374668 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.373688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-sysconfig\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.375251 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.374764    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 16:06:08.397251 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.397235    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4f6fz"
Jul 24 16:06:08.404903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.404854    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4f6fz"
Jul 24 16:06:08.464402 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.464378    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 16:06:08.474403 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v459\" (UniqueName: \"kubernetes.io/projected/773b8c84-0c85-4980-b49e-f79e426c17f5-kube-api-access-6v459\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.474403 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474365    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-ovn-node-metrics-cert\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.474671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-ovnkube-script-lib\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.474671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-etc-selinux\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.474671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474608    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8c1aa89-7d46-4c9c-8e7a-93155b733e35-host\") pod \"node-ca-hgm4t\" (UID: \"e8c1aa89-7d46-4c9c-8e7a-93155b733e35\") " pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.474671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474632    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc59r\" (UniqueName: \"kubernetes.io/projected/42810a30-7721-4ff6-bbcd-51db8e069a5d-kube-api-access-lc59r\") pod \"iptables-alerter-w8wct\" (UID: \"42810a30-7721-4ff6-bbcd-51db8e069a5d\") " pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-daemon-config\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-cnibin\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32537f3f-042f-4d3f-9b9d-722cb26ef475-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8c1aa89-7d46-4c9c-8e7a-93155b733e35-host\") pod \"node-ca-hgm4t\" (UID: \"e8c1aa89-7d46-4c9c-8e7a-93155b733e35\") " pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474739    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-etc-selinux\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-slash\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474771    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-cnibin\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-sysconfig\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-sysctl-d\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-run\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-var-lib-cni-multus\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.474855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-sysconfig\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-var-lib-kubelet\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474896    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-etc-openvswitch\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29617d35-46b4-4fa4-aa91-c048ca5b9889-dbus\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-run\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-sysctl-d\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac-konnectivity-ca\") pod \"konnectivity-agent-swswd\" (UID: \"2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac\") " pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-var-lib-kubelet\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-var-lib-cni-multus\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.474995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-run-netns\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475064    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-ovnkube-config\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475079    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29617d35-46b4-4fa4-aa91-c048ca5b9889-dbus\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475087    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-env-overrides\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7813417e-8bc8-443d-840b-659310daa0ee-hosts-file\") pod \"node-resolver-9nhx7\" (UID: \"7813417e-8bc8-443d-840b-659310daa0ee\") " pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475137    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq9sn\" (UniqueName: \"kubernetes.io/projected/3ac647c5-5c98-4ea5-9db0-3f167aebd396-kube-api-access-rq9sn\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-systemd\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.475444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475218    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-cni-dir\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-run-netns\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.475247    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475255    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-systemd\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-systemd-units\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475288    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-run-ovn\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.475313    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret podName:29617d35-46b4-4fa4-aa91-c048ca5b9889 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:08.97529406 +0000 UTC m=+2.959984835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret") pod "global-pull-secret-syncer-dscj2" (UID: "29617d35-46b4-4fa4-aa91-c048ca5b9889") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475312    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-cni-dir\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-run-netns\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-daemon-config\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8z7m\" (UniqueName: \"kubernetes.io/projected/e8c1aa89-7d46-4c9c-8e7a-93155b733e35-kube-api-access-d8z7m\") pod \"node-ca-hgm4t\" (UID: \"e8c1aa89-7d46-4c9c-8e7a-93155b733e35\") " pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-sysctl-conf\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32537f3f-042f-4d3f-9b9d-722cb26ef475-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-sys\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-tuned\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trhz9\" (UniqueName: \"kubernetes.io/projected/b943eabe-3fe7-4b72-b432-acb2e0a999f4-kube-api-access-trhz9\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-sys\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.476267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjr9b\" (UniqueName: \"kubernetes.io/projected/7813417e-8bc8-443d-840b-659310daa0ee-kube-api-access-mjr9b\") pod \"node-resolver-9nhx7\" (UID: \"7813417e-8bc8-443d-840b-659310daa0ee\") " pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475506    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-sysctl-conf\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-sys-fs\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-var-lib-kubelet\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475598    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-host\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-run-systemd\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac-konnectivity-ca\") pod \"konnectivity-agent-swswd\" (UID: \"2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac\") " pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-var-lib-kubelet\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475655    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-sys-fs\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475695    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-host\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-run-openvswitch\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-cni-netd\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-device-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42810a30-7721-4ff6-bbcd-51db8e069a5d-host-slash\") pod \"iptables-alerter-w8wct\" (UID: \"42810a30-7721-4ff6-bbcd-51db8e069a5d\") " pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-os-release\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-hostroot\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475857    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-device-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.477094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-etc-kubernetes\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475909    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-registration-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-run-k8s-cni-cncf-io\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475985    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-os-release\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.475992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/773b8c84-0c85-4980-b49e-f79e426c17f5-tmp\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476021    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42810a30-7721-4ff6-bbcd-51db8e069a5d-host-slash\") pod \"iptables-alerter-w8wct\" (UID: \"42810a30-7721-4ff6-bbcd-51db8e069a5d\") " pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-system-cni-dir\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-run-multus-certs\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476062    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-run-k8s-cni-cncf-io\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-hostroot\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-os-release\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476145    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-run-multus-certs\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476151    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-etc-kubernetes\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476162    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32537f3f-042f-4d3f-9b9d-722cb26ef475-cni-binary-copy\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476169    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476183    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.477893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-system-cni-dir\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-cni-bin\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac-agent-certs\") pod \"konnectivity-agent-swswd\" (UID: \"2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac\") " pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476278    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-registration-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-var-lib-cni-bin\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476245    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-os-release\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-conf-dir\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476355    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-kubelet\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.476373    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42810a30-7721-4ff6-bbcd-51db8e069a5d-iptables-alerter-script\") pod \"iptables-alerter-w8wct\" (UID: \"42810a30-7721-4ff6-bbcd-51db8e069a5d\") " pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-modprobe-d\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.476425    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs podName:b943eabe-3fe7-4b72-b432-acb2e0a999f4 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:08.976408257 +0000 UTC m=+2.961099031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs") pod "network-metrics-daemon-qswb4" (UID: "b943eabe-3fe7-4b72-b432-acb2e0a999f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-host-var-lib-cni-bin\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-modprobe-d\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-conf-dir\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-cnibin\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.478386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-cni-binary-copy\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476692    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32537f3f-042f-4d3f-9b9d-722cb26ef475-cni-binary-copy\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-socket-dir-parent\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32537f3f-042f-4d3f-9b9d-722cb26ef475-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-multus-socket-dir-parent\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-var-lib-openvswitch\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476820    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-log-socket\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-lib-modules\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-system-cni-dir\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njqsl\" (UniqueName: \"kubernetes.io/projected/32537f3f-042f-4d3f-9b9d-722cb26ef475-kube-api-access-njqsl\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-run-ovn-kubernetes\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e8c1aa89-7d46-4c9c-8e7a-93155b733e35-serviceca\") pod \"node-ca-hgm4t\" (UID: \"e8c1aa89-7d46-4c9c-8e7a-93155b733e35\") " pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.476990    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-kubelet-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-socket-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42810a30-7721-4ff6-bbcd-51db8e069a5d-iptables-alerter-script\") pod \"iptables-alerter-w8wct\" (UID: \"42810a30-7721-4ff6-bbcd-51db8e069a5d\") " pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.479005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-726mw\" (UniqueName: \"kubernetes.io/projected/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-kube-api-access-726mw\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477108    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-969sn\" (UniqueName: \"kubernetes.io/projected/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-kube-api-access-969sn\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477134    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32537f3f-042f-4d3f-9b9d-722cb26ef475-system-cni-dir\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32537f3f-042f-4d3f-9b9d-722cb26ef475-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-kubelet-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477288    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ac647c5-5c98-4ea5-9db0-3f167aebd396-socket-dir\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477287    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-lib-modules\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-node-log\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7813417e-8bc8-443d-840b-659310daa0ee-tmp-dir\") pod \"node-resolver-9nhx7\" (UID: \"7813417e-8bc8-443d-840b-659310daa0ee\") " pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29617d35-46b4-4fa4-aa91-c048ca5b9889-kubelet-config\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-kubernetes\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477708    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e8c1aa89-7d46-4c9c-8e7a-93155b733e35-serviceca\") pod \"node-ca-hgm4t\" (UID: \"e8c1aa89-7d46-4c9c-8e7a-93155b733e35\") " pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477717    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-kubernetes\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477749    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-cni-binary-copy\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477760    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29617d35-46b4-4fa4-aa91-c048ca5b9889-kubelet-config\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.477811    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-cnibin\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.479181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/773b8c84-0c85-4980-b49e-f79e426c17f5-etc-tuned\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.479500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.479192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/773b8c84-0c85-4980-b49e-f79e426c17f5-tmp\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.480327 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.480236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac-agent-certs\") pod \"konnectivity-agent-swswd\" (UID: \"2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac\") " pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:08.482690 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.482660    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v459\" (UniqueName: \"kubernetes.io/projected/773b8c84-0c85-4980-b49e-f79e426c17f5-kube-api-access-6v459\") pod \"tuned-n6h26\" (UID: \"773b8c84-0c85-4980-b49e-f79e426c17f5\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.487861 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.487834    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq9sn\" (UniqueName: \"kubernetes.io/projected/3ac647c5-5c98-4ea5-9db0-3f167aebd396-kube-api-access-rq9sn\") pod \"aws-ebs-csi-driver-node-84gzz\" (UID: \"3ac647c5-5c98-4ea5-9db0-3f167aebd396\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.489590 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.489561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc59r\" (UniqueName: \"kubernetes.io/projected/42810a30-7721-4ff6-bbcd-51db8e069a5d-kube-api-access-lc59r\") pod \"iptables-alerter-w8wct\" (UID: \"42810a30-7721-4ff6-bbcd-51db8e069a5d\") " pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.489862 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.489839    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trhz9\" (UniqueName: \"kubernetes.io/projected/b943eabe-3fe7-4b72-b432-acb2e0a999f4-kube-api-access-trhz9\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:08.490569 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.490548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8z7m\" (UniqueName: \"kubernetes.io/projected/e8c1aa89-7d46-4c9c-8e7a-93155b733e35-kube-api-access-d8z7m\") pod \"node-ca-hgm4t\" (UID: \"e8c1aa89-7d46-4c9c-8e7a-93155b733e35\") " pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.490657 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.490564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-726mw\" (UniqueName: \"kubernetes.io/projected/c10afac7-1ff4-4eac-9a77-c47a4e7e4698-kube-api-access-726mw\") pod \"multus-7gq5q\" (UID: \"c10afac7-1ff4-4eac-9a77-c47a4e7e4698\") " pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.492488 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.492465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njqsl\" (UniqueName: \"kubernetes.io/projected/32537f3f-042f-4d3f-9b9d-722cb26ef475-kube-api-access-njqsl\") pod \"multus-additional-cni-plugins-qhhzj\" (UID: \"32537f3f-042f-4d3f-9b9d-722cb26ef475\") " pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.506701 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.506615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal" event={"ID":"10f0c28ca9cd19ab7159a10a4ec7a08a","Type":"ContainerStarted","Data":"f6c8322a2070248317d02502dc514b52b3d24fbfbda02162290c394bfd5bd4b0"}
Jul 24 16:06:08.508412 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.508383    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal" event={"ID":"3c29e302b1338537410b67bb59e7a33e","Type":"ContainerStarted","Data":"af8ad4f33b365e8d56a0d0cdb24a099f9148bce5937baa870e1c096c4748896a"}
Jul 24 16:06:08.578819 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.578763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-ovn-node-metrics-cert\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.578819 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.578803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-ovnkube-script-lib\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579009 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.578831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-slash\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579009 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.578858    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-etc-openvswitch\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579009 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.578883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-run-netns\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579009 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.578905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-ovnkube-config\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579009 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.578927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-env-overrides\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579009 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.578949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7813417e-8bc8-443d-840b-659310daa0ee-hosts-file\") pod \"node-resolver-9nhx7\" (UID: \"7813417e-8bc8-443d-840b-659310daa0ee\") " pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.579009 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.578987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-systemd-units\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-run-ovn\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjr9b\" (UniqueName: \"kubernetes.io/projected/7813417e-8bc8-443d-840b-659310daa0ee-kube-api-access-mjr9b\") pod \"node-resolver-9nhx7\" (UID: \"7813417e-8bc8-443d-840b-659310daa0ee\") " pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-run-systemd\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-run-openvswitch\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-cni-netd\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-cni-bin\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-kubelet\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-var-lib-openvswitch\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-log-socket\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579780 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-run-ovn-kubernetes\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579780 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579780 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-969sn\" (UniqueName: \"kubernetes.io/projected/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-kube-api-access-969sn\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579780 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579376    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-node-log\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.579780 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7813417e-8bc8-443d-840b-659310daa0ee-tmp-dir\") pod \"node-resolver-9nhx7\" (UID: \"7813417e-8bc8-443d-840b-659310daa0ee\") " pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.579780 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.579738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7813417e-8bc8-443d-840b-659310daa0ee-tmp-dir\") pod \"node-resolver-9nhx7\" (UID: \"7813417e-8bc8-443d-840b-659310daa0ee\") " pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.580146 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580125    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-run-systemd\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580200 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-var-lib-openvswitch\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580253 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580210    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-run-openvswitch\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580253 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-cni-netd\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580476 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-cni-bin\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580538 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-kubelet\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580713 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580666    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-ovnkube-script-lib\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580773 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7813417e-8bc8-443d-840b-659310daa0ee-hosts-file\") pod \"node-resolver-9nhx7\" (UID: \"7813417e-8bc8-443d-840b-659310daa0ee\") " pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.580821 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-systemd-units\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580821 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-env-overrides\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580896 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580828    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-run-ovn\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580896 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-run-netns\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580896 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-slash\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.580896 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.580887    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-etc-openvswitch\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.581154 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.581128    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.581221 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.581190    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-log-socket\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.581221 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.581193    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-ovnkube-config\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.581314 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.581222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-host-run-ovn-kubernetes\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.581314 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.581257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-node-log\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.583468 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.583444    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-ovn-node-metrics-cert\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.586151 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.586132    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:08.586243 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.586157    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:08.586243 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.586170    2561 projected.go:196] Error preparing data for projected volume kube-api-access-vqm5h for pod openshift-network-diagnostics/network-check-target-p6ljc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:08.586345 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.586246    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h podName:fb1b162b-4e8a-466f-b0a2-338211930ca7 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:09.086221489 +0000 UTC m=+3.070912250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vqm5h" (UniqueName: "kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h") pod "network-check-target-p6ljc" (UID: "fb1b162b-4e8a-466f-b0a2-338211930ca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:08.589062 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.589010    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-969sn\" (UniqueName: \"kubernetes.io/projected/e4e7eb47-105e-4fcb-9576-45ab5d39cc83-kube-api-access-969sn\") pod \"ovnkube-node-2jcjx\" (UID: \"e4e7eb47-105e-4fcb-9576-45ab5d39cc83\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.591137 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.591117    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjr9b\" (UniqueName: \"kubernetes.io/projected/7813417e-8bc8-443d-840b-659310daa0ee-kube-api-access-mjr9b\") pod \"node-resolver-9nhx7\" (UID: \"7813417e-8bc8-443d-840b-659310daa0ee\") " pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.663379 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.663351    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz"
Jul 24 16:06:08.668738 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.668702    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hgm4t"
Jul 24 16:06:08.673576 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:08.673552    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac647c5_5c98_4ea5_9db0_3f167aebd396.slice/crio-326a7987283a97da9dcb81146730da092b14a49d9cb670820c1a308511fc49f5 WatchSource:0}: Error finding container 326a7987283a97da9dcb81146730da092b14a49d9cb670820c1a308511fc49f5: Status 404 returned error can't find the container with id 326a7987283a97da9dcb81146730da092b14a49d9cb670820c1a308511fc49f5
Jul 24 16:06:08.678714 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.678695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w8wct"
Jul 24 16:06:08.681233 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:08.681201    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c1aa89_7d46_4c9c_8e7a_93155b733e35.slice/crio-2fc07780f6fe3b23278b0d898e4cfb87ac74aaf6ec2b373299446d12ae670eb0 WatchSource:0}: Error finding container 2fc07780f6fe3b23278b0d898e4cfb87ac74aaf6ec2b373299446d12ae670eb0: Status 404 returned error can't find the container with id 2fc07780f6fe3b23278b0d898e4cfb87ac74aaf6ec2b373299446d12ae670eb0
Jul 24 16:06:08.681300 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.681275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:08.687089 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.687070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7gq5q"
Jul 24 16:06:08.692292 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.692276    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6h26"
Jul 24 16:06:08.696673 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.696514    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qhhzj"
Jul 24 16:06:08.698686 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:08.698370    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac2a9d1_5ea3_44e2_98d5_1615d3c528ac.slice/crio-9cddf1328d273b163a38b87543d45c03d892dd7f319ab52fd9d3eec2dd6452ea WatchSource:0}: Error finding container 9cddf1328d273b163a38b87543d45c03d892dd7f319ab52fd9d3eec2dd6452ea: Status 404 returned error can't find the container with id 9cddf1328d273b163a38b87543d45c03d892dd7f319ab52fd9d3eec2dd6452ea
Jul 24 16:06:08.701122 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:08.700881    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10afac7_1ff4_4eac_9a77_c47a4e7e4698.slice/crio-6688037dabb183711e6e5c4126f11ece2d84c1c8677572b9b638acaec644e22f WatchSource:0}: Error finding container 6688037dabb183711e6e5c4126f11ece2d84c1c8677572b9b638acaec644e22f: Status 404 returned error can't find the container with id 6688037dabb183711e6e5c4126f11ece2d84c1c8677572b9b638acaec644e22f
Jul 24 16:06:08.703072 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.701872    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:08.703072 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:08.702975    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42810a30_7721_4ff6_bbcd_51db8e069a5d.slice/crio-b64c898dd225a29011d84c444888301f8af30d5f6255e14b1caa16832498a531 WatchSource:0}: Error finding container b64c898dd225a29011d84c444888301f8af30d5f6255e14b1caa16832498a531: Status 404 returned error can't find the container with id b64c898dd225a29011d84c444888301f8af30d5f6255e14b1caa16832498a531
Jul 24 16:06:08.706876 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.706738    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nhx7"
Jul 24 16:06:08.713003 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:08.712981    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32537f3f_042f_4d3f_9b9d_722cb26ef475.slice/crio-6cf3e48eb518f3ad6eed66608cf517061658a66ea88632915055ee08d92386fc WatchSource:0}: Error finding container 6cf3e48eb518f3ad6eed66608cf517061658a66ea88632915055ee08d92386fc: Status 404 returned error can't find the container with id 6cf3e48eb518f3ad6eed66608cf517061658a66ea88632915055ee08d92386fc
Jul 24 16:06:08.720909 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:08.720887    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773b8c84_0c85_4980_b49e_f79e426c17f5.slice/crio-54c99c58effd3b146b6b69d003c27255be606565a71a48c5c6509d8758d549b1 WatchSource:0}: Error finding container 54c99c58effd3b146b6b69d003c27255be606565a71a48c5c6509d8758d549b1: Status 404 returned error can't find the container with id 54c99c58effd3b146b6b69d003c27255be606565a71a48c5c6509d8758d549b1
Jul 24 16:06:08.725498 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:08.725479    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7813417e_8bc8_443d_840b_659310daa0ee.slice/crio-f4092e1bcb61865628317d2a929034bafa31dd176f28ea98f9908452c7604c67 WatchSource:0}: Error finding container f4092e1bcb61865628317d2a929034bafa31dd176f28ea98f9908452c7604c67: Status 404 returned error can't find the container with id f4092e1bcb61865628317d2a929034bafa31dd176f28ea98f9908452c7604c67
Jul 24 16:06:08.728233 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:08.728163    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e7eb47_105e_4fcb_9576_45ab5d39cc83.slice/crio-139ec5c7145219c728511c5f0e964555a4d52978d3c3b07eb93a4cc44bc901fd WatchSource:0}: Error finding container 139ec5c7145219c728511c5f0e964555a4d52978d3c3b07eb93a4cc44bc901fd: Status 404 returned error can't find the container with id 139ec5c7145219c728511c5f0e964555a4d52978d3c3b07eb93a4cc44bc901fd
Jul 24 16:06:08.829875 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.829843    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:06:08.981962 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.981934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:08.982097 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:08.981989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:08.982097 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.982090    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:08.982097 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.982090    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:08.982226 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.982149    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs podName:b943eabe-3fe7-4b72-b432-acb2e0a999f4 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:09.982132349 +0000 UTC m=+3.966823109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs") pod "network-metrics-daemon-qswb4" (UID: "b943eabe-3fe7-4b72-b432-acb2e0a999f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:08.982226 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:08.982190    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret podName:29617d35-46b4-4fa4-aa91-c048ca5b9889 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:09.982162862 +0000 UTC m=+3.966853635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret") pod "global-pull-secret-syncer-dscj2" (UID: "29617d35-46b4-4fa4-aa91-c048ca5b9889") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:09.182670 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.182625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:09.182843 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:09.182789    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:09.182843 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:09.182813    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:09.182843 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:09.182828    2561 projected.go:196] Error preparing data for projected volume kube-api-access-vqm5h for pod openshift-network-diagnostics/network-check-target-p6ljc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:09.183014 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:09.182875    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h podName:fb1b162b-4e8a-466f-b0a2-338211930ca7 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:10.18286113 +0000 UTC m=+4.167551889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqm5h" (UniqueName: "kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h") pod "network-check-target-p6ljc" (UID: "fb1b162b-4e8a-466f-b0a2-338211930ca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:09.206398 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.206319    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:06:09.407856 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.407812    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:01:08 +0000 UTC" deadline="2028-04-26 20:14:21.291395588 +0000 UTC"
Jul 24 16:06:09.407856 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.407852    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15412h8m11.88354768s"
Jul 24 16:06:09.520361 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.520275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" event={"ID":"e4e7eb47-105e-4fcb-9576-45ab5d39cc83","Type":"ContainerStarted","Data":"139ec5c7145219c728511c5f0e964555a4d52978d3c3b07eb93a4cc44bc901fd"}
Jul 24 16:06:09.539244 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.539154    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6h26" event={"ID":"773b8c84-0c85-4980-b49e-f79e426c17f5","Type":"ContainerStarted","Data":"54c99c58effd3b146b6b69d003c27255be606565a71a48c5c6509d8758d549b1"}
Jul 24 16:06:09.541833 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.541802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7gq5q" event={"ID":"c10afac7-1ff4-4eac-9a77-c47a4e7e4698","Type":"ContainerStarted","Data":"6688037dabb183711e6e5c4126f11ece2d84c1c8677572b9b638acaec644e22f"}
Jul 24 16:06:09.544489 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.544430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w8wct" event={"ID":"42810a30-7721-4ff6-bbcd-51db8e069a5d","Type":"ContainerStarted","Data":"b64c898dd225a29011d84c444888301f8af30d5f6255e14b1caa16832498a531"}
Jul 24 16:06:09.546315 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.546273    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swswd" event={"ID":"2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac","Type":"ContainerStarted","Data":"9cddf1328d273b163a38b87543d45c03d892dd7f319ab52fd9d3eec2dd6452ea"}
Jul 24 16:06:09.550205 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.550179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hgm4t" event={"ID":"e8c1aa89-7d46-4c9c-8e7a-93155b733e35","Type":"ContainerStarted","Data":"2fc07780f6fe3b23278b0d898e4cfb87ac74aaf6ec2b373299446d12ae670eb0"}
Jul 24 16:06:09.555205 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.555170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nhx7" event={"ID":"7813417e-8bc8-443d-840b-659310daa0ee","Type":"ContainerStarted","Data":"f4092e1bcb61865628317d2a929034bafa31dd176f28ea98f9908452c7604c67"}
Jul 24 16:06:09.557126 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.557093    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" event={"ID":"32537f3f-042f-4d3f-9b9d-722cb26ef475","Type":"ContainerStarted","Data":"6cf3e48eb518f3ad6eed66608cf517061658a66ea88632915055ee08d92386fc"}
Jul 24 16:06:09.559458 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.559429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz" event={"ID":"3ac647c5-5c98-4ea5-9db0-3f167aebd396","Type":"ContainerStarted","Data":"326a7987283a97da9dcb81146730da092b14a49d9cb670820c1a308511fc49f5"}
Jul 24 16:06:09.990170 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.990110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:09.990357 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:09.990179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:09.990357 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:09.990320    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:09.990474 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:09.990379    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret podName:29617d35-46b4-4fa4-aa91-c048ca5b9889 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:11.990361647 +0000 UTC m=+5.975052419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret") pod "global-pull-secret-syncer-dscj2" (UID: "29617d35-46b4-4fa4-aa91-c048ca5b9889") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:09.991111 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:09.990784    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:09.991111 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:09.990834    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs podName:b943eabe-3fe7-4b72-b432-acb2e0a999f4 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:11.990818726 +0000 UTC m=+5.975509485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs") pod "network-metrics-daemon-qswb4" (UID: "b943eabe-3fe7-4b72-b432-acb2e0a999f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:10.191513 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:10.191477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:10.191695 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:10.191676    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:10.191695 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:10.191695    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:10.191799 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:10.191708    2561 projected.go:196] Error preparing data for projected volume kube-api-access-vqm5h for pod openshift-network-diagnostics/network-check-target-p6ljc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:10.191799 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:10.191766    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h podName:fb1b162b-4e8a-466f-b0a2-338211930ca7 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:12.1917475 +0000 UTC m=+6.176438262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqm5h" (UniqueName: "kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h") pod "network-check-target-p6ljc" (UID: "fb1b162b-4e8a-466f-b0a2-338211930ca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:10.408570 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:10.408485    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:01:08 +0000 UTC" deadline="2028-01-27 04:20:32.416146282 +0000 UTC"
Jul 24 16:06:10.408570 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:10.408540    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13236h14m22.007610581s"
Jul 24 16:06:10.504683 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:10.504551    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:10.504683 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:10.504665    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:10.504961 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:10.504943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:10.505069 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:10.505048    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:10.505121 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:10.505078    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:10.505196 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:10.505176    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:12.006653 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:12.006603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:12.007112 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:12.006691    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:12.007112 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.006828    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:12.007112 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.006891    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs podName:b943eabe-3fe7-4b72-b432-acb2e0a999f4 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:16.00687156 +0000 UTC m=+9.991562336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs") pod "network-metrics-daemon-qswb4" (UID: "b943eabe-3fe7-4b72-b432-acb2e0a999f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:12.007112 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.006955    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:12.007112 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.006989    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret podName:29617d35-46b4-4fa4-aa91-c048ca5b9889 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:16.006978419 +0000 UTC m=+9.991669183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret") pod "global-pull-secret-syncer-dscj2" (UID: "29617d35-46b4-4fa4-aa91-c048ca5b9889") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:12.208112 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:12.208075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:12.208338 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.208233    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:12.208338 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.208252    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:12.208338 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.208265    2561 projected.go:196] Error preparing data for projected volume kube-api-access-vqm5h for pod openshift-network-diagnostics/network-check-target-p6ljc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:12.208338 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.208319    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h podName:fb1b162b-4e8a-466f-b0a2-338211930ca7 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:16.208302355 +0000 UTC m=+10.192993117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqm5h" (UniqueName: "kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h") pod "network-check-target-p6ljc" (UID: "fb1b162b-4e8a-466f-b0a2-338211930ca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:12.502767 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:12.502737    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:12.502940 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.502878    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:12.505347 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:12.505325    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:12.505483 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.505434    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:12.505542 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:12.505488    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:12.505589 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:12.505578    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:14.503964 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:14.503928    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:14.503964 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:14.503964    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:14.504442 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:14.504090    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:14.504579 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:14.504547    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:14.504579 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:14.504572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:14.504783 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:14.504705    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:16.038778 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:16.038744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:16.039118 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:16.038822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:16.039118 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.038944    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:16.039118 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.039004    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs podName:b943eabe-3fe7-4b72-b432-acb2e0a999f4 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:24.038983497 +0000 UTC m=+18.023674260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs") pod "network-metrics-daemon-qswb4" (UID: "b943eabe-3fe7-4b72-b432-acb2e0a999f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:16.039357 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.039343    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:16.039396 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.039385    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret podName:29617d35-46b4-4fa4-aa91-c048ca5b9889 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:24.039374685 +0000 UTC m=+18.024065444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret") pod "global-pull-secret-syncer-dscj2" (UID: "29617d35-46b4-4fa4-aa91-c048ca5b9889") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:16.240473 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:16.240324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:16.240659 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.240500    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:16.240659 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.240526    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:16.240659 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.240548    2561 projected.go:196] Error preparing data for projected volume kube-api-access-vqm5h for pod openshift-network-diagnostics/network-check-target-p6ljc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:16.240659 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.240609    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h podName:fb1b162b-4e8a-466f-b0a2-338211930ca7 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:24.240589861 +0000 UTC m=+18.225280623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqm5h" (UniqueName: "kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h") pod "network-check-target-p6ljc" (UID: "fb1b162b-4e8a-466f-b0a2-338211930ca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:16.502701 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:16.502617    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:16.502701 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:16.502676    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:16.502701 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:16.502618    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:16.502964 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.502852    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:16.502964 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.502877    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:16.503068 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:16.502973    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:18.506034 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:18.505997    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:18.506451 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:18.506008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:18.506451 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:18.506122    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:18.506451 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:18.506133    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:18.506451 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:18.506226    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:18.506451 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:18.506300    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:20.504722 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:20.504531    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:20.504722 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:20.504668    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:20.504722 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:20.504672    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:20.504722 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:20.504679    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:20.505223 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:20.504775    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:20.505312 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:20.505274    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:22.502524 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:22.502491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:22.502975 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:22.502491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:22.502975 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:22.502650    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:22.502975 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:22.502491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:22.502975 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:22.502680    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:22.502975 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:22.502745    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:24.096233 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:24.095682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:24.096233 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:24.095739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:24.096233 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.095845    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:24.096233 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.095851    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:24.096233 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.095911    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret podName:29617d35-46b4-4fa4-aa91-c048ca5b9889 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:40.095893212 +0000 UTC m=+34.080583971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret") pod "global-pull-secret-syncer-dscj2" (UID: "29617d35-46b4-4fa4-aa91-c048ca5b9889") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:24.096233 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.095930    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs podName:b943eabe-3fe7-4b72-b432-acb2e0a999f4 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:40.095920453 +0000 UTC m=+34.080611224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs") pod "network-metrics-daemon-qswb4" (UID: "b943eabe-3fe7-4b72-b432-acb2e0a999f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:24.296595 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:24.296551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:24.296789 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.296746    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:24.296789 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.296768    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:24.296789 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.296780    2561 projected.go:196] Error preparing data for projected volume kube-api-access-vqm5h for pod openshift-network-diagnostics/network-check-target-p6ljc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:24.296926 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.296851    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h podName:fb1b162b-4e8a-466f-b0a2-338211930ca7 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:40.296832777 +0000 UTC m=+34.281523560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqm5h" (UniqueName: "kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h") pod "network-check-target-p6ljc" (UID: "fb1b162b-4e8a-466f-b0a2-338211930ca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:24.503349 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:24.501567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:24.503349 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:24.501576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:24.503349 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.501700    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:24.503349 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:24.501712    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:24.503349 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.501826    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:24.503349 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:24.501914    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:26.503305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:26.503275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:26.503788 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:26.503382    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:26.503788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:26.503397    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:26.503788 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:26.503519    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:26.503788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:26.503565    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:26.503788 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:26.503632    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:28.501857 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.501528    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:28.502277 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.501754    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:28.502277 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.502002    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:28.502277 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:28.502003    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:28.502277 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:28.502106    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:28.502277 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:28.502225    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:28.598564 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.598533    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal" event={"ID":"10f0c28ca9cd19ab7159a10a4ec7a08a","Type":"ContainerStarted","Data":"41f3428d8753629bc3ebff170e5f966448c036c05c7c8aa13f8bc27757ebc955"}
Jul 24 16:06:28.600368 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.600341    2561 generic.go:356] "Generic (PLEG): container finished" podID="3c29e302b1338537410b67bb59e7a33e" containerID="b371c7bb27a138832d61c4396b5185f6dcd72ba96c9ac7232a11d056f0b95f94" exitCode=0
Jul 24 16:06:28.600470 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.600401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal" event={"ID":"3c29e302b1338537410b67bb59e7a33e","Type":"ContainerDied","Data":"b371c7bb27a138832d61c4396b5185f6dcd72ba96c9ac7232a11d056f0b95f94"}
Jul 24 16:06:28.603142 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.603105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" event={"ID":"e4e7eb47-105e-4fcb-9576-45ab5d39cc83","Type":"ContainerStarted","Data":"3832faed903c3af4341b9f77df4dfaff5b1800c330b6bc0e2e257597fc286aba"}
Jul 24 16:06:28.603250 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.603192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" event={"ID":"e4e7eb47-105e-4fcb-9576-45ab5d39cc83","Type":"ContainerStarted","Data":"0df1cd67091e4de2a8e16b25cbc816dbdf1ba3b98675eebede61dd0ea0c4cb85"}
Jul 24 16:06:28.603250 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.603235    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" event={"ID":"e4e7eb47-105e-4fcb-9576-45ab5d39cc83","Type":"ContainerStarted","Data":"70c6f37d8c64482389c171b940406b61dc2f0df3401d9f8a943f6e4a3317e4ce"}
Jul 24 16:06:28.603354 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.603271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" event={"ID":"e4e7eb47-105e-4fcb-9576-45ab5d39cc83","Type":"ContainerStarted","Data":"810c06c9a2bbdce9a8d53ff375a4c16f83d1f7d2e126c02f29b4469f47b309a0"}
Jul 24 16:06:28.604632 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.604609    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6h26" event={"ID":"773b8c84-0c85-4980-b49e-f79e426c17f5","Type":"ContainerStarted","Data":"03f1cb084e36d7910ad8004fae35eba919c0b339987e462b2bf589c9b0e7dc01"}
Jul 24 16:06:28.605858 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.605839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7gq5q" event={"ID":"c10afac7-1ff4-4eac-9a77-c47a4e7e4698","Type":"ContainerStarted","Data":"5614a471662bff348dc5485e234416adc9e7347eb7618798b03ea3e391f5e78d"}
Jul 24 16:06:28.607099 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.607078    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swswd" event={"ID":"2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac","Type":"ContainerStarted","Data":"ec6bcd576d41a9e643194e9a6bd1669bc581152ab0d5a2a2dfd5d7ad72ab50aa"}
Jul 24 16:06:28.608405 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.608384    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hgm4t" event={"ID":"e8c1aa89-7d46-4c9c-8e7a-93155b733e35","Type":"ContainerStarted","Data":"dcf9c71f30c3a726953b89f0ef669f1d098d5355289e23b8b16ed8c83d935509"}
Jul 24 16:06:28.609825 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.609805    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nhx7" event={"ID":"7813417e-8bc8-443d-840b-659310daa0ee","Type":"ContainerStarted","Data":"117f99b5b80064c2ccd639146f1ec9b87aa17875ebce8919a1a8eb8a7cd454e3"}
Jul 24 16:06:28.611015 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.610994    2561 generic.go:356] "Generic (PLEG): container finished" podID="32537f3f-042f-4d3f-9b9d-722cb26ef475" containerID="72b363f4b53fc91ce38e9b633678f163a5e8bb0a5052e4a50230622c4ec78e86" exitCode=0
Jul 24 16:06:28.611096 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.611067    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" event={"ID":"32537f3f-042f-4d3f-9b9d-722cb26ef475","Type":"ContainerDied","Data":"72b363f4b53fc91ce38e9b633678f163a5e8bb0a5052e4a50230622c4ec78e86"}
Jul 24 16:06:28.612487 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.612467    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz" event={"ID":"3ac647c5-5c98-4ea5-9db0-3f167aebd396","Type":"ContainerStarted","Data":"2ee47a587c1a8a23223171dd00b3ee74811100a4623432c2b5e39a1d3e880d9c"}
Jul 24 16:06:28.612558 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.612511    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal" podStartSLOduration=21.612497341 podStartE2EDuration="21.612497341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:28.612342242 +0000 UTC m=+22.597033024" watchObservedRunningTime="2026-07-24 16:06:28.612497341 +0000 UTC m=+22.597188121"
Jul 24 16:06:28.626124 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.626090    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hgm4t" podStartSLOduration=3.358957401 podStartE2EDuration="22.626078101s" totalImagesPullingTime="19.2671207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:28.625817751 +0000 UTC m=+22.610508541" watchObservedRunningTime="2026-07-24 16:06:28.626078101 +0000 UTC m=+22.610768881"
Jul 24 16:06:28.642143 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.642106    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n6h26" podStartSLOduration=3.360447592 podStartE2EDuration="22.642087552s" totalImagesPullingTime="19.28163996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:28.641897106 +0000 UTC m=+22.626587887" watchObservedRunningTime="2026-07-24 16:06:28.642087552 +0000 UTC m=+22.626778333"
Jul 24 16:06:28.672228 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.672191    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-swswd" podStartSLOduration=7.827275688 podStartE2EDuration="22.672176922s" totalImagesPullingTime="14.844901234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:28.67156153 +0000 UTC m=+22.656252332" watchObservedRunningTime="2026-07-24 16:06:28.672176922 +0000 UTC m=+22.656867702"
Jul 24 16:06:28.686481 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.686449    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7gq5q" podStartSLOduration=3.26402878 podStartE2EDuration="22.686436049s" totalImagesPullingTime="19.422407269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:28.686195821 +0000 UTC m=+22.670886629" watchObservedRunningTime="2026-07-24 16:06:28.686436049 +0000 UTC m=+22.671126821"
Jul 24 16:06:28.717317 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:28.717275    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9nhx7" podStartSLOduration=3.439899835 podStartE2EDuration="22.717260792s" totalImagesPullingTime="19.277360957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:28.716931804 +0000 UTC m=+22.701622585" watchObservedRunningTime="2026-07-24 16:06:28.717260792 +0000 UTC m=+22.701951573"
Jul 24 16:06:29.617190 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:29.616984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal" event={"ID":"3c29e302b1338537410b67bb59e7a33e","Type":"ContainerStarted","Data":"5da54fc0dde92d57876f3eca5d008ba55f6810efcda94b45c6efac957d0d06cd"}
Jul 24 16:06:29.620656 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:29.620604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" event={"ID":"e4e7eb47-105e-4fcb-9576-45ab5d39cc83","Type":"ContainerStarted","Data":"4b887c0ca8922979bbc36a5874ee508e369fe330d44c21b5cb2bdfb1dfe914a6"}
Jul 24 16:06:29.620769 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:29.620692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" event={"ID":"e4e7eb47-105e-4fcb-9576-45ab5d39cc83","Type":"ContainerStarted","Data":"6fcb6b1d97d26b5d0cf2527c5304b81edb48c376f7e1c66116a22d3793f301f5"}
Jul 24 16:06:29.622257 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:29.622232    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w8wct" event={"ID":"42810a30-7721-4ff6-bbcd-51db8e069a5d","Type":"ContainerStarted","Data":"0f75c4f408d69644bc2e94f141a6241041da377fb9279d62eb101a4fbc4e6dc3"}
Jul 24 16:06:29.638249 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:29.638206    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal" podStartSLOduration=22.63819342 podStartE2EDuration="22.63819342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:29.637499953 +0000 UTC m=+23.622190735" watchObservedRunningTime="2026-07-24 16:06:29.63819342 +0000 UTC m=+23.622884201"
Jul 24 16:06:29.653962 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:29.653923    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w8wct" podStartSLOduration=4.413439494 podStartE2EDuration="23.653913384s" totalImagesPullingTime="19.24047389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:29.653447801 +0000 UTC m=+23.638138583" watchObservedRunningTime="2026-07-24 16:06:29.653913384 +0000 UTC m=+23.638604164"
Jul 24 16:06:30.036773 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.036750    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 16:06:30.433270 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.433157    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T16:06:30.036766307Z","UUID":"0a98ea69-a7c4-4313-bdf7-a635ef314ba1","Handler":null,"Name":"","Endpoint":""}
Jul 24 16:06:30.435025 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.434994    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 16:06:30.435145 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.435034    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 16:06:30.505154 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.505113    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:30.505308 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.505223    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:30.505308 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:30.505231    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:30.505308 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.505255    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:30.505462 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:30.505362    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:30.505462 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:30.505443    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:30.626115 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.626085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz" event={"ID":"3ac647c5-5c98-4ea5-9db0-3f167aebd396","Type":"ContainerStarted","Data":"35d92df04d6993793f2cdb0d4b13a7ba1619b3744640316f0fa9a2297547cb09"}
Jul 24 16:06:30.753011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.752940    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:30.753679 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:30.753658    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:31.632763 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:31.632724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" event={"ID":"e4e7eb47-105e-4fcb-9576-45ab5d39cc83","Type":"ContainerStarted","Data":"01674894c67465c36f21e2eb94cbfb9fd852a2bb1ef4ea7f5dca88fe1a947ff0"}
Jul 24 16:06:31.634889 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:31.634859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz" event={"ID":"3ac647c5-5c98-4ea5-9db0-3f167aebd396","Type":"ContainerStarted","Data":"e1279bd29b81dbeed9bc946c6f10818a0d50292bc7c04dccf044303058494a2a"}
Jul 24 16:06:31.635088 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:31.635071    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:31.635546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:31.635523    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-swswd"
Jul 24 16:06:31.652467 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:31.652428    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84gzz" podStartSLOduration=3.544233469 podStartE2EDuration="25.652414331s" totalImagesPullingTime="22.108180862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:31.651799321 +0000 UTC m=+25.636490122" watchObservedRunningTime="2026-07-24 16:06:31.652414331 +0000 UTC m=+25.637105112"
Jul 24 16:06:32.502488 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:32.502458    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:32.502695 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:32.502495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:32.502695 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:32.502576    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:32.502969 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:32.502953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:32.503065 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:32.503047    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:32.503155 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:32.503137    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:33.644388 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:33.644124    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" event={"ID":"e4e7eb47-105e-4fcb-9576-45ab5d39cc83","Type":"ContainerStarted","Data":"d3658ebe7457e759db947d3191db04a7c024333a826c91590c89237bc161f44c"}
Jul 24 16:06:33.644942 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:33.644449    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:33.646762 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:33.646691    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" event={"ID":"32537f3f-042f-4d3f-9b9d-722cb26ef475","Type":"ContainerStarted","Data":"28401fe808fe5188f9c30c26ecbaffd1101158f7dbc16cc6ebed2833158b91f7"}
Jul 24 16:06:33.661999 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:33.661966    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:33.672490 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:33.672336    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx" podStartSLOduration=8.349234170999999 podStartE2EDuration="27.672319828s" totalImagesPullingTime="19.323085657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:33.67089243 +0000 UTC m=+27.655583212" watchObservedRunningTime="2026-07-24 16:06:33.672319828 +0000 UTC m=+27.657010608"
Jul 24 16:06:34.501947 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:34.501912    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:34.502126 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:34.501970    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:34.502126 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:34.501976    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:34.502126 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:34.502060    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:34.502218 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:34.502186    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:34.502278 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:34.502261    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:34.650686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:34.650659    2561 generic.go:356] "Generic (PLEG): container finished" podID="32537f3f-042f-4d3f-9b9d-722cb26ef475" containerID="28401fe808fe5188f9c30c26ecbaffd1101158f7dbc16cc6ebed2833158b91f7" exitCode=0
Jul 24 16:06:34.651301 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:34.650746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" event={"ID":"32537f3f-042f-4d3f-9b9d-722cb26ef475","Type":"ContainerDied","Data":"28401fe808fe5188f9c30c26ecbaffd1101158f7dbc16cc6ebed2833158b91f7"}
Jul 24 16:06:34.651301 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:34.651238    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:34.651412 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:34.651307    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:34.667658 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:34.667623    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:06:35.463066 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:35.462880    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qswb4"]
Jul 24 16:06:35.463252 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:35.463163    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:35.463305 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:35.463282    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:35.465342 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:35.465259    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p6ljc"]
Jul 24 16:06:35.465342 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:35.465341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:35.465507 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:35.465431    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:35.482240 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:35.482216    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dscj2"]
Jul 24 16:06:35.482342 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:35.482289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:35.482395 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:35.482369    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:36.656528 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:36.656493    2561 generic.go:356] "Generic (PLEG): container finished" podID="32537f3f-042f-4d3f-9b9d-722cb26ef475" containerID="fd9c6b51e06ae28c3ce661069a90b3c20b8894aa1f54e991d789a5da47289ca1" exitCode=0
Jul 24 16:06:36.657047 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:36.656579    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" event={"ID":"32537f3f-042f-4d3f-9b9d-722cb26ef475","Type":"ContainerDied","Data":"fd9c6b51e06ae28c3ce661069a90b3c20b8894aa1f54e991d789a5da47289ca1"}
Jul 24 16:06:37.501747 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:37.501711    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:37.501916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:37.501711    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:37.501916 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:37.501823    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:37.502039 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:37.501907    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:37.502039 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:37.501713    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:37.502039 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:37.502009    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:37.661231 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:37.661206    2561 generic.go:356] "Generic (PLEG): container finished" podID="32537f3f-042f-4d3f-9b9d-722cb26ef475" containerID="f442b32f102b5b5c179460ad4a072104cfaa901db50afd954b5580e70ec874da" exitCode=0
Jul 24 16:06:37.661483 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:37.661264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" event={"ID":"32537f3f-042f-4d3f-9b9d-722cb26ef475","Type":"ContainerDied","Data":"f442b32f102b5b5c179460ad4a072104cfaa901db50afd954b5580e70ec874da"}
Jul 24 16:06:39.502257 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:39.502220    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:39.502699 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:39.502339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:39.502699 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:39.502354    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:39.502699 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:39.502368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:39.502699 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:39.502461    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:39.502699 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:39.502562    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:40.116882 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:40.116851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:40.117046 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:40.116911    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:40.117046 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:40.117006    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:40.117046 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:40.117006    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:40.117159 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:40.117061    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs podName:b943eabe-3fe7-4b72-b432-acb2e0a999f4 nodeName:}" failed. No retries permitted until 2026-07-24 16:07:12.117041409 +0000 UTC m=+66.101732168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs") pod "network-metrics-daemon-qswb4" (UID: "b943eabe-3fe7-4b72-b432-acb2e0a999f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:40.117159 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:40.117080    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret podName:29617d35-46b4-4fa4-aa91-c048ca5b9889 nodeName:}" failed. No retries permitted until 2026-07-24 16:07:12.117069867 +0000 UTC m=+66.101760626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret") pod "global-pull-secret-syncer-dscj2" (UID: "29617d35-46b4-4fa4-aa91-c048ca5b9889") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:40.317961 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:40.317928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:40.318117 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:40.318074    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:40.318117 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:40.318089    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:40.318117 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:40.318098    2561 projected.go:196] Error preparing data for projected volume kube-api-access-vqm5h for pod openshift-network-diagnostics/network-check-target-p6ljc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:40.318229 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:40.318148    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h podName:fb1b162b-4e8a-466f-b0a2-338211930ca7 nodeName:}" failed. No retries permitted until 2026-07-24 16:07:12.318134778 +0000 UTC m=+66.302825537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqm5h" (UniqueName: "kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h") pod "network-check-target-p6ljc" (UID: "fb1b162b-4e8a-466f-b0a2-338211930ca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:41.501735 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.501709    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:41.502193 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.501707    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:41.502193 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:41.501845    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qswb4" podUID="b943eabe-3fe7-4b72-b432-acb2e0a999f4"
Jul 24 16:06:41.502193 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.501710    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:41.502193 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:41.501932    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dscj2" podUID="29617d35-46b4-4fa4-aa91-c048ca5b9889"
Jul 24 16:06:41.502193 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:41.502000    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6ljc" podUID="fb1b162b-4e8a-466f-b0a2-338211930ca7"
Jul 24 16:06:41.841198 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.841132    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeReady"
Jul 24 16:06:41.841335 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.841247    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 16:06:41.882309 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.882252    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f8445b44b-ftb67"]
Jul 24 16:06:41.902910 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.902883    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-28cf9"]
Jul 24 16:06:41.903035 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.902995    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:41.905606 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.905461    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 16:06:41.905801 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.905781    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 16:06:41.905920 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.905868    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 16:06:41.906123 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.906099    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ndlwb\""
Jul 24 16:06:41.917062 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.917037    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 16:06:41.918909 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.918885    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-swgns"]
Jul 24 16:06:41.919032 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.919013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:41.921451 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.921435    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 16:06:41.921451 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.921447    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v6rwh\""
Jul 24 16:06:41.921603 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.921440    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 16:06:41.939379 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.939362    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f8445b44b-ftb67"]
Jul 24 16:06:41.939472 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.939387    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-28cf9"]
Jul 24 16:06:41.939472 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.939403    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swgns"]
Jul 24 16:06:41.939472 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.939423    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ssqlw"]
Jul 24 16:06:41.939604 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.939499    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:41.942317 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.942298    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 16:06:41.942431 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.942410    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 16:06:41.942571 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.942551    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l4gkx\""
Jul 24 16:06:41.942667 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.942437    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 16:06:41.942667 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.942504    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 16:06:41.971508 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.971487    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ssqlw"]
Jul 24 16:06:41.971604 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.971564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssqlw"
Jul 24 16:06:41.974839 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.974821    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 16:06:41.974945 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.974876    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7xbff\""
Jul 24 16:06:41.975091 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.975075    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 16:06:41.976273 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:41.976255    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 16:06:42.031544 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031523    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.031697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.031697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf62ebce-0b3e-47f9-aa38-58b858e098c3-config-volume\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.031697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031587    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-bound-sa-token\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.031697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4zfx\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-kube-api-access-z4zfx\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.031697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fa8fe71-3432-4e48-959c-afb256df4318-data-volume\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.031697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shdq6\" (UniqueName: \"kubernetes.io/projected/cf62ebce-0b3e-47f9-aa38-58b858e098c3-kube-api-access-shdq6\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.031697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-trusted-ca\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.031908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-installation-pull-secrets\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.031908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-certificates\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.031908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.031908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031807    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fa8fe71-3432-4e48-959c-afb256df4318-crio-socket\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.031908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2735425-6a15-48a1-a318-e7b47d1bf833-ca-trust-extracted\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.031908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-image-registry-private-configuration\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.031908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.032145 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lx77\" (UniqueName: \"kubernetes.io/projected/0fa8fe71-3432-4e48-959c-afb256df4318-kube-api-access-9lx77\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.032145 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.031938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf62ebce-0b3e-47f9-aa38-58b858e098c3-tmp-dir\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.133221 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.133385 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fa8fe71-3432-4e48-959c-afb256df4318-crio-socket\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.133385 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2735425-6a15-48a1-a318-e7b47d1bf833-ca-trust-extracted\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.133385 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-image-registry-private-configuration\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.133385 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.133352    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:42.133566 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.133566 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.133423    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:42.133566 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133475    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fa8fe71-3432-4e48-959c-afb256df4318-crio-socket\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.133566 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.133428    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls podName:cf62ebce-0b3e-47f9-aa38-58b858e098c3 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:42.633407748 +0000 UTC m=+36.618098529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls") pod "dns-default-28cf9" (UID: "cf62ebce-0b3e-47f9-aa38-58b858e098c3") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:42.133566 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.133549    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls podName:0fa8fe71-3432-4e48-959c-afb256df4318 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:42.633527784 +0000 UTC m=+36.618218544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swgns" (UID: "0fa8fe71-3432-4e48-959c-afb256df4318") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:42.133826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lx77\" (UniqueName: \"kubernetes.io/projected/0fa8fe71-3432-4e48-959c-afb256df4318-kube-api-access-9lx77\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.133826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf62ebce-0b3e-47f9-aa38-58b858e098c3-tmp-dir\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.133826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.133826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.133826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133761    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf62ebce-0b3e-47f9-aa38-58b858e098c3-config-volume\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.133826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-bound-sa-token\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.133826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4zfx\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-kube-api-access-z4zfx\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.133839    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.133843    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.133862    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f8445b44b-ftb67: secret "image-registry-tls" not found
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fa8fe71-3432-4e48-959c-afb256df4318-data-volume\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133893    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2735425-6a15-48a1-a318-e7b47d1bf833-ca-trust-extracted\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.133903    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm podName:0fa8fe71-3432-4e48-959c-afb256df4318 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:42.633887626 +0000 UTC m=+36.618578386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swgns" (UID: "0fa8fe71-3432-4e48-959c-afb256df4318") : configmap "kube-rbac-proxy" not found
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.133944    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls podName:e2735425-6a15-48a1-a318-e7b47d1bf833 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:42.633921671 +0000 UTC m=+36.618612437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls") pod "image-registry-5f8445b44b-ftb67" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833") : secret "image-registry-tls" not found
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.133981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf62ebce-0b3e-47f9-aa38-58b858e098c3-tmp-dir\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.134011    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f16e4a4f-e4f3-4718-bafb-acfe973c503c-cert\") pod \"ingress-canary-ssqlw\" (UID: \"f16e4a4f-e4f3-4718-bafb-acfe973c503c\") " pod="openshift-ingress-canary/ingress-canary-ssqlw"
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.134040    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqnqv\" (UniqueName: \"kubernetes.io/projected/f16e4a4f-e4f3-4718-bafb-acfe973c503c-kube-api-access-kqnqv\") pod \"ingress-canary-ssqlw\" (UID: \"f16e4a4f-e4f3-4718-bafb-acfe973c503c\") " pod="openshift-ingress-canary/ingress-canary-ssqlw"
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.134075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shdq6\" (UniqueName: \"kubernetes.io/projected/cf62ebce-0b3e-47f9-aa38-58b858e098c3-kube-api-access-shdq6\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.134101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-trusted-ca\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.134115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fa8fe71-3432-4e48-959c-afb256df4318-data-volume\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.134149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.134143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-installation-pull-secrets\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.134826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.134180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-certificates\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.134826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.134479    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf62ebce-0b3e-47f9-aa38-58b858e098c3-config-volume\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.134826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.134697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-certificates\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.135080 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.135058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-trusted-ca\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.137581 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.137564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-image-registry-private-configuration\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.137631 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.137579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-installation-pull-secrets\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.142084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.142035    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lx77\" (UniqueName: \"kubernetes.io/projected/0fa8fe71-3432-4e48-959c-afb256df4318-kube-api-access-9lx77\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.142691 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.142669    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4zfx\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-kube-api-access-z4zfx\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.143001 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.142977    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-bound-sa-token\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.143116 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.143058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shdq6\" (UniqueName: \"kubernetes.io/projected/cf62ebce-0b3e-47f9-aa38-58b858e098c3-kube-api-access-shdq6\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.235070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.235044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f16e4a4f-e4f3-4718-bafb-acfe973c503c-cert\") pod \"ingress-canary-ssqlw\" (UID: \"f16e4a4f-e4f3-4718-bafb-acfe973c503c\") " pod="openshift-ingress-canary/ingress-canary-ssqlw"
Jul 24 16:06:42.235152 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.235085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqnqv\" (UniqueName: \"kubernetes.io/projected/f16e4a4f-e4f3-4718-bafb-acfe973c503c-kube-api-access-kqnqv\") pod \"ingress-canary-ssqlw\" (UID: \"f16e4a4f-e4f3-4718-bafb-acfe973c503c\") " pod="openshift-ingress-canary/ingress-canary-ssqlw"
Jul 24 16:06:42.238050 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.238023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f16e4a4f-e4f3-4718-bafb-acfe973c503c-cert\") pod \"ingress-canary-ssqlw\" (UID: \"f16e4a4f-e4f3-4718-bafb-acfe973c503c\") " pod="openshift-ingress-canary/ingress-canary-ssqlw"
Jul 24 16:06:42.244274 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.244251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqnqv\" (UniqueName: \"kubernetes.io/projected/f16e4a4f-e4f3-4718-bafb-acfe973c503c-kube-api-access-kqnqv\") pod \"ingress-canary-ssqlw\" (UID: \"f16e4a4f-e4f3-4718-bafb-acfe973c503c\") " pod="openshift-ingress-canary/ingress-canary-ssqlw"
Jul 24 16:06:42.279540 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.279518    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssqlw"
Jul 24 16:06:42.461427 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.461341    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ssqlw"]
Jul 24 16:06:42.464117 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:42.464087    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16e4a4f_e4f3_4718_bafb_acfe973c503c.slice/crio-8fff13858e529cfc3bc8de63b20db7b2055c6805eb7d2b7c815a793a4bb7ae88 WatchSource:0}: Error finding container 8fff13858e529cfc3bc8de63b20db7b2055c6805eb7d2b7c815a793a4bb7ae88: Status 404 returned error can't find the container with id 8fff13858e529cfc3bc8de63b20db7b2055c6805eb7d2b7c815a793a4bb7ae88
Jul 24 16:06:42.638395 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.638364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.638424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.638470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.638492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.638493    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.638559    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.638579    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm podName:0fa8fe71-3432-4e48-959c-afb256df4318 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:43.638560758 +0000 UTC m=+37.623251520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swgns" (UID: "0fa8fe71-3432-4e48-959c-afb256df4318") : configmap "kube-rbac-proxy" not found
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.638594    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.638598    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.638617    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f8445b44b-ftb67: secret "image-registry-tls" not found
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.638608    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls podName:cf62ebce-0b3e-47f9-aa38-58b858e098c3 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:43.638596321 +0000 UTC m=+37.623287084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls") pod "dns-default-28cf9" (UID: "cf62ebce-0b3e-47f9-aa38-58b858e098c3") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.638689    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls podName:0fa8fe71-3432-4e48-959c-afb256df4318 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:43.638677278 +0000 UTC m=+37.623368041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swgns" (UID: "0fa8fe71-3432-4e48-959c-afb256df4318") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:42.639028 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:42.638702    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls podName:e2735425-6a15-48a1-a318-e7b47d1bf833 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:43.638696368 +0000 UTC m=+37.623387127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls") pod "image-registry-5f8445b44b-ftb67" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833") : secret "image-registry-tls" not found
Jul 24 16:06:42.675608 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.675542    2561 generic.go:356] "Generic (PLEG): container finished" podID="32537f3f-042f-4d3f-9b9d-722cb26ef475" containerID="91062edc12776b7105e85d2edb52ceb07c3d803f301ac571a129b59faf8cee9f" exitCode=0
Jul 24 16:06:42.675735 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.675619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" event={"ID":"32537f3f-042f-4d3f-9b9d-722cb26ef475","Type":"ContainerDied","Data":"91062edc12776b7105e85d2edb52ceb07c3d803f301ac571a129b59faf8cee9f"}
Jul 24 16:06:42.676667 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:42.676629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ssqlw" event={"ID":"f16e4a4f-e4f3-4718-bafb-acfe973c503c","Type":"ContainerStarted","Data":"8fff13858e529cfc3bc8de63b20db7b2055c6805eb7d2b7c815a793a4bb7ae88"}
Jul 24 16:06:43.501985 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.501706    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:06:43.502169 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.501766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:06:43.502559 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.501811    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:06:43.504892 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.504868    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 16:06:43.505003 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.504946    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fvsfq\""
Jul 24 16:06:43.506096 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.506078    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nb27\""
Jul 24 16:06:43.506096 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.506093    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 16:06:43.506315 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.506301    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 16:06:43.506391 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.506372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 16:06:43.523489 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.523475    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nhx7_7813417e-8bc8-443d-840b-659310daa0ee/dns-node-resolver/0.log"
Jul 24 16:06:43.645763 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.645730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:43.645867    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.645894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:43.645952    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls podName:cf62ebce-0b3e-47f9-aa38-58b858e098c3 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:45.645917554 +0000 UTC m=+39.630608313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls") pod "dns-default-28cf9" (UID: "cf62ebce-0b3e-47f9-aa38-58b858e098c3") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:43.645975    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:43.646019    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:43.646022    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls podName:0fa8fe71-3432-4e48-959c-afb256df4318 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:45.64600509 +0000 UTC m=+39.630695866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swgns" (UID: "0fa8fe71-3432-4e48-959c-afb256df4318") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:43.646030    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f8445b44b-ftb67: secret "image-registry-tls" not found
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.645976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:43.646067    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls podName:e2735425-6a15-48a1-a318-e7b47d1bf833 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:45.646057739 +0000 UTC m=+39.630748498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls") pod "image-registry-5f8445b44b-ftb67" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833") : secret "image-registry-tls" not found
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.646084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:43.646123    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:06:43.646175 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:43.646153    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm podName:0fa8fe71-3432-4e48-959c-afb256df4318 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:45.646144089 +0000 UTC m=+39.630834847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swgns" (UID: "0fa8fe71-3432-4e48-959c-afb256df4318") : configmap "kube-rbac-proxy" not found
Jul 24 16:06:43.683245 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.683217    2561 generic.go:356] "Generic (PLEG): container finished" podID="32537f3f-042f-4d3f-9b9d-722cb26ef475" containerID="8b26f48128ace4134292be92cdd503826841fc27d8e708c19025f6f7e6ef68fd" exitCode=0
Jul 24 16:06:43.683405 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:43.683269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" event={"ID":"32537f3f-042f-4d3f-9b9d-722cb26ef475","Type":"ContainerDied","Data":"8b26f48128ace4134292be92cdd503826841fc27d8e708c19025f6f7e6ef68fd"}
Jul 24 16:06:44.380841 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.380807    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hcxn5"]
Jul 24 16:06:44.386269 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.386254    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.389243 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.389220    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 24 16:06:44.389832 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.389814    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 24 16:06:44.389903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.389815    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 24 16:06:44.389903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.389844    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 24 16:06:44.389903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.389816    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-d7x7s\""
Jul 24 16:06:44.394102 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.394080    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hcxn5"]
Jul 24 16:06:44.500116 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.500091    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hgm4t_e8c1aa89-7d46-4c9c-8e7a-93155b733e35/node-ca/0.log"
Jul 24 16:06:44.553940 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.553906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d7caa8c-d63a-44b4-be89-70ff4a42d084-signing-key\") pod \"service-ca-658d7b7c78-hcxn5\" (UID: \"6d7caa8c-d63a-44b4-be89-70ff4a42d084\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.553940 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.553952    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d7caa8c-d63a-44b4-be89-70ff4a42d084-signing-cabundle\") pod \"service-ca-658d7b7c78-hcxn5\" (UID: \"6d7caa8c-d63a-44b4-be89-70ff4a42d084\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.554185 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.554005    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glj8x\" (UniqueName: \"kubernetes.io/projected/6d7caa8c-d63a-44b4-be89-70ff4a42d084-kube-api-access-glj8x\") pod \"service-ca-658d7b7c78-hcxn5\" (UID: \"6d7caa8c-d63a-44b4-be89-70ff4a42d084\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.655203 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.655123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glj8x\" (UniqueName: \"kubernetes.io/projected/6d7caa8c-d63a-44b4-be89-70ff4a42d084-kube-api-access-glj8x\") pod \"service-ca-658d7b7c78-hcxn5\" (UID: \"6d7caa8c-d63a-44b4-be89-70ff4a42d084\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.655617 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.655233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d7caa8c-d63a-44b4-be89-70ff4a42d084-signing-key\") pod \"service-ca-658d7b7c78-hcxn5\" (UID: \"6d7caa8c-d63a-44b4-be89-70ff4a42d084\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.655617 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.655274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d7caa8c-d63a-44b4-be89-70ff4a42d084-signing-cabundle\") pod \"service-ca-658d7b7c78-hcxn5\" (UID: \"6d7caa8c-d63a-44b4-be89-70ff4a42d084\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.656013 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.655981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d7caa8c-d63a-44b4-be89-70ff4a42d084-signing-cabundle\") pod \"service-ca-658d7b7c78-hcxn5\" (UID: \"6d7caa8c-d63a-44b4-be89-70ff4a42d084\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.659883 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.659861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d7caa8c-d63a-44b4-be89-70ff4a42d084-signing-key\") pod \"service-ca-658d7b7c78-hcxn5\" (UID: \"6d7caa8c-d63a-44b4-be89-70ff4a42d084\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.664119 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.664078    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glj8x\" (UniqueName: \"kubernetes.io/projected/6d7caa8c-d63a-44b4-be89-70ff4a42d084-kube-api-access-glj8x\") pod \"service-ca-658d7b7c78-hcxn5\" (UID: \"6d7caa8c-d63a-44b4-be89-70ff4a42d084\") " pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.689741 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.689700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" event={"ID":"32537f3f-042f-4d3f-9b9d-722cb26ef475","Type":"ContainerStarted","Data":"c44f1896c438cb9af88e8f91b9a37e41cb5f759d753dde19280150f437820562"}
Jul 24 16:06:44.696253 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.696072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5"
Jul 24 16:06:44.718357 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:44.718308    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qhhzj" podStartSLOduration=7.82860266 podStartE2EDuration="38.718293326s" totalImagesPullingTime="30.889690666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:44.717021241 +0000 UTC m=+38.701712056" watchObservedRunningTime="2026-07-24 16:06:44.718293326 +0000 UTC m=+38.702984108"
Jul 24 16:06:45.354123 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:45.353906    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hcxn5"]
Jul 24 16:06:45.358187 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:45.358158    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7caa8c_d63a_44b4_be89_70ff4a42d084.slice/crio-7191cd33459cf4194beb9a19414486f519102b0d5f79deff41d34f3a73ea721a WatchSource:0}: Error finding container 7191cd33459cf4194beb9a19414486f519102b0d5f79deff41d34f3a73ea721a: Status 404 returned error can't find the container with id 7191cd33459cf4194beb9a19414486f519102b0d5f79deff41d34f3a73ea721a
Jul 24 16:06:45.663684 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:45.663656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:45.663725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:45.663744    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:45.663778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:45.663804    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm podName:0fa8fe71-3432-4e48-959c-afb256df4318 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:49.663782252 +0000 UTC m=+43.648473013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swgns" (UID: "0fa8fe71-3432-4e48-959c-afb256df4318") : configmap "kube-rbac-proxy" not found
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:45.663858    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:45.663904    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls podName:0fa8fe71-3432-4e48-959c-afb256df4318 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:49.663888972 +0000 UTC m=+43.648579738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swgns" (UID: "0fa8fe71-3432-4e48-959c-afb256df4318") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:45.663909    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:45.663917    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:45.663929    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f8445b44b-ftb67: secret "image-registry-tls" not found
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:45.663855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:45.663961    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls podName:cf62ebce-0b3e-47f9-aa38-58b858e098c3 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:49.663948845 +0000 UTC m=+43.648639607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls") pod "dns-default-28cf9" (UID: "cf62ebce-0b3e-47f9-aa38-58b858e098c3") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:45.664264 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:45.663985    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls podName:e2735425-6a15-48a1-a318-e7b47d1bf833 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:49.663979325 +0000 UTC m=+43.648670084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls") pod "image-registry-5f8445b44b-ftb67" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833") : secret "image-registry-tls" not found
Jul 24 16:06:45.693276 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:45.693247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ssqlw" event={"ID":"f16e4a4f-e4f3-4718-bafb-acfe973c503c","Type":"ContainerStarted","Data":"82d1107578ecad7b157cec79bf0dd975bcb78fb656958bdd1c93185c1d14d34f"}
Jul 24 16:06:45.694385 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:45.694360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5" event={"ID":"6d7caa8c-d63a-44b4-be89-70ff4a42d084","Type":"ContainerStarted","Data":"7191cd33459cf4194beb9a19414486f519102b0d5f79deff41d34f3a73ea721a"}
Jul 24 16:06:45.712443 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:45.712399    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ssqlw" podStartSLOduration=1.6676947260000001 podStartE2EDuration="4.712383423s" totalImagesPullingTime="3.044688697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:45.712088898 +0000 UTC m=+39.696779702" watchObservedRunningTime="2026-07-24 16:06:45.712383423 +0000 UTC m=+39.697074203"
Jul 24 16:06:48.703069 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:48.703028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5" event={"ID":"6d7caa8c-d63a-44b4-be89-70ff4a42d084","Type":"ContainerStarted","Data":"344170e2e520332817437a0cb538bf32a168d8782ff92e93333def5e63eb1976"}
Jul 24 16:06:48.722214 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:48.722166    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-hcxn5" podStartSLOduration=2.230580724 podStartE2EDuration="4.72215167s" totalImagesPullingTime="2.491570946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:48.72122789 +0000 UTC m=+42.705918671" watchObservedRunningTime="2026-07-24 16:06:48.72215167 +0000 UTC m=+42.706842451"
Jul 24 16:06:49.699188 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:49.699145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:49.699388 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:49.699293    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:49.699388 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:49.699337    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:49.699388 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:49.699368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:49.699546 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:49.699301    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:49.699546 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:49.699416    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:49.699546 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:49.699429    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f8445b44b-ftb67: secret "image-registry-tls" not found
Jul 24 16:06:49.699546 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:49.699356    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:49.699546 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:49.699468    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls podName:cf62ebce-0b3e-47f9-aa38-58b858e098c3 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:57.699448537 +0000 UTC m=+51.684139310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls") pod "dns-default-28cf9" (UID: "cf62ebce-0b3e-47f9-aa38-58b858e098c3") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:49.699546 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:49.699511    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls podName:e2735425-6a15-48a1-a318-e7b47d1bf833 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:57.69949496 +0000 UTC m=+51.684185724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls") pod "image-registry-5f8445b44b-ftb67" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833") : secret "image-registry-tls" not found
Jul 24 16:06:49.699546 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:06:49.699534    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls podName:0fa8fe71-3432-4e48-959c-afb256df4318 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:57.699525105 +0000 UTC m=+51.684215869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swgns" (UID: "0fa8fe71-3432-4e48-959c-afb256df4318") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:49.700054 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:49.700032    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fa8fe71-3432-4e48-959c-afb256df4318-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:57.760542 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:57.760510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:57.761058 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:57.760569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:57.761058 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:57.760686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:57.763770 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:57.763751    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf62ebce-0b3e-47f9-aa38-58b858e098c3-metrics-tls\") pod \"dns-default-28cf9\" (UID: \"cf62ebce-0b3e-47f9-aa38-58b858e098c3\") " pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:57.763861 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:57.763768    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fa8fe71-3432-4e48-959c-afb256df4318-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swgns\" (UID: \"0fa8fe71-3432-4e48-959c-afb256df4318\") " pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:57.763973 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:57.763952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") pod \"image-registry-5f8445b44b-ftb67\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") " pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:57.816512 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:57.816480    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:57.827619 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:57.827592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-28cf9"
Jul 24 16:06:57.848515 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:57.848493    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swgns"
Jul 24 16:06:58.010989 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:58.010804    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f8445b44b-ftb67"]
Jul 24 16:06:58.025503 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:58.025481    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-28cf9"]
Jul 24 16:06:58.027122 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:58.027095    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2735425_6a15_48a1_a318_e7b47d1bf833.slice/crio-635dc1b75e9af4fddc23ac87f5cf1966d02c745d776aa069c8ef94ee386707bd WatchSource:0}: Error finding container 635dc1b75e9af4fddc23ac87f5cf1966d02c745d776aa069c8ef94ee386707bd: Status 404 returned error can't find the container with id 635dc1b75e9af4fddc23ac87f5cf1966d02c745d776aa069c8ef94ee386707bd
Jul 24 16:06:58.027544 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:06:58.027529    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf62ebce_0b3e_47f9_aa38_58b858e098c3.slice/crio-026fe9f08816ad6106e5c8637e5994e6774f1fd340a2dcfc35ac14a068b0422d WatchSource:0}: Error finding container 026fe9f08816ad6106e5c8637e5994e6774f1fd340a2dcfc35ac14a068b0422d: Status 404 returned error can't find the container with id 026fe9f08816ad6106e5c8637e5994e6774f1fd340a2dcfc35ac14a068b0422d
Jul 24 16:06:58.039425 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:58.039404    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swgns"]
Jul 24 16:06:58.732070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:58.732031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67" event={"ID":"e2735425-6a15-48a1-a318-e7b47d1bf833","Type":"ContainerStarted","Data":"b0ec874b8e1aa01dba50968c63dfa5ed54145414a743046ef18b26fe2cbeda0c"}
Jul 24 16:06:58.732343 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:58.732098    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67" event={"ID":"e2735425-6a15-48a1-a318-e7b47d1bf833","Type":"ContainerStarted","Data":"635dc1b75e9af4fddc23ac87f5cf1966d02c745d776aa069c8ef94ee386707bd"}
Jul 24 16:06:58.732907 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:58.732883    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:06:58.734463 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:58.734394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-28cf9" event={"ID":"cf62ebce-0b3e-47f9-aa38-58b858e098c3","Type":"ContainerStarted","Data":"026fe9f08816ad6106e5c8637e5994e6774f1fd340a2dcfc35ac14a068b0422d"}
Jul 24 16:06:58.736186 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:58.736119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swgns" event={"ID":"0fa8fe71-3432-4e48-959c-afb256df4318","Type":"ContainerStarted","Data":"7d222e37b68f02ced47975bcbd19382614c16b8c4716e0d2f0658fe0314c958e"}
Jul 24 16:06:58.754868 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:06:58.754813    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67" podStartSLOduration=39.75479337 podStartE2EDuration="39.75479337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:58.753286857 +0000 UTC m=+52.737977643" watchObservedRunningTime="2026-07-24 16:06:58.75479337 +0000 UTC m=+52.739484149"
Jul 24 16:07:00.742497 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:00.742461    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-28cf9" event={"ID":"cf62ebce-0b3e-47f9-aa38-58b858e098c3","Type":"ContainerStarted","Data":"f3e3136ac9ef47e5ba2a4dc337d91b8d8b4ba720a66d50081ed26f6494488ec5"}
Jul 24 16:07:00.743043 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:00.742530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-28cf9" event={"ID":"cf62ebce-0b3e-47f9-aa38-58b858e098c3","Type":"ContainerStarted","Data":"503f43e739c65a4ba6536d236c8af0dcb149d50a508079828ed9946ed0ee8333"}
Jul 24 16:07:00.759621 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:00.759569    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-28cf9" podStartSLOduration=17.818817411 podStartE2EDuration="19.759554023s" totalImagesPullingTime="1.940736612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:00.759010064 +0000 UTC m=+54.743700845" watchObservedRunningTime="2026-07-24 16:07:00.759554023 +0000 UTC m=+54.744244821"
Jul 24 16:07:01.744896 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:01.744858    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-28cf9"
Jul 24 16:07:03.753702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:03.753627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swgns" event={"ID":"0fa8fe71-3432-4e48-959c-afb256df4318","Type":"ContainerStarted","Data":"e32472f7d7efebc3202540b4dc4e5643f0deb746ed62f691020de634f1855edf"}
Jul 24 16:07:04.594503 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.594467    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"]
Jul 24 16:07:04.637044 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.637019    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"]
Jul 24 16:07:04.637206 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.637180    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.641376 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.641352    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 16:07:04.641505 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.641427    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 16:07:04.641505 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.641437    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 24 16:07:04.641505 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.641438    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 16:07:04.641754 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.641738    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 24 16:07:04.641825 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.641742    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 24 16:07:04.642015 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.642000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 24 16:07:04.658681 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.658625    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"]
Jul 24 16:07:04.658681 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.658675    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"]
Jul 24 16:07:04.658851 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.658749    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"
Jul 24 16:07:04.659692 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.659671    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f8445b44b-ftb67"]
Jul 24 16:07:04.666526 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.665059    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 24 16:07:04.666526 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.665306    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-shwb8\""
Jul 24 16:07:04.722062 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.722028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fcc78e9-9905-4bf5-8247-72bd7294f94f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.722258 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.722082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.722258 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.722105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-ca\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.722258 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.722164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f6a7ea0-79e5-4447-bd99-6912b382272c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-869c9cc95b-qz5zv\" (UID: \"7f6a7ea0-79e5-4447-bd99-6912b382272c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"
Jul 24 16:07:04.722258 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.722239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc6sg\" (UniqueName: \"kubernetes.io/projected/1fcc78e9-9905-4bf5-8247-72bd7294f94f-kube-api-access-gc6sg\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.722493 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.722269    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-hub\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.722493 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.722328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8k7m\" (UniqueName: \"kubernetes.io/projected/7f6a7ea0-79e5-4447-bd99-6912b382272c-kube-api-access-l8k7m\") pod \"managed-serviceaccount-addon-agent-869c9cc95b-qz5zv\" (UID: \"7f6a7ea0-79e5-4447-bd99-6912b382272c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"
Jul 24 16:07:04.722493 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.722354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.736688 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.736664    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6db78ddb6f-vxjx8"]
Jul 24 16:07:04.787976 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.787940    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db78ddb6f-vxjx8"]
Jul 24 16:07:04.788349 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.788052    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.822855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.822833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8k7m\" (UniqueName: \"kubernetes.io/projected/7f6a7ea0-79e5-4447-bd99-6912b382272c-kube-api-access-l8k7m\") pod \"managed-serviceaccount-addon-agent-869c9cc95b-qz5zv\" (UID: \"7f6a7ea0-79e5-4447-bd99-6912b382272c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"
Jul 24 16:07:04.822985 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.822869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64ba36df-d31a-483e-9705-14cf552ffcce-bound-sa-token\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.822985 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.822904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.822985 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.822931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64ba36df-d31a-483e-9705-14cf552ffcce-image-registry-private-configuration\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.822985 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.822962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fcc78e9-9905-4bf5-8247-72bd7294f94f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.823197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.822987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64ba36df-d31a-483e-9705-14cf552ffcce-registry-certificates\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.823197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.823197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-ca\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.823197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f6a7ea0-79e5-4447-bd99-6912b382272c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-869c9cc95b-qz5zv\" (UID: \"7f6a7ea0-79e5-4447-bd99-6912b382272c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"
Jul 24 16:07:04.823197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64ba36df-d31a-483e-9705-14cf552ffcce-registry-tls\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.823197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823133    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64ba36df-d31a-483e-9705-14cf552ffcce-ca-trust-extracted\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.823197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc6sg\" (UniqueName: \"kubernetes.io/projected/1fcc78e9-9905-4bf5-8247-72bd7294f94f-kube-api-access-gc6sg\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.823546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-hub\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.823546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64ba36df-d31a-483e-9705-14cf552ffcce-trusted-ca\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.823546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xzgb\" (UniqueName: \"kubernetes.io/projected/64ba36df-d31a-483e-9705-14cf552ffcce-kube-api-access-6xzgb\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.823546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823326    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64ba36df-d31a-483e-9705-14cf552ffcce-installation-pull-secrets\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.823923 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.823704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fcc78e9-9905-4bf5-8247-72bd7294f94f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.825991 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.825970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-ca\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.826322 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.826277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.826518 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.826494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-hub\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.826691 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.826667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f6a7ea0-79e5-4447-bd99-6912b382272c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-869c9cc95b-qz5zv\" (UID: \"7f6a7ea0-79e5-4447-bd99-6912b382272c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"
Jul 24 16:07:04.826850 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.826829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fcc78e9-9905-4bf5-8247-72bd7294f94f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.840276 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.840253    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8k7m\" (UniqueName: \"kubernetes.io/projected/7f6a7ea0-79e5-4447-bd99-6912b382272c-kube-api-access-l8k7m\") pod \"managed-serviceaccount-addon-agent-869c9cc95b-qz5zv\" (UID: \"7f6a7ea0-79e5-4447-bd99-6912b382272c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"
Jul 24 16:07:04.841465 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.841445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc6sg\" (UniqueName: \"kubernetes.io/projected/1fcc78e9-9905-4bf5-8247-72bd7294f94f-kube-api-access-gc6sg\") pod \"cluster-proxy-proxy-agent-575c65cff-w2xxx\" (UID: \"1fcc78e9-9905-4bf5-8247-72bd7294f94f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.924675 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.924623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64ba36df-d31a-483e-9705-14cf552ffcce-installation-pull-secrets\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.924850 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.924688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64ba36df-d31a-483e-9705-14cf552ffcce-bound-sa-token\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.924850 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.924710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64ba36df-d31a-483e-9705-14cf552ffcce-image-registry-private-configuration\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.924850 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.924729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64ba36df-d31a-483e-9705-14cf552ffcce-registry-certificates\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.924850 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.924763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64ba36df-d31a-483e-9705-14cf552ffcce-registry-tls\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.924850 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.924806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64ba36df-d31a-483e-9705-14cf552ffcce-ca-trust-extracted\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.925110 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.924854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64ba36df-d31a-483e-9705-14cf552ffcce-trusted-ca\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.925110 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.924891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xzgb\" (UniqueName: \"kubernetes.io/projected/64ba36df-d31a-483e-9705-14cf552ffcce-kube-api-access-6xzgb\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.925985 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.925957    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64ba36df-d31a-483e-9705-14cf552ffcce-registry-certificates\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.926093 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.925957    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64ba36df-d31a-483e-9705-14cf552ffcce-trusted-ca\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.926211 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.926192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64ba36df-d31a-483e-9705-14cf552ffcce-ca-trust-extracted\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.927945 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.927918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64ba36df-d31a-483e-9705-14cf552ffcce-image-registry-private-configuration\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.928456 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.928437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64ba36df-d31a-483e-9705-14cf552ffcce-installation-pull-secrets\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.928880 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.928863    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64ba36df-d31a-483e-9705-14cf552ffcce-registry-tls\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.942608 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.942584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xzgb\" (UniqueName: \"kubernetes.io/projected/64ba36df-d31a-483e-9705-14cf552ffcce-kube-api-access-6xzgb\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.943987 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.943968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64ba36df-d31a-483e-9705-14cf552ffcce-bound-sa-token\") pod \"image-registry-6db78ddb6f-vxjx8\" (UID: \"64ba36df-d31a-483e-9705-14cf552ffcce\") " pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:04.952937 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.952920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"
Jul 24 16:07:04.969936 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:04.969918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"
Jul 24 16:07:05.113050 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:05.113018    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:06.674510 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:06.674484    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jcjx"
Jul 24 16:07:06.685909 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:06.685881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv"]
Jul 24 16:07:06.688527 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:07:06.688499    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f6a7ea0_79e5_4447_bd99_6912b382272c.slice/crio-ee2d4c5a16e6a63616aa84fb575aecdadd698413ef69ea3e523d2a915720cb57 WatchSource:0}: Error finding container ee2d4c5a16e6a63616aa84fb575aecdadd698413ef69ea3e523d2a915720cb57: Status 404 returned error can't find the container with id ee2d4c5a16e6a63616aa84fb575aecdadd698413ef69ea3e523d2a915720cb57
Jul 24 16:07:06.706622 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:06.706603    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx"]
Jul 24 16:07:06.707689 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:07:06.707666    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fcc78e9_9905_4bf5_8247_72bd7294f94f.slice/crio-63ecc4abac7ddca93eb5751c146beb14b6fdd4fdb14518427aaef8224fbd16c3 WatchSource:0}: Error finding container 63ecc4abac7ddca93eb5751c146beb14b6fdd4fdb14518427aaef8224fbd16c3: Status 404 returned error can't find the container with id 63ecc4abac7ddca93eb5751c146beb14b6fdd4fdb14518427aaef8224fbd16c3
Jul 24 16:07:06.765651 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:06.765617    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swgns" event={"ID":"0fa8fe71-3432-4e48-959c-afb256df4318","Type":"ContainerStarted","Data":"2d3c2f387d2148b3c21f045ea35c5958695ba9ec4b0ef964774aa7338bdcfdf4"}
Jul 24 16:07:06.766688 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:06.766667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx" event={"ID":"1fcc78e9-9905-4bf5-8247-72bd7294f94f","Type":"ContainerStarted","Data":"63ecc4abac7ddca93eb5751c146beb14b6fdd4fdb14518427aaef8224fbd16c3"}
Jul 24 16:07:06.767736 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:06.767710    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv" event={"ID":"7f6a7ea0-79e5-4447-bd99-6912b382272c","Type":"ContainerStarted","Data":"ee2d4c5a16e6a63616aa84fb575aecdadd698413ef69ea3e523d2a915720cb57"}
Jul 24 16:07:06.912367 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:06.912340    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db78ddb6f-vxjx8"]
Jul 24 16:07:06.915497 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:07:06.915469    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ba36df_d31a_483e_9705_14cf552ffcce.slice/crio-862d526d4ff5d38eb3f6dcdecb3f5f427af713fc6085d2f065322b86af86aa96 WatchSource:0}: Error finding container 862d526d4ff5d38eb3f6dcdecb3f5f427af713fc6085d2f065322b86af86aa96: Status 404 returned error can't find the container with id 862d526d4ff5d38eb3f6dcdecb3f5f427af713fc6085d2f065322b86af86aa96
Jul 24 16:07:07.774877 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:07.774040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8" event={"ID":"64ba36df-d31a-483e-9705-14cf552ffcce","Type":"ContainerStarted","Data":"40b964e2347ba81c19d4d027cf82fd03d24610e39e6e99f004f25c14073ba896"}
Jul 24 16:07:07.774877 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:07.774096    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8" event={"ID":"64ba36df-d31a-483e-9705-14cf552ffcce","Type":"ContainerStarted","Data":"862d526d4ff5d38eb3f6dcdecb3f5f427af713fc6085d2f065322b86af86aa96"}
Jul 24 16:07:07.774877 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:07.774823    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:11.749473 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:11.749442    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-28cf9"
Jul 24 16:07:11.769853 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:11.769808    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8" podStartSLOduration=7.769793912 podStartE2EDuration="7.769793912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:07:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:07.802965447 +0000 UTC m=+61.787656227" watchObservedRunningTime="2026-07-24 16:07:11.769793912 +0000 UTC m=+65.754484693"
Jul 24 16:07:12.187314 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.187273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:07:12.187503 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.187339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:07:12.191051 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.191017    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 16:07:12.191921 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.191894    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 16:07:12.200422 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.200374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b943eabe-3fe7-4b72-b432-acb2e0a999f4-metrics-certs\") pod \"network-metrics-daemon-qswb4\" (UID: \"b943eabe-3fe7-4b72-b432-acb2e0a999f4\") " pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:07:12.200694 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.200668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29617d35-46b4-4fa4-aa91-c048ca5b9889-original-pull-secret\") pod \"global-pull-secret-syncer-dscj2\" (UID: \"29617d35-46b4-4fa4-aa91-c048ca5b9889\") " pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:07:12.317307 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.317277    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fvsfq\""
Jul 24 16:07:12.324530 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.324500    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dscj2"
Jul 24 16:07:12.325559 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.325536    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qswb4"
Jul 24 16:07:12.388811 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.388771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:07:12.391626 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.391595    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 16:07:12.402346 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.402320    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 16:07:12.413396 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.413373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqm5h\" (UniqueName: \"kubernetes.io/projected/fb1b162b-4e8a-466f-b0a2-338211930ca7-kube-api-access-vqm5h\") pod \"network-check-target-p6ljc\" (UID: \"fb1b162b-4e8a-466f-b0a2-338211930ca7\") " pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:07:12.632707 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.632672    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nb27\""
Jul 24 16:07:12.641027 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:12.641000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:07:13.272695 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.272664    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qswb4"]
Jul 24 16:07:13.285655 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:07:13.285604    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb943eabe_3fe7_4b72_b432_acb2e0a999f4.slice/crio-92538df03f2958af17718368e184d470ccab5f0068f2d16e1a0cfc51e32a4c25 WatchSource:0}: Error finding container 92538df03f2958af17718368e184d470ccab5f0068f2d16e1a0cfc51e32a4c25: Status 404 returned error can't find the container with id 92538df03f2958af17718368e184d470ccab5f0068f2d16e1a0cfc51e32a4c25
Jul 24 16:07:13.491342 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.491309    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dscj2"]
Jul 24 16:07:13.494955 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.494930    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p6ljc"]
Jul 24 16:07:13.495064 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:07:13.494979    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29617d35_46b4_4fa4_aa91_c048ca5b9889.slice/crio-5d3782be9a8a5a3fa1028a323e0645b1e161f0df61c8b3b7b5f070f1fe51a7c7 WatchSource:0}: Error finding container 5d3782be9a8a5a3fa1028a323e0645b1e161f0df61c8b3b7b5f070f1fe51a7c7: Status 404 returned error can't find the container with id 5d3782be9a8a5a3fa1028a323e0645b1e161f0df61c8b3b7b5f070f1fe51a7c7
Jul 24 16:07:13.497709 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:07:13.497685    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1b162b_4e8a_466f_b0a2_338211930ca7.slice/crio-bf693df4d360961a60064d4e16367d0680abb40478190f68194796da30e358c2 WatchSource:0}: Error finding container bf693df4d360961a60064d4e16367d0680abb40478190f68194796da30e358c2: Status 404 returned error can't find the container with id bf693df4d360961a60064d4e16367d0680abb40478190f68194796da30e358c2
Jul 24 16:07:13.804316 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.804280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qswb4" event={"ID":"b943eabe-3fe7-4b72-b432-acb2e0a999f4","Type":"ContainerStarted","Data":"92538df03f2958af17718368e184d470ccab5f0068f2d16e1a0cfc51e32a4c25"}
Jul 24 16:07:13.806088 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.806056    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv" event={"ID":"7f6a7ea0-79e5-4447-bd99-6912b382272c","Type":"ContainerStarted","Data":"ed1d8a174f338ed70fe0eb0deb8fc99fbb583bd324b0b758966d5021dd86c0c6"}
Jul 24 16:07:13.808372 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.808346    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swgns" event={"ID":"0fa8fe71-3432-4e48-959c-afb256df4318","Type":"ContainerStarted","Data":"00f57c258076cc05fe390a0b91fae50814b225ee13af7741c5585b4d42bcd2aa"}
Jul 24 16:07:13.811533 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.811481    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx" event={"ID":"1fcc78e9-9905-4bf5-8247-72bd7294f94f","Type":"ContainerStarted","Data":"02ab51c249f0e5b13ffe309b669631e934066ab9e35a5c31cff4f1af9d39f4d8"}
Jul 24 16:07:13.811533 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.811522    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx" event={"ID":"1fcc78e9-9905-4bf5-8247-72bd7294f94f","Type":"ContainerStarted","Data":"f4e1e7118d726af377563fe599d9a9ef01408960a2aebd7aaa5a4fe36dee39a6"}
Jul 24 16:07:13.811533 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.811539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx" event={"ID":"1fcc78e9-9905-4bf5-8247-72bd7294f94f","Type":"ContainerStarted","Data":"fa1feb2bbc2dac991945a767e18c0ea04c18c0c9be06ea95a9ad88fb5884ff9b"}
Jul 24 16:07:13.812900 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.812726    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p6ljc" event={"ID":"fb1b162b-4e8a-466f-b0a2-338211930ca7","Type":"ContainerStarted","Data":"bf693df4d360961a60064d4e16367d0680abb40478190f68194796da30e358c2"}
Jul 24 16:07:13.813845 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.813811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dscj2" event={"ID":"29617d35-46b4-4fa4-aa91-c048ca5b9889","Type":"ContainerStarted","Data":"5d3782be9a8a5a3fa1028a323e0645b1e161f0df61c8b3b7b5f070f1fe51a7c7"}
Jul 24 16:07:13.823959 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.823919    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869c9cc95b-qz5zv" podStartSLOduration=3.414214907 podStartE2EDuration="9.823900003s" totalImagesPullingTime="6.409685096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:13.822835426 +0000 UTC m=+67.807526210" watchObservedRunningTime="2026-07-24 16:07:13.823900003 +0000 UTC m=+67.808590801"
Jul 24 16:07:13.846370 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.846327    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575c65cff-w2xxx" podStartSLOduration=3.438990701 podStartE2EDuration="9.846315626s" totalImagesPullingTime="6.407324925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:13.845616836 +0000 UTC m=+67.830307618" watchObservedRunningTime="2026-07-24 16:07:13.846315626 +0000 UTC m=+67.831006385"
Jul 24 16:07:13.867455 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:13.867393    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-swgns" podStartSLOduration=17.934947247 podStartE2EDuration="32.867375692s" totalImagesPullingTime="14.932428445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:13.865961614 +0000 UTC m=+67.850652390" watchObservedRunningTime="2026-07-24 16:07:13.867375692 +0000 UTC m=+67.852066474"
Jul 24 16:07:14.667970 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:14.667929    2561 patch_prober.go:28] interesting pod/image-registry-5f8445b44b-ftb67 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 16:07:14.668366 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:14.667995    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67" podUID="e2735425-6a15-48a1-a318-e7b47d1bf833" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:07:14.824615 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:14.824532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qswb4" event={"ID":"b943eabe-3fe7-4b72-b432-acb2e0a999f4","Type":"ContainerStarted","Data":"1b19d1ff0323caf69010bede92fa40fd82d0097d786214f41db2d637fe2ffc90"}
Jul 24 16:07:14.824615 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:14.824592    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qswb4" event={"ID":"b943eabe-3fe7-4b72-b432-acb2e0a999f4","Type":"ContainerStarted","Data":"f01c208dac996f2a980dda55558a06d1518dee0ac55179b6dc0cbf0e783228e8"}
Jul 24 16:07:14.855147 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:14.855103    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qswb4" podStartSLOduration=67.70307436 podStartE2EDuration="1m8.855089221s" totalImagesPullingTime="1.152014861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:14.854809298 +0000 UTC m=+68.839500080" watchObservedRunningTime="2026-07-24 16:07:14.855089221 +0000 UTC m=+68.839780002"
Jul 24 16:07:18.838455 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:18.838363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p6ljc" event={"ID":"fb1b162b-4e8a-466f-b0a2-338211930ca7","Type":"ContainerStarted","Data":"8ace97d6e6e3d173642a1a49a3a2c0a0434187457519138c9dace53bcf041e92"}
Jul 24 16:07:18.838927 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:18.838478    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:07:18.839874 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:18.839848    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dscj2" event={"ID":"29617d35-46b4-4fa4-aa91-c048ca5b9889","Type":"ContainerStarted","Data":"56a0865402ced1f7fb6fa65cc047586e247bba78604e5f46f10548d1d5aac2b9"}
Jul 24 16:07:18.859039 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:18.858983    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p6ljc" podStartSLOduration=68.349765122 podStartE2EDuration="1m12.858958641s" totalImagesPullingTime="4.509193519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:18.857146859 +0000 UTC m=+72.841837639" watchObservedRunningTime="2026-07-24 16:07:18.858958641 +0000 UTC m=+72.843649423"
Jul 24 16:07:18.877504 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:18.877447    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dscj2" podStartSLOduration=68.362060022 podStartE2EDuration="1m12.877431316s" totalImagesPullingTime="4.515371294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:18.875738243 +0000 UTC m=+72.860429024" watchObservedRunningTime="2026-07-24 16:07:18.877431316 +0000 UTC m=+72.862122098"
Jul 24 16:07:24.663990 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:24.663965    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:07:29.681069 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:29.680941    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67" podUID="e2735425-6a15-48a1-a318-e7b47d1bf833" containerName="registry" containerID="cri-o://b0ec874b8e1aa01dba50968c63dfa5ed54145414a743046ef18b26fe2cbeda0c" gracePeriod=30
Jul 24 16:07:29.794994 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:29.794968    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6db78ddb6f-vxjx8"
Jul 24 16:07:29.876768 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:29.876745    2561 generic.go:356] "Generic (PLEG): container finished" podID="e2735425-6a15-48a1-a318-e7b47d1bf833" containerID="b0ec874b8e1aa01dba50968c63dfa5ed54145414a743046ef18b26fe2cbeda0c" exitCode=0
Jul 24 16:07:29.876875 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:29.876809    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67" event={"ID":"e2735425-6a15-48a1-a318-e7b47d1bf833","Type":"ContainerDied","Data":"b0ec874b8e1aa01dba50968c63dfa5ed54145414a743046ef18b26fe2cbeda0c"}
Jul 24 16:07:29.942722 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:29.942670    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:07:30.028081 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.028053    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4zfx\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-kube-api-access-z4zfx\") pod \"e2735425-6a15-48a1-a318-e7b47d1bf833\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") "
Jul 24 16:07:30.028081 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.028081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-bound-sa-token\") pod \"e2735425-6a15-48a1-a318-e7b47d1bf833\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") "
Jul 24 16:07:30.028303 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.028123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2735425-6a15-48a1-a318-e7b47d1bf833-ca-trust-extracted\") pod \"e2735425-6a15-48a1-a318-e7b47d1bf833\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") "
Jul 24 16:07:30.028303 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.028149    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-image-registry-private-configuration\") pod \"e2735425-6a15-48a1-a318-e7b47d1bf833\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") "
Jul 24 16:07:30.028303 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.028181    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-trusted-ca\") pod \"e2735425-6a15-48a1-a318-e7b47d1bf833\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") "
Jul 24 16:07:30.028303 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.028226    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-certificates\") pod \"e2735425-6a15-48a1-a318-e7b47d1bf833\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") "
Jul 24 16:07:30.028303 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.028255    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") pod \"e2735425-6a15-48a1-a318-e7b47d1bf833\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") "
Jul 24 16:07:30.028303 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.028279    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-installation-pull-secrets\") pod \"e2735425-6a15-48a1-a318-e7b47d1bf833\" (UID: \"e2735425-6a15-48a1-a318-e7b47d1bf833\") "
Jul 24 16:07:30.029085 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.028726    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e2735425-6a15-48a1-a318-e7b47d1bf833" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:07:30.029262 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.029219    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e2735425-6a15-48a1-a318-e7b47d1bf833" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:07:30.031005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.030884    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-kube-api-access-z4zfx" (OuterVolumeSpecName: "kube-api-access-z4zfx") pod "e2735425-6a15-48a1-a318-e7b47d1bf833" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833"). InnerVolumeSpecName "kube-api-access-z4zfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:07:30.031005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.030959    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e2735425-6a15-48a1-a318-e7b47d1bf833" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:07:30.031005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.030971    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e2735425-6a15-48a1-a318-e7b47d1bf833" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:07:30.031234 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.031133    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e2735425-6a15-48a1-a318-e7b47d1bf833" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:07:30.031234 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.031212    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e2735425-6a15-48a1-a318-e7b47d1bf833" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:07:30.037796 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.037773    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2735425-6a15-48a1-a318-e7b47d1bf833-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e2735425-6a15-48a1-a318-e7b47d1bf833" (UID: "e2735425-6a15-48a1-a318-e7b47d1bf833"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:07:30.129087 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.129054    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4zfx\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-kube-api-access-z4zfx\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:07:30.129087 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.129080    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-bound-sa-token\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:07:30.129087 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.129091    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2735425-6a15-48a1-a318-e7b47d1bf833-ca-trust-extracted\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:07:30.129296 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.129099    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-image-registry-private-configuration\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:07:30.129296 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.129110    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-trusted-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:07:30.129296 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.129117    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-certificates\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:07:30.129296 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.129125    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2735425-6a15-48a1-a318-e7b47d1bf833-registry-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:07:30.129296 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.129133    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2735425-6a15-48a1-a318-e7b47d1bf833-installation-pull-secrets\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:07:30.881156 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.881120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67" event={"ID":"e2735425-6a15-48a1-a318-e7b47d1bf833","Type":"ContainerDied","Data":"635dc1b75e9af4fddc23ac87f5cf1966d02c745d776aa069c8ef94ee386707bd"}
Jul 24 16:07:30.881531 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.881167    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f8445b44b-ftb67"
Jul 24 16:07:30.881531 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.881191    2561 scope.go:117] "RemoveContainer" containerID="b0ec874b8e1aa01dba50968c63dfa5ed54145414a743046ef18b26fe2cbeda0c"
Jul 24 16:07:30.897604 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.897580    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f8445b44b-ftb67"]
Jul 24 16:07:30.901181 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:30.901160    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f8445b44b-ftb67"]
Jul 24 16:07:32.506230 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:32.506197    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2735425-6a15-48a1-a318-e7b47d1bf833" path="/var/lib/kubelet/pods/e2735425-6a15-48a1-a318-e7b47d1bf833/volumes"
Jul 24 16:07:45.844001 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:45.841749    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8fshp"]
Jul 24 16:07:45.844001 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:45.842211    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2735425-6a15-48a1-a318-e7b47d1bf833" containerName="registry"
Jul 24 16:07:45.844001 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:45.842229    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2735425-6a15-48a1-a318-e7b47d1bf833" containerName="registry"
Jul 24 16:07:45.844001 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:45.842334    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2735425-6a15-48a1-a318-e7b47d1bf833" containerName="registry"
Jul 24 16:07:46.243724 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.243691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.247605 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.247582    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 16:07:46.247832 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.247799    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 16:07:46.247957 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.247744    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 16:07:46.247957 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.247902    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 16:07:46.247957 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.247586    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q9pb8\""
Jul 24 16:07:46.248121 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.247970    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 16:07:46.248121 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.247812    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 16:07:46.338653 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.338610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c420587-d825-4a49-8e05-5e56b1671462-root\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.338816 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.338694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.338816 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.338737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c420587-d825-4a49-8e05-5e56b1671462-metrics-client-ca\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.338816 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.338770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-textfile\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.338816 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.338799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbjjt\" (UniqueName: \"kubernetes.io/projected/5c420587-d825-4a49-8e05-5e56b1671462-kube-api-access-dbjjt\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.338816 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.338816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-tls\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.339011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.338834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-wtmp\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.339011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.338892    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c420587-d825-4a49-8e05-5e56b1671462-sys\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.339011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.338920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-accelerators-collector-config\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.439878 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.439838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c420587-d825-4a49-8e05-5e56b1671462-sys\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.439878 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.439883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-accelerators-collector-config\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.439900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c420587-d825-4a49-8e05-5e56b1671462-root\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.439918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.439951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c420587-d825-4a49-8e05-5e56b1671462-sys\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.439956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c420587-d825-4a49-8e05-5e56b1671462-metrics-client-ca\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.439970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c420587-d825-4a49-8e05-5e56b1671462-root\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.440019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-textfile\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.440051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbjjt\" (UniqueName: \"kubernetes.io/projected/5c420587-d825-4a49-8e05-5e56b1671462-kube-api-access-dbjjt\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440084 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.440068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-tls\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440467 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.440091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-wtmp\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440467 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.440235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-wtmp\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440576 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.440518    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-textfile\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440576 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.440550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-accelerators-collector-config\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.440711 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.440595    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c420587-d825-4a49-8e05-5e56b1671462-metrics-client-ca\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.442682 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.442659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-tls\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.442803 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.442733    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c420587-d825-4a49-8e05-5e56b1671462-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.449176 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.449149    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbjjt\" (UniqueName: \"kubernetes.io/projected/5c420587-d825-4a49-8e05-5e56b1671462-kube-api-access-dbjjt\") pod \"node-exporter-8fshp\" (UID: \"5c420587-d825-4a49-8e05-5e56b1671462\") " pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.553657 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.553547    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8fshp"
Jul 24 16:07:46.581653 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:07:46.581613    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c420587_d825_4a49_8e05_5e56b1671462.slice/crio-8b9a7086afc9f18e2f9968c5140369afac7e8c9ad1f73dd6d1106d34e0015185 WatchSource:0}: Error finding container 8b9a7086afc9f18e2f9968c5140369afac7e8c9ad1f73dd6d1106d34e0015185: Status 404 returned error can't find the container with id 8b9a7086afc9f18e2f9968c5140369afac7e8c9ad1f73dd6d1106d34e0015185
Jul 24 16:07:46.933271 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:46.933232    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fshp" event={"ID":"5c420587-d825-4a49-8e05-5e56b1671462","Type":"ContainerStarted","Data":"8b9a7086afc9f18e2f9968c5140369afac7e8c9ad1f73dd6d1106d34e0015185"}
Jul 24 16:07:48.941028 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:48.940997    2561 generic.go:356] "Generic (PLEG): container finished" podID="5c420587-d825-4a49-8e05-5e56b1671462" containerID="b7b20f6d2e1094fcf965c8bbc750bf79b28cdcb8fc617bcf6514a78161221ad2" exitCode=0
Jul 24 16:07:48.941395 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:48.941085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fshp" event={"ID":"5c420587-d825-4a49-8e05-5e56b1671462","Type":"ContainerDied","Data":"b7b20f6d2e1094fcf965c8bbc750bf79b28cdcb8fc617bcf6514a78161221ad2"}
Jul 24 16:07:49.845507 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:49.845477    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p6ljc"
Jul 24 16:07:49.945910 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:49.945876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fshp" event={"ID":"5c420587-d825-4a49-8e05-5e56b1671462","Type":"ContainerStarted","Data":"e6d6dde005ae38bf16e394881c25993e69ca07210b496ebbdf7b18f575029c40"}
Jul 24 16:07:49.946281 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:49.945937    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fshp" event={"ID":"5c420587-d825-4a49-8e05-5e56b1671462","Type":"ContainerStarted","Data":"754cb1de263abe533dbe1001bb11ac52a51dd1462ab5afe74a9b68d5d6e43213"}
Jul 24 16:07:49.972503 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:07:49.972455    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8fshp" podStartSLOduration=3.422294688 podStartE2EDuration="4.972441971s" totalImagesPullingTime="1.454166002s" totalInitContainerRuntime="95.981281ms" isStatefulPod=true podCreationTimestamp="2026-07-24 16:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:49.971083957 +0000 UTC m=+103.955774737" watchObservedRunningTime="2026-07-24 16:07:49.972441971 +0000 UTC m=+103.957132752"
Jul 24 16:11:06.371363 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:06.371333    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 16:11:36.801089 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:36.801055    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"]
Jul 24 16:11:36.803017 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:36.803000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:36.805824 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:36.805801    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 16:11:36.806570 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:36.806556    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-phxzg\""
Jul 24 16:11:36.806616 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:36.806558    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 16:11:36.819603 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:36.819578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"]
Jul 24 16:11:36.992382 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:36.992353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56crn\" (UniqueName: \"kubernetes.io/projected/9630e157-cdfe-4d84-b811-188ea6f5cfa1-kube-api-access-56crn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:36.992551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:36.992398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:36.992551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:36.992478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:37.093820 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.093738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:37.093820 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.093784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:37.093820 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.093817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56crn\" (UniqueName: \"kubernetes.io/projected/9630e157-cdfe-4d84-b811-188ea6f5cfa1-kube-api-access-56crn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:37.094195 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.094171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:37.094235 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.094182    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:37.102922 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.102892    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56crn\" (UniqueName: \"kubernetes.io/projected/9630e157-cdfe-4d84-b811-188ea6f5cfa1-kube-api-access-56crn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:37.111566 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.111547    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:37.240623 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.240593    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"]
Jul 24 16:11:37.243909 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:11:37.243867    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9630e157_cdfe_4d84_b811_188ea6f5cfa1.slice/crio-bca2fc35bc5a46430344823d4f23c5f5a0d8ff088c7cddf2d182c9d95a19d346 WatchSource:0}: Error finding container bca2fc35bc5a46430344823d4f23c5f5a0d8ff088c7cddf2d182c9d95a19d346: Status 404 returned error can't find the container with id bca2fc35bc5a46430344823d4f23c5f5a0d8ff088c7cddf2d182c9d95a19d346
Jul 24 16:11:37.245712 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.245693    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:11:37.657910 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:37.657876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn" event={"ID":"9630e157-cdfe-4d84-b811-188ea6f5cfa1","Type":"ContainerStarted","Data":"bca2fc35bc5a46430344823d4f23c5f5a0d8ff088c7cddf2d182c9d95a19d346"}
Jul 24 16:11:43.681608 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:43.681576    2561 generic.go:356] "Generic (PLEG): container finished" podID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerID="2fc6082ed1cf344a6bef352cbfbba552f65b0c8e1fcc641f3b02125067785027" exitCode=0
Jul 24 16:11:43.682015 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:43.681616    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn" event={"ID":"9630e157-cdfe-4d84-b811-188ea6f5cfa1","Type":"ContainerDied","Data":"2fc6082ed1cf344a6bef352cbfbba552f65b0c8e1fcc641f3b02125067785027"}
Jul 24 16:11:45.691460 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:45.691427    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn" event={"ID":"9630e157-cdfe-4d84-b811-188ea6f5cfa1","Type":"ContainerStarted","Data":"f6ffb2145ffe55566f8a431fe0bd6c6f6f0b4448eb3571dada7ea1e17d86dd83"}
Jul 24 16:11:46.695967 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:46.695925    2561 generic.go:356] "Generic (PLEG): container finished" podID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerID="f6ffb2145ffe55566f8a431fe0bd6c6f6f0b4448eb3571dada7ea1e17d86dd83" exitCode=0
Jul 24 16:11:46.696442 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:46.695976    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn" event={"ID":"9630e157-cdfe-4d84-b811-188ea6f5cfa1","Type":"ContainerDied","Data":"f6ffb2145ffe55566f8a431fe0bd6c6f6f0b4448eb3571dada7ea1e17d86dd83"}
Jul 24 16:11:53.724121 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:53.724087    2561 generic.go:356] "Generic (PLEG): container finished" podID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerID="62fc51eda773d8df91b7ec5aba8375afb38603c85ed8457124a8ce9d0490d17e" exitCode=0
Jul 24 16:11:53.724475 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:53.724161    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn" event={"ID":"9630e157-cdfe-4d84-b811-188ea6f5cfa1","Type":"ContainerDied","Data":"62fc51eda773d8df91b7ec5aba8375afb38603c85ed8457124a8ce9d0490d17e"}
Jul 24 16:11:54.849722 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:54.849698    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:54.925910 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:54.925886    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-util\") pod \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") "
Jul 24 16:11:54.926051 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:54.925947    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56crn\" (UniqueName: \"kubernetes.io/projected/9630e157-cdfe-4d84-b811-188ea6f5cfa1-kube-api-access-56crn\") pod \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") "
Jul 24 16:11:54.926051 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:54.925986    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-bundle\") pod \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\" (UID: \"9630e157-cdfe-4d84-b811-188ea6f5cfa1\") "
Jul 24 16:11:54.926681 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:54.926631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-bundle" (OuterVolumeSpecName: "bundle") pod "9630e157-cdfe-4d84-b811-188ea6f5cfa1" (UID: "9630e157-cdfe-4d84-b811-188ea6f5cfa1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:11:54.928177 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:54.928156    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9630e157-cdfe-4d84-b811-188ea6f5cfa1-kube-api-access-56crn" (OuterVolumeSpecName: "kube-api-access-56crn") pod "9630e157-cdfe-4d84-b811-188ea6f5cfa1" (UID: "9630e157-cdfe-4d84-b811-188ea6f5cfa1"). InnerVolumeSpecName "kube-api-access-56crn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:11:54.930927 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:54.930899    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-util" (OuterVolumeSpecName: "util") pod "9630e157-cdfe-4d84-b811-188ea6f5cfa1" (UID: "9630e157-cdfe-4d84-b811-188ea6f5cfa1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:11:55.026900 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:55.026829    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56crn\" (UniqueName: \"kubernetes.io/projected/9630e157-cdfe-4d84-b811-188ea6f5cfa1-kube-api-access-56crn\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:11:55.026900 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:55.026855    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-bundle\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:11:55.026900 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:55.026864    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9630e157-cdfe-4d84-b811-188ea6f5cfa1-util\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:11:55.732163 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:55.732126    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn" event={"ID":"9630e157-cdfe-4d84-b811-188ea6f5cfa1","Type":"ContainerDied","Data":"bca2fc35bc5a46430344823d4f23c5f5a0d8ff088c7cddf2d182c9d95a19d346"}
Jul 24 16:11:55.732163 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:55.732152    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wmhn"
Jul 24 16:11:55.732365 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:55.732173    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bca2fc35bc5a46430344823d4f23c5f5a0d8ff088c7cddf2d182c9d95a19d346"
Jul 24 16:11:59.969607 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:59.969528    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"]
Jul 24 16:11:59.970090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:59.969854    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerName="util"
Jul 24 16:11:59.970090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:59.969871    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerName="util"
Jul 24 16:11:59.970090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:59.969890    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerName="pull"
Jul 24 16:11:59.970090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:59.969899    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerName="pull"
Jul 24 16:11:59.970090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:59.969912    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerName="extract"
Jul 24 16:11:59.970090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:59.969921    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerName="extract"
Jul 24 16:11:59.970090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:11:59.969986    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9630e157-cdfe-4d84-b811-188ea6f5cfa1" containerName="extract"
Jul 24 16:12:00.015778 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.015756    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"]
Jul 24 16:12:00.015935 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.015863    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"
Jul 24 16:12:00.018789 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.018768    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v9zqj\""
Jul 24 16:12:00.019000 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.018985    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 16:12:00.019249 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.019232    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:12:00.063158 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.063135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ghk\" (UniqueName: \"kubernetes.io/projected/a5fb5571-1010-41bc-8b61-13076effa862-kube-api-access-v2ghk\") pod \"cert-manager-operator-controller-manager-55c444bf86-skktm\" (UID: \"a5fb5571-1010-41bc-8b61-13076effa862\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"
Jul 24 16:12:00.063262 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.063167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5fb5571-1010-41bc-8b61-13076effa862-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-skktm\" (UID: \"a5fb5571-1010-41bc-8b61-13076effa862\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"
Jul 24 16:12:00.163563 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.163539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ghk\" (UniqueName: \"kubernetes.io/projected/a5fb5571-1010-41bc-8b61-13076effa862-kube-api-access-v2ghk\") pod \"cert-manager-operator-controller-manager-55c444bf86-skktm\" (UID: \"a5fb5571-1010-41bc-8b61-13076effa862\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"
Jul 24 16:12:00.163691 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.163572    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5fb5571-1010-41bc-8b61-13076effa862-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-skktm\" (UID: \"a5fb5571-1010-41bc-8b61-13076effa862\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"
Jul 24 16:12:00.163900 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.163885    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5fb5571-1010-41bc-8b61-13076effa862-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-skktm\" (UID: \"a5fb5571-1010-41bc-8b61-13076effa862\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"
Jul 24 16:12:00.172347 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.172327    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ghk\" (UniqueName: \"kubernetes.io/projected/a5fb5571-1010-41bc-8b61-13076effa862-kube-api-access-v2ghk\") pod \"cert-manager-operator-controller-manager-55c444bf86-skktm\" (UID: \"a5fb5571-1010-41bc-8b61-13076effa862\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"
Jul 24 16:12:00.325232 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.325158    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"
Jul 24 16:12:00.474686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.474654    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm"]
Jul 24 16:12:00.478486 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:12:00.478455    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fb5571_1010_41bc_8b61_13076effa862.slice/crio-2702140ee70bbdf8cbad90408c6ae69b2f1348d29f99c3822c3c17c84e521fbf WatchSource:0}: Error finding container 2702140ee70bbdf8cbad90408c6ae69b2f1348d29f99c3822c3c17c84e521fbf: Status 404 returned error can't find the container with id 2702140ee70bbdf8cbad90408c6ae69b2f1348d29f99c3822c3c17c84e521fbf
Jul 24 16:12:00.749319 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:00.749281    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm" event={"ID":"a5fb5571-1010-41bc-8b61-13076effa862","Type":"ContainerStarted","Data":"2702140ee70bbdf8cbad90408c6ae69b2f1348d29f99c3822c3c17c84e521fbf"}
Jul 24 16:12:02.761882 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:02.761841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm" event={"ID":"a5fb5571-1010-41bc-8b61-13076effa862","Type":"ContainerStarted","Data":"f132ed3488b4b21e10f3f350a0d7d2309d6492a653e7b82a8359b71fbce33e9f"}
Jul 24 16:12:02.796660 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:02.796391    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skktm" podStartSLOduration=1.706928022 podStartE2EDuration="3.796372924s" totalImagesPullingTime="2.089444902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:12:02.79586461 +0000 UTC m=+356.780555393" watchObservedRunningTime="2026-07-24 16:12:02.796372924 +0000 UTC m=+356.781063706"
Jul 24 16:12:03.705302 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.705267    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"]
Jul 24 16:12:03.726759 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.726734    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"]
Jul 24 16:12:03.726908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.726826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:03.732808 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.732785    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 16:12:03.732956 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.732811    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 16:12:03.733699 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.733682    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-phxzg\""
Jul 24 16:12:03.791091 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.791065    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:03.791446 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.791098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:03.791446 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.791124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ttkf\" (UniqueName: \"kubernetes.io/projected/16ab60dc-0650-4ad2-a7e2-484575a97aa9-kube-api-access-4ttkf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:03.892149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.892119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:03.892149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.892154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:03.892329 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.892182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ttkf\" (UniqueName: \"kubernetes.io/projected/16ab60dc-0650-4ad2-a7e2-484575a97aa9-kube-api-access-4ttkf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:03.892526 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.892500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:03.892567 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.892551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:03.919796 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:03.919772    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ttkf\" (UniqueName: \"kubernetes.io/projected/16ab60dc-0650-4ad2-a7e2-484575a97aa9-kube-api-access-4ttkf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:04.035894 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:04.035819    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:04.185258 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:04.185238    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"]
Jul 24 16:12:04.187749 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:12:04.187725    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ab60dc_0650_4ad2_a7e2_484575a97aa9.slice/crio-8e29c3501882b1bc1e6eba1f330913e46dbdda220071f962d295adfd3feeadbd WatchSource:0}: Error finding container 8e29c3501882b1bc1e6eba1f330913e46dbdda220071f962d295adfd3feeadbd: Status 404 returned error can't find the container with id 8e29c3501882b1bc1e6eba1f330913e46dbdda220071f962d295adfd3feeadbd
Jul 24 16:12:04.771094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:04.771063    2561 generic.go:356] "Generic (PLEG): container finished" podID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerID="0b975794d6bb520d17321ec89135acf9d7e64ba7d41916d91ddbfa91356955d6" exitCode=0
Jul 24 16:12:04.771255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:04.771125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p" event={"ID":"16ab60dc-0650-4ad2-a7e2-484575a97aa9","Type":"ContainerDied","Data":"0b975794d6bb520d17321ec89135acf9d7e64ba7d41916d91ddbfa91356955d6"}
Jul 24 16:12:04.771255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:04.771165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p" event={"ID":"16ab60dc-0650-4ad2-a7e2-484575a97aa9","Type":"ContainerStarted","Data":"8e29c3501882b1bc1e6eba1f330913e46dbdda220071f962d295adfd3feeadbd"}
Jul 24 16:12:06.782827 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:06.782793    2561 generic.go:356] "Generic (PLEG): container finished" podID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerID="594c5ba391c9e4c3b41bc31f6398cb17d5088cdc75dd92c0d74cd01659297348" exitCode=0
Jul 24 16:12:06.783176 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:06.782843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p" event={"ID":"16ab60dc-0650-4ad2-a7e2-484575a97aa9","Type":"ContainerDied","Data":"594c5ba391c9e4c3b41bc31f6398cb17d5088cdc75dd92c0d74cd01659297348"}
Jul 24 16:12:07.789054 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:07.789020    2561 generic.go:356] "Generic (PLEG): container finished" podID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerID="5783fe2473a59ba392391e0b906a5978841cb3337441774d0c72025d7048a397" exitCode=0
Jul 24 16:12:07.789418 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:07.789100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p" event={"ID":"16ab60dc-0650-4ad2-a7e2-484575a97aa9","Type":"ContainerDied","Data":"5783fe2473a59ba392391e0b906a5978841cb3337441774d0c72025d7048a397"}
Jul 24 16:12:08.912297 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:08.912276    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:09.035924 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.035895    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ttkf\" (UniqueName: \"kubernetes.io/projected/16ab60dc-0650-4ad2-a7e2-484575a97aa9-kube-api-access-4ttkf\") pod \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") "
Jul 24 16:12:09.035924 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.035928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-bundle\") pod \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") "
Jul 24 16:12:09.036140 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.035991    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-util\") pod \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\" (UID: \"16ab60dc-0650-4ad2-a7e2-484575a97aa9\") "
Jul 24 16:12:09.036379 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.036347    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-bundle" (OuterVolumeSpecName: "bundle") pod "16ab60dc-0650-4ad2-a7e2-484575a97aa9" (UID: "16ab60dc-0650-4ad2-a7e2-484575a97aa9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:12:09.038176 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.038154    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ab60dc-0650-4ad2-a7e2-484575a97aa9-kube-api-access-4ttkf" (OuterVolumeSpecName: "kube-api-access-4ttkf") pod "16ab60dc-0650-4ad2-a7e2-484575a97aa9" (UID: "16ab60dc-0650-4ad2-a7e2-484575a97aa9"). InnerVolumeSpecName "kube-api-access-4ttkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:12:09.041223 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.041193    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-util" (OuterVolumeSpecName: "util") pod "16ab60dc-0650-4ad2-a7e2-484575a97aa9" (UID: "16ab60dc-0650-4ad2-a7e2-484575a97aa9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:12:09.136645 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.136607    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ttkf\" (UniqueName: \"kubernetes.io/projected/16ab60dc-0650-4ad2-a7e2-484575a97aa9-kube-api-access-4ttkf\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:12:09.136794 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.136661    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-bundle\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:12:09.136794 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.136670    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ab60dc-0650-4ad2-a7e2-484575a97aa9-util\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:12:09.797947 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.797917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p" event={"ID":"16ab60dc-0650-4ad2-a7e2-484575a97aa9","Type":"ContainerDied","Data":"8e29c3501882b1bc1e6eba1f330913e46dbdda220071f962d295adfd3feeadbd"}
Jul 24 16:12:09.797947 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.797955    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjhp2p"
Jul 24 16:12:09.798193 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:09.797962    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e29c3501882b1bc1e6eba1f330913e46dbdda220071f962d295adfd3feeadbd"
Jul 24 16:12:20.158504 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.158463    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"]
Jul 24 16:12:20.159011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.158853    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerName="util"
Jul 24 16:12:20.159011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.158872    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerName="util"
Jul 24 16:12:20.159011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.158887    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerName="pull"
Jul 24 16:12:20.159011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.158895    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerName="pull"
Jul 24 16:12:20.159011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.158910    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerName="extract"
Jul 24 16:12:20.159011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.158918    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerName="extract"
Jul 24 16:12:20.159011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.158973    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ab60dc-0650-4ad2-a7e2-484575a97aa9" containerName="extract"
Jul 24 16:12:20.161070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.161050    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.165674 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.165650    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-phxzg\""
Jul 24 16:12:20.166054 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.166036    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 16:12:20.166487 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.166469    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 16:12:20.193506 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.193474    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"]
Jul 24 16:12:20.220309 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.220279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr296\" (UniqueName: \"kubernetes.io/projected/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-kube-api-access-kr296\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.220432 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.220330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.220432 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.220349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.320954 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.320918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr296\" (UniqueName: \"kubernetes.io/projected/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-kube-api-access-kr296\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.321106 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.320970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.321106 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.320996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.321365 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.321347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.321405 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.321365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.337622 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.337592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr296\" (UniqueName: \"kubernetes.io/projected/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-kube-api-access-kr296\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.469494 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.469396    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:20.599172 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.599141    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"]
Jul 24 16:12:20.602165 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:12:20.602141    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2347b8a1_7260_47cb_bd4f_0a62d39ef2e9.slice/crio-689bf30f769643fabaa510093d1d200e43a7aa5d2a34ced92490fdebf900ede2 WatchSource:0}: Error finding container 689bf30f769643fabaa510093d1d200e43a7aa5d2a34ced92490fdebf900ede2: Status 404 returned error can't find the container with id 689bf30f769643fabaa510093d1d200e43a7aa5d2a34ced92490fdebf900ede2
Jul 24 16:12:20.838448 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.838367    2561 generic.go:356] "Generic (PLEG): container finished" podID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerID="bbe077fd93f7e3d7b1e45e7db3d4bf98c10da726d732fc6d5743131815c29a11" exitCode=0
Jul 24 16:12:20.838448 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.838401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx" event={"ID":"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9","Type":"ContainerDied","Data":"bbe077fd93f7e3d7b1e45e7db3d4bf98c10da726d732fc6d5743131815c29a11"}
Jul 24 16:12:20.838448 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:20.838437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx" event={"ID":"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9","Type":"ContainerStarted","Data":"689bf30f769643fabaa510093d1d200e43a7aa5d2a34ced92490fdebf900ede2"}
Jul 24 16:12:21.844416 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:21.844382    2561 generic.go:356] "Generic (PLEG): container finished" podID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerID="399cfa7ce20dea55a43991202dd005adfa1f623eeb9a6e660d26b8a3061ab126" exitCode=0
Jul 24 16:12:21.844835 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:21.844455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx" event={"ID":"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9","Type":"ContainerDied","Data":"399cfa7ce20dea55a43991202dd005adfa1f623eeb9a6e660d26b8a3061ab126"}
Jul 24 16:12:22.851054 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:22.851019    2561 generic.go:356] "Generic (PLEG): container finished" podID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerID="22130b054a90fd15d1024c32d3637c13ee56421bbcfd53b9d443088ac3048cfb" exitCode=0
Jul 24 16:12:22.851440 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:22.851112    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx" event={"ID":"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9","Type":"ContainerDied","Data":"22130b054a90fd15d1024c32d3637c13ee56421bbcfd53b9d443088ac3048cfb"}
Jul 24 16:12:23.978339 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:23.978317    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:24.052062 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.052034    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-util\") pod \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") "
Jul 24 16:12:24.052213 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.052097    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr296\" (UniqueName: \"kubernetes.io/projected/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-kube-api-access-kr296\") pod \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") "
Jul 24 16:12:24.052213 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.052114    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-bundle\") pod \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\" (UID: \"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9\") "
Jul 24 16:12:24.052867 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.052783    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-bundle" (OuterVolumeSpecName: "bundle") pod "2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" (UID: "2347b8a1-7260-47cb-bd4f-0a62d39ef2e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:12:24.054273 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.054254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-kube-api-access-kr296" (OuterVolumeSpecName: "kube-api-access-kr296") pod "2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" (UID: "2347b8a1-7260-47cb-bd4f-0a62d39ef2e9"). InnerVolumeSpecName "kube-api-access-kr296". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:12:24.060282 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.060242    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-util" (OuterVolumeSpecName: "util") pod "2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" (UID: "2347b8a1-7260-47cb-bd4f-0a62d39ef2e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:12:24.152608 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.152535    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-util\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:12:24.152608 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.152562    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr296\" (UniqueName: \"kubernetes.io/projected/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-kube-api-access-kr296\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:12:24.152608 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.152572    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2347b8a1-7260-47cb-bd4f-0a62d39ef2e9-bundle\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:12:24.862037 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.862001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx" event={"ID":"2347b8a1-7260-47cb-bd4f-0a62d39ef2e9","Type":"ContainerDied","Data":"689bf30f769643fabaa510093d1d200e43a7aa5d2a34ced92490fdebf900ede2"}
Jul 24 16:12:24.862189 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.862059    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="689bf30f769643fabaa510093d1d200e43a7aa5d2a34ced92490fdebf900ede2"
Jul 24 16:12:24.862189 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:24.862014    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjwqbx"
Jul 24 16:12:36.826978 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.826943    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"]
Jul 24 16:12:36.827408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.827185    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerName="util"
Jul 24 16:12:36.827408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.827197    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerName="util"
Jul 24 16:12:36.827408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.827210    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerName="pull"
Jul 24 16:12:36.827408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.827215    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerName="pull"
Jul 24 16:12:36.827408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.827226    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerName="extract"
Jul 24 16:12:36.827408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.827231    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerName="extract"
Jul 24 16:12:36.827408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.827274    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2347b8a1-7260-47cb-bd4f-0a62d39ef2e9" containerName="extract"
Jul 24 16:12:36.849484 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.849457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:36.853292 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.853267    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 16:12:36.853399 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.853347    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 16:12:36.853625 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.853607    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 16:12:36.853751 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.853624    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zw9nh\""
Jul 24 16:12:36.853751 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.853733    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 16:12:36.867394 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.867373    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"]
Jul 24 16:12:36.939994 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.939960    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9c59d29-6b9a-4370-8208-33974f3a1628-tmp\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:36.940164 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.940001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxpjc\" (UniqueName: \"kubernetes.io/projected/c9c59d29-6b9a-4370-8208-33974f3a1628-kube-api-access-wxpjc\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:36.940164 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.940036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9c59d29-6b9a-4370-8208-33974f3a1628-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:36.940164 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.940098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9c59d29-6b9a-4370-8208-33974f3a1628-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:36.940267 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:36.940164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9c59d29-6b9a-4370-8208-33974f3a1628-manifests\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.040854 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.040813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9c59d29-6b9a-4370-8208-33974f3a1628-tmp\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.041033 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.040860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxpjc\" (UniqueName: \"kubernetes.io/projected/c9c59d29-6b9a-4370-8208-33974f3a1628-kube-api-access-wxpjc\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.041033 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.041005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9c59d29-6b9a-4370-8208-33974f3a1628-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.041150 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.041079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9c59d29-6b9a-4370-8208-33974f3a1628-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.041150 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.041142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9c59d29-6b9a-4370-8208-33974f3a1628-manifests\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.041448 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.041428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9c59d29-6b9a-4370-8208-33974f3a1628-manifests\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.043049 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.043029    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9c59d29-6b9a-4370-8208-33974f3a1628-tmp\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.043324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.043306    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9c59d29-6b9a-4370-8208-33974f3a1628-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.043370 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.043355    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9c59d29-6b9a-4370-8208-33974f3a1628-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.057401 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.057383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxpjc\" (UniqueName: \"kubernetes.io/projected/c9c59d29-6b9a-4370-8208-33974f3a1628-kube-api-access-wxpjc\") pod \"opendatahub-operator-controller-manager-5d6c795b6-ln7c4\" (UID: \"c9c59d29-6b9a-4370-8208-33974f3a1628\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.158510 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.158485    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:37.296533 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.296510    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"]
Jul 24 16:12:37.298978 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:12:37.298945    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c59d29_6b9a_4370_8208_33974f3a1628.slice/crio-ceb01d0173c16d69f3b7a0539b9690f144f3e105ec9b875ab9797990616bfbc9 WatchSource:0}: Error finding container ceb01d0173c16d69f3b7a0539b9690f144f3e105ec9b875ab9797990616bfbc9: Status 404 returned error can't find the container with id ceb01d0173c16d69f3b7a0539b9690f144f3e105ec9b875ab9797990616bfbc9
Jul 24 16:12:37.920003 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:37.919964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4" event={"ID":"c9c59d29-6b9a-4370-8208-33974f3a1628","Type":"ContainerStarted","Data":"ceb01d0173c16d69f3b7a0539b9690f144f3e105ec9b875ab9797990616bfbc9"}
Jul 24 16:12:40.934174 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:40.934135    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4" event={"ID":"c9c59d29-6b9a-4370-8208-33974f3a1628","Type":"ContainerStarted","Data":"68949266183bcedb61e7b04fdb4821712409ace935e6c47242d79677712c06eb"}
Jul 24 16:12:41.939207 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:41.939174    2561 generic.go:356] "Generic (PLEG): container finished" podID="c9c59d29-6b9a-4370-8208-33974f3a1628" containerID="68949266183bcedb61e7b04fdb4821712409ace935e6c47242d79677712c06eb" exitCode=0
Jul 24 16:12:41.939714 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:41.939261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4" event={"ID":"c9c59d29-6b9a-4370-8208-33974f3a1628","Type":"ContainerDied","Data":"68949266183bcedb61e7b04fdb4821712409ace935e6c47242d79677712c06eb"}
Jul 24 16:12:42.944905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:42.944867    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4" event={"ID":"c9c59d29-6b9a-4370-8208-33974f3a1628","Type":"ContainerStarted","Data":"bd680c6624a98ce83f2a28eff8cb50ec2855376b9e9898d6a52468223f05362a"}
Jul 24 16:12:42.945401 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:42.944977    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:42.973673 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:42.973596    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4" podStartSLOduration=2.442826436 podStartE2EDuration="6.97357925s" totalImagesPullingTime="3.47571554s" totalInitContainerRuntime="1.055037274s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:12:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:12:42.971887916 +0000 UTC m=+396.956578697" watchObservedRunningTime="2026-07-24 16:12:42.97357925 +0000 UTC m=+396.958270032"
Jul 24 16:12:53.952796 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:53.952751    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-ln7c4"
Jul 24 16:12:54.895834 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:54.895802    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"]
Jul 24 16:12:54.903479 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:54.903457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:54.908920 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:54.908898    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 16:12:54.909023 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:54.908899    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 16:12:54.909875 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:54.909858    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 16:12:54.909955 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:54.909929    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cxf24\""
Jul 24 16:12:54.910010 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:54.910000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 16:12:54.910087 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:54.910070    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:12:54.912158 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:54.912140    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"]
Jul 24 16:12:55.075420 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.075381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-cert\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.075806 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.075442    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-manager-config\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.075806 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.075498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-metrics-cert\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.075806 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.075517    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrnbb\" (UniqueName: \"kubernetes.io/projected/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-kube-api-access-wrnbb\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.176255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.176183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-manager-config\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.176255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.176221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-metrics-cert\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.176255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.176249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrnbb\" (UniqueName: \"kubernetes.io/projected/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-kube-api-access-wrnbb\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.176461 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.176281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-cert\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.176918 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.176895    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-manager-config\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.178767 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.178747    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-cert\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.178891 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.178872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-metrics-cert\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.192330 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.192307    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrnbb\" (UniqueName: \"kubernetes.io/projected/c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d-kube-api-access-wrnbb\") pod \"lws-controller-manager-9cffb5c7d-m6rs4\" (UID: \"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d\") " pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.212276 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.212256    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:55.345220 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.345190    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"]
Jul 24 16:12:55.348119 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:12:55.348097    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62e91a7_9b4d_4cc5_b2b0_d1ea17a93d0d.slice/crio-06124d1be2fd94ecc6eaf847dc6e306bc717b5860c606fa911c3d82fff53a307 WatchSource:0}: Error finding container 06124d1be2fd94ecc6eaf847dc6e306bc717b5860c606fa911c3d82fff53a307: Status 404 returned error can't find the container with id 06124d1be2fd94ecc6eaf847dc6e306bc717b5860c606fa911c3d82fff53a307
Jul 24 16:12:55.997140 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:55.997106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4" event={"ID":"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d","Type":"ContainerStarted","Data":"06124d1be2fd94ecc6eaf847dc6e306bc717b5860c606fa911c3d82fff53a307"}
Jul 24 16:12:58.007773 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:58.007692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4" event={"ID":"c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d","Type":"ContainerStarted","Data":"e8c4a5842e7d9ed7913f9615e58205a08af41015e9a0c09810cf322a97c6f9b4"}
Jul 24 16:12:58.008111 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:58.007842    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:12:58.032978 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:12:58.032931    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4" podStartSLOduration=1.735651077 podStartE2EDuration="4.032916945s" totalImagesPullingTime="2.297265868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:12:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:12:58.031404893 +0000 UTC m=+412.016095699" watchObservedRunningTime="2026-07-24 16:12:58.032916945 +0000 UTC m=+412.017607726"
Jul 24 16:13:05.699378 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.699342    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"]
Jul 24 16:13:05.703552 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.703537    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.712423 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.712398    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n4tl4\""
Jul 24 16:13:05.712533 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.712515    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 16:13:05.712603 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.712590    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 16:13:05.712694 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.712612    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 16:13:05.712810 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.712796    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 16:13:05.712905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.712890    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 16:13:05.712972 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.712943    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 16:13:05.749633 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.749607    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"]
Jul 24 16:13:05.759788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.759769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.759893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.759795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.759893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.759824    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d6f1a5d-1319-4b9f-9397-69be4432b457-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.759893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.759845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d6f1a5d-1319-4b9f-9397-69be4432b457-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.760001 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.759924    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.760035 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.759987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.760068 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.760037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8wqv\" (UniqueName: \"kubernetes.io/projected/9d6f1a5d-1319-4b9f-9397-69be4432b457-kube-api-access-x8wqv\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.861208 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.861176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8wqv\" (UniqueName: \"kubernetes.io/projected/9d6f1a5d-1319-4b9f-9397-69be4432b457-kube-api-access-x8wqv\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.861401 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.861232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.861401 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.861259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.861401 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.861298    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d6f1a5d-1319-4b9f-9397-69be4432b457-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.861401 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.861329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d6f1a5d-1319-4b9f-9397-69be4432b457-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.861401 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.861369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.861401 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.861396    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.862382 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.862358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.864447 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.864423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d6f1a5d-1319-4b9f-9397-69be4432b457-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.864588 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.864486    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.864844 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.864822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.866228 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.866206    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d6f1a5d-1319-4b9f-9397-69be4432b457-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.883617 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.883580    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d6f1a5d-1319-4b9f-9397-69be4432b457-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:05.883833 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:05.883816    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8wqv\" (UniqueName: \"kubernetes.io/projected/9d6f1a5d-1319-4b9f-9397-69be4432b457-kube-api-access-x8wqv\") pod \"istiod-openshift-gateway-5677ccb49b-9rk5t\" (UID: \"9d6f1a5d-1319-4b9f-9397-69be4432b457\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:06.012674 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:06.012558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:06.206519 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:06.206498    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"]
Jul 24 16:13:06.208765 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:13:06.208731    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6f1a5d_1319_4b9f_9397_69be4432b457.slice/crio-a6286aa8172cbc8f89d1176c8b4e5508249a2fe7f8b7088a15dcf7f6c0474151 WatchSource:0}: Error finding container a6286aa8172cbc8f89d1176c8b4e5508249a2fe7f8b7088a15dcf7f6c0474151: Status 404 returned error can't find the container with id a6286aa8172cbc8f89d1176c8b4e5508249a2fe7f8b7088a15dcf7f6c0474151
Jul 24 16:13:07.047973 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:07.047936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t" event={"ID":"9d6f1a5d-1319-4b9f-9397-69be4432b457","Type":"ContainerStarted","Data":"a6286aa8172cbc8f89d1176c8b4e5508249a2fe7f8b7088a15dcf7f6c0474151"}
Jul 24 16:13:09.012014 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:09.011976    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 16:13:09.012306 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:09.012043    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 16:13:09.015319 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:09.015296    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9cffb5c7d-m6rs4"
Jul 24 16:13:10.062211 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:10.062177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t" event={"ID":"9d6f1a5d-1319-4b9f-9397-69be4432b457","Type":"ContainerStarted","Data":"f4192259675c18d9504589fc3a00382ab56ce34386e94232aad2260a324da127"}
Jul 24 16:13:10.062666 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:10.062363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:13:10.064112 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:10.064090    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-9rk5t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:13:10.064243 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:10.064138    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t" podUID="9d6f1a5d-1319-4b9f-9397-69be4432b457" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:13:10.146911 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:10.146852    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t" podStartSLOduration=2.345623711 podStartE2EDuration="5.146835827s" totalImagesPullingTime="2.801212116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:10.136877547 +0000 UTC m=+424.121568327" watchObservedRunningTime="2026-07-24 16:13:10.146835827 +0000 UTC m=+424.131526607"
Jul 24 16:13:11.067169 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:13:11.067142    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9rk5t"
Jul 24 16:14:14.479704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.479666    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"]
Jul 24 16:14:14.483179 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.483157    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.485656 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.485623    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 16:14:14.485772 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.485733    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 16:14:14.486610 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.486592    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w6clx\""
Jul 24 16:14:14.492743 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.492723    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"]
Jul 24 16:14:14.585506 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.585464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxvp\" (UniqueName: \"kubernetes.io/projected/2f086180-ee5b-4467-914e-61ef3499c53b-kube-api-access-dnxvp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.585506 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.585513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.585739 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.585575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.685919 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.685893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.686077 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.685969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxvp\" (UniqueName: \"kubernetes.io/projected/2f086180-ee5b-4467-914e-61ef3499c53b-kube-api-access-dnxvp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.686077 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.686008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.686343 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.686320    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.686431 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.686413    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.694854 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.694835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxvp\" (UniqueName: \"kubernetes.io/projected/2f086180-ee5b-4467-914e-61ef3499c53b-kube-api-access-dnxvp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.792779 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.792707    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:14.870828 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.870801    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"]
Jul 24 16:14:14.874490 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.874467    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:14.884039 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.883617    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"]
Jul 24 16:14:14.921776 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.921679    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"]
Jul 24 16:14:14.924321 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:14:14.924295    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f086180_ee5b_4467_914e_61ef3499c53b.slice/crio-fed7593329a393a99f727ea13284e9096dc281ced072ef3c7b7b8343a9996382 WatchSource:0}: Error finding container fed7593329a393a99f727ea13284e9096dc281ced072ef3c7b7b8343a9996382: Status 404 returned error can't find the container with id fed7593329a393a99f727ea13284e9096dc281ced072ef3c7b7b8343a9996382
Jul 24 16:14:14.987942 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.987919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:14.988044 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.987962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:14.988044 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:14.987982    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdlt\" (UniqueName: \"kubernetes.io/projected/ff02b33a-c681-4f2d-8a58-5a36a28c9355-kube-api-access-fhdlt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:15.088799 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.088726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:15.088799 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.088766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:15.088799 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.088793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdlt\" (UniqueName: \"kubernetes.io/projected/ff02b33a-c681-4f2d-8a58-5a36a28c9355-kube-api-access-fhdlt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:15.089079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.089060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:15.089155 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.089139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:15.097532 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.097508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdlt\" (UniqueName: \"kubernetes.io/projected/ff02b33a-c681-4f2d-8a58-5a36a28c9355-kube-api-access-fhdlt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:15.187537 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.187492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:15.323236 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.323202    2561 generic.go:356] "Generic (PLEG): container finished" podID="2f086180-ee5b-4467-914e-61ef3499c53b" containerID="85ac871efea7ace08060d71179dbdb527a5a46c6d6ef500f9368e715f76f4504" exitCode=0
Jul 24 16:14:15.323412 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.323242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh" event={"ID":"2f086180-ee5b-4467-914e-61ef3499c53b","Type":"ContainerDied","Data":"85ac871efea7ace08060d71179dbdb527a5a46c6d6ef500f9368e715f76f4504"}
Jul 24 16:14:15.323412 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.323294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh" event={"ID":"2f086180-ee5b-4467-914e-61ef3499c53b","Type":"ContainerStarted","Data":"fed7593329a393a99f727ea13284e9096dc281ced072ef3c7b7b8343a9996382"}
Jul 24 16:14:15.328452 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.328433    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"]
Jul 24 16:14:15.329025 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:14:15.329004    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff02b33a_c681_4f2d_8a58_5a36a28c9355.slice/crio-22df17d680ca68767058a7b5bb5a13352b0e1c44c7315c46de7268946a2efbc6 WatchSource:0}: Error finding container 22df17d680ca68767058a7b5bb5a13352b0e1c44c7315c46de7268946a2efbc6: Status 404 returned error can't find the container with id 22df17d680ca68767058a7b5bb5a13352b0e1c44c7315c46de7268946a2efbc6
Jul 24 16:14:15.337804 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.337780    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"]
Jul 24 16:14:15.341795 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.341747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.365386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.365361    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"]
Jul 24 16:14:15.492525 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.492494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.492967 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.492546    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.492967 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.492578    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4h45\" (UniqueName: \"kubernetes.io/projected/347ace90-6984-4515-8f91-7851f7b23e3e-kube-api-access-s4h45\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.593235 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.593170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.593235 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.593207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4h45\" (UniqueName: \"kubernetes.io/projected/347ace90-6984-4515-8f91-7851f7b23e3e-kube-api-access-s4h45\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.593387 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.593254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.593518 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.593500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.593580 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.593525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.602490 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.602465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4h45\" (UniqueName: \"kubernetes.io/projected/347ace90-6984-4515-8f91-7851f7b23e3e-kube-api-access-s4h45\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.662045 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.662022    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:15.670285 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.670265    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"]
Jul 24 16:14:15.673627 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.673610    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.684448 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.684429    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"]
Jul 24 16:14:15.792949 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.792922    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"]
Jul 24 16:14:15.795007 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.794984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxct2\" (UniqueName: \"kubernetes.io/projected/95e1140c-8da7-488d-a58d-f4d40407d934-kube-api-access-kxct2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.795120 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.795026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.795120 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.795058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.795326 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:14:15.795305    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347ace90_6984_4515_8f91_7851f7b23e3e.slice/crio-84e68a40512a76c9f38316843f280b789b1390c2b8a34f7e057c42a74ed45e0f WatchSource:0}: Error finding container 84e68a40512a76c9f38316843f280b789b1390c2b8a34f7e057c42a74ed45e0f: Status 404 returned error can't find the container with id 84e68a40512a76c9f38316843f280b789b1390c2b8a34f7e057c42a74ed45e0f
Jul 24 16:14:15.895538 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.895516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.895677 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.895580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxct2\" (UniqueName: \"kubernetes.io/projected/95e1140c-8da7-488d-a58d-f4d40407d934-kube-api-access-kxct2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.895677 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.895611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.895934 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.895911    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.895999 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.895923    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.904831 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.904813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxct2\" (UniqueName: \"kubernetes.io/projected/95e1140c-8da7-488d-a58d-f4d40407d934-kube-api-access-kxct2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:15.982600 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:15.982564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:16.152804 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.152695    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"]
Jul 24 16:14:16.156445 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:14:16.156421    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e1140c_8da7_488d_a58d_f4d40407d934.slice/crio-8c1df70affc23a4845fd9ae743596cfa1ac35bf73d33157db1c9a981e9239014 WatchSource:0}: Error finding container 8c1df70affc23a4845fd9ae743596cfa1ac35bf73d33157db1c9a981e9239014: Status 404 returned error can't find the container with id 8c1df70affc23a4845fd9ae743596cfa1ac35bf73d33157db1c9a981e9239014
Jul 24 16:14:16.328369 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.328341    2561 generic.go:356] "Generic (PLEG): container finished" podID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerID="84055ac6aa491ff779eef7f6303e32cde6bb825068fa939de9a375ef2150facb" exitCode=0
Jul 24 16:14:16.328473 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.328432    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb" event={"ID":"ff02b33a-c681-4f2d-8a58-5a36a28c9355","Type":"ContainerDied","Data":"84055ac6aa491ff779eef7f6303e32cde6bb825068fa939de9a375ef2150facb"}
Jul 24 16:14:16.328536 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.328488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb" event={"ID":"ff02b33a-c681-4f2d-8a58-5a36a28c9355","Type":"ContainerStarted","Data":"22df17d680ca68767058a7b5bb5a13352b0e1c44c7315c46de7268946a2efbc6"}
Jul 24 16:14:16.330039 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.330012    2561 generic.go:356] "Generic (PLEG): container finished" podID="347ace90-6984-4515-8f91-7851f7b23e3e" containerID="3ce71f8feedc5d7c19bcf9f85c6594e894c00405f2da9b4f730b6e77abf0a873" exitCode=0
Jul 24 16:14:16.330152 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.330106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms" event={"ID":"347ace90-6984-4515-8f91-7851f7b23e3e","Type":"ContainerDied","Data":"3ce71f8feedc5d7c19bcf9f85c6594e894c00405f2da9b4f730b6e77abf0a873"}
Jul 24 16:14:16.330216 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.330151    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms" event={"ID":"347ace90-6984-4515-8f91-7851f7b23e3e","Type":"ContainerStarted","Data":"84e68a40512a76c9f38316843f280b789b1390c2b8a34f7e057c42a74ed45e0f"}
Jul 24 16:14:16.332207 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.332185    2561 generic.go:356] "Generic (PLEG): container finished" podID="2f086180-ee5b-4467-914e-61ef3499c53b" containerID="6127c89f50b04edbe5a12b5b542d6baf796b3010a7efdee6a14c3f8161b63362" exitCode=0
Jul 24 16:14:16.332303 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.332270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh" event={"ID":"2f086180-ee5b-4467-914e-61ef3499c53b","Type":"ContainerDied","Data":"6127c89f50b04edbe5a12b5b542d6baf796b3010a7efdee6a14c3f8161b63362"}
Jul 24 16:14:16.333837 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.333815    2561 generic.go:356] "Generic (PLEG): container finished" podID="95e1140c-8da7-488d-a58d-f4d40407d934" containerID="f099838ec92314bd4cc5a1ceacd8f9fe7a12319f9c9267236efefeb2946e1846" exitCode=0
Jul 24 16:14:16.333911 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.333843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb" event={"ID":"95e1140c-8da7-488d-a58d-f4d40407d934","Type":"ContainerDied","Data":"f099838ec92314bd4cc5a1ceacd8f9fe7a12319f9c9267236efefeb2946e1846"}
Jul 24 16:14:16.333911 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:16.333883    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb" event={"ID":"95e1140c-8da7-488d-a58d-f4d40407d934","Type":"ContainerStarted","Data":"8c1df70affc23a4845fd9ae743596cfa1ac35bf73d33157db1c9a981e9239014"}
Jul 24 16:14:17.340931 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:17.340906    2561 generic.go:356] "Generic (PLEG): container finished" podID="2f086180-ee5b-4467-914e-61ef3499c53b" containerID="073e00851520670db3ae184d84dbe7751730bc49dc41f26604f3076974d4c7c6" exitCode=0
Jul 24 16:14:17.341278 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:17.340984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh" event={"ID":"2f086180-ee5b-4467-914e-61ef3499c53b","Type":"ContainerDied","Data":"073e00851520670db3ae184d84dbe7751730bc49dc41f26604f3076974d4c7c6"}
Jul 24 16:14:18.347209 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.347178    2561 generic.go:356] "Generic (PLEG): container finished" podID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerID="4dd63df26c6066a7aa40d6edbbae3c2b0f7962ba5aeeb252fef6d6d289586fe0" exitCode=0
Jul 24 16:14:18.347669 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.347267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb" event={"ID":"ff02b33a-c681-4f2d-8a58-5a36a28c9355","Type":"ContainerDied","Data":"4dd63df26c6066a7aa40d6edbbae3c2b0f7962ba5aeeb252fef6d6d289586fe0"}
Jul 24 16:14:18.349128 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.349110    2561 generic.go:356] "Generic (PLEG): container finished" podID="347ace90-6984-4515-8f91-7851f7b23e3e" containerID="4723c77662c554ddceb429bc3c541b010f23a6f248b581095f23cb923e0714b5" exitCode=0
Jul 24 16:14:18.349209 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.349191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms" event={"ID":"347ace90-6984-4515-8f91-7851f7b23e3e","Type":"ContainerDied","Data":"4723c77662c554ddceb429bc3c541b010f23a6f248b581095f23cb923e0714b5"}
Jul 24 16:14:18.350921 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.350900    2561 generic.go:356] "Generic (PLEG): container finished" podID="95e1140c-8da7-488d-a58d-f4d40407d934" containerID="d7439d50ec5cc1e8c92b1767aa6b89557c74738f7eee4b2884464998b01a2a00" exitCode=0
Jul 24 16:14:18.351015 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.350948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb" event={"ID":"95e1140c-8da7-488d-a58d-f4d40407d934","Type":"ContainerDied","Data":"d7439d50ec5cc1e8c92b1767aa6b89557c74738f7eee4b2884464998b01a2a00"}
Jul 24 16:14:18.506873 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.506850    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:18.618127 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.618067    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnxvp\" (UniqueName: \"kubernetes.io/projected/2f086180-ee5b-4467-914e-61ef3499c53b-kube-api-access-dnxvp\") pod \"2f086180-ee5b-4467-914e-61ef3499c53b\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") "
Jul 24 16:14:18.618127 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.618108    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-bundle\") pod \"2f086180-ee5b-4467-914e-61ef3499c53b\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") "
Jul 24 16:14:18.618272 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.618163    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-util\") pod \"2f086180-ee5b-4467-914e-61ef3499c53b\" (UID: \"2f086180-ee5b-4467-914e-61ef3499c53b\") "
Jul 24 16:14:18.621793 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.619071    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-bundle" (OuterVolumeSpecName: "bundle") pod "2f086180-ee5b-4467-914e-61ef3499c53b" (UID: "2f086180-ee5b-4467-914e-61ef3499c53b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:14:18.621793 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.621743    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f086180-ee5b-4467-914e-61ef3499c53b-kube-api-access-dnxvp" (OuterVolumeSpecName: "kube-api-access-dnxvp") pod "2f086180-ee5b-4467-914e-61ef3499c53b" (UID: "2f086180-ee5b-4467-914e-61ef3499c53b"). InnerVolumeSpecName "kube-api-access-dnxvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:18.625924 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.625879    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-util" (OuterVolumeSpecName: "util") pod "2f086180-ee5b-4467-914e-61ef3499c53b" (UID: "2f086180-ee5b-4467-914e-61ef3499c53b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:14:18.719966 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.719927    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnxvp\" (UniqueName: \"kubernetes.io/projected/2f086180-ee5b-4467-914e-61ef3499c53b-kube-api-access-dnxvp\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:18.719966 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.719967    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-bundle\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:18.720115 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:18.719982    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f086180-ee5b-4467-914e-61ef3499c53b-util\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:19.357852 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:19.357815    2561 generic.go:356] "Generic (PLEG): container finished" podID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerID="9ec3bb35d98b2e770a52c333d053ddb0b6d623728b27d9fbcd01da0b81a16ee4" exitCode=0
Jul 24 16:14:19.358295 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:19.357913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb" event={"ID":"ff02b33a-c681-4f2d-8a58-5a36a28c9355","Type":"ContainerDied","Data":"9ec3bb35d98b2e770a52c333d053ddb0b6d623728b27d9fbcd01da0b81a16ee4"}
Jul 24 16:14:19.359803 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:19.359782    2561 generic.go:356] "Generic (PLEG): container finished" podID="347ace90-6984-4515-8f91-7851f7b23e3e" containerID="dc1dac241821952c04c19c3029ba586dbc37e12f971a8a2be7337209039f2ba0" exitCode=0
Jul 24 16:14:19.359933 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:19.359866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms" event={"ID":"347ace90-6984-4515-8f91-7851f7b23e3e","Type":"ContainerDied","Data":"dc1dac241821952c04c19c3029ba586dbc37e12f971a8a2be7337209039f2ba0"}
Jul 24 16:14:19.361692 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:19.361667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh" event={"ID":"2f086180-ee5b-4467-914e-61ef3499c53b","Type":"ContainerDied","Data":"fed7593329a393a99f727ea13284e9096dc281ced072ef3c7b7b8343a9996382"}
Jul 24 16:14:19.361795 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:19.361711    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fed7593329a393a99f727ea13284e9096dc281ced072ef3c7b7b8343a9996382"
Jul 24 16:14:19.361795 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:19.361676    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh"
Jul 24 16:14:19.363634 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:19.363614    2561 generic.go:356] "Generic (PLEG): container finished" podID="95e1140c-8da7-488d-a58d-f4d40407d934" containerID="ca1be3dd3e2e9144d1afe1210eda96a6a477f7583ff742a050cacb044e1f1398" exitCode=0
Jul 24 16:14:19.363743 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:19.363673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb" event={"ID":"95e1140c-8da7-488d-a58d-f4d40407d934","Type":"ContainerDied","Data":"ca1be3dd3e2e9144d1afe1210eda96a6a477f7583ff742a050cacb044e1f1398"}
Jul 24 16:14:20.515549 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.515527    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:20.550920 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.550898    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:14:20.553490 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.553470    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:20.634115 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.634050    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4h45\" (UniqueName: \"kubernetes.io/projected/347ace90-6984-4515-8f91-7851f7b23e3e-kube-api-access-s4h45\") pod \"347ace90-6984-4515-8f91-7851f7b23e3e\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") "
Jul 24 16:14:20.634115 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.634085    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-util\") pod \"347ace90-6984-4515-8f91-7851f7b23e3e\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") "
Jul 24 16:14:20.634115 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.634109    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-bundle\") pod \"347ace90-6984-4515-8f91-7851f7b23e3e\" (UID: \"347ace90-6984-4515-8f91-7851f7b23e3e\") "
Jul 24 16:14:20.634621 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.634595    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-bundle" (OuterVolumeSpecName: "bundle") pod "347ace90-6984-4515-8f91-7851f7b23e3e" (UID: "347ace90-6984-4515-8f91-7851f7b23e3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:14:20.636255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.636229    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/347ace90-6984-4515-8f91-7851f7b23e3e-kube-api-access-s4h45" (OuterVolumeSpecName: "kube-api-access-s4h45") pod "347ace90-6984-4515-8f91-7851f7b23e3e" (UID: "347ace90-6984-4515-8f91-7851f7b23e3e"). InnerVolumeSpecName "kube-api-access-s4h45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:20.639580 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.639560    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-util" (OuterVolumeSpecName: "util") pod "347ace90-6984-4515-8f91-7851f7b23e3e" (UID: "347ace90-6984-4515-8f91-7851f7b23e3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:14:20.734910 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.734882    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxct2\" (UniqueName: \"kubernetes.io/projected/95e1140c-8da7-488d-a58d-f4d40407d934-kube-api-access-kxct2\") pod \"95e1140c-8da7-488d-a58d-f4d40407d934\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") "
Jul 24 16:14:20.735016 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.734920    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-bundle\") pod \"95e1140c-8da7-488d-a58d-f4d40407d934\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") "
Jul 24 16:14:20.735059 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.735042    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhdlt\" (UniqueName: \"kubernetes.io/projected/ff02b33a-c681-4f2d-8a58-5a36a28c9355-kube-api-access-fhdlt\") pod \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") "
Jul 24 16:14:20.735097 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.735081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-util\") pod \"95e1140c-8da7-488d-a58d-f4d40407d934\" (UID: \"95e1140c-8da7-488d-a58d-f4d40407d934\") "
Jul 24 16:14:20.735141 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.735113    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-util\") pod \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") "
Jul 24 16:14:20.735175 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.735144    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-bundle\") pod \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\" (UID: \"ff02b33a-c681-4f2d-8a58-5a36a28c9355\") "
Jul 24 16:14:20.735379 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.735362    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4h45\" (UniqueName: \"kubernetes.io/projected/347ace90-6984-4515-8f91-7851f7b23e3e-kube-api-access-s4h45\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:20.735449 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.735386    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-util\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:20.735449 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.735400    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/347ace90-6984-4515-8f91-7851f7b23e3e-bundle\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:20.735748 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.735578    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-bundle" (OuterVolumeSpecName: "bundle") pod "95e1140c-8da7-488d-a58d-f4d40407d934" (UID: "95e1140c-8da7-488d-a58d-f4d40407d934"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:14:20.735898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.735873    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-bundle" (OuterVolumeSpecName: "bundle") pod "ff02b33a-c681-4f2d-8a58-5a36a28c9355" (UID: "ff02b33a-c681-4f2d-8a58-5a36a28c9355"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:14:20.737104 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.737075    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e1140c-8da7-488d-a58d-f4d40407d934-kube-api-access-kxct2" (OuterVolumeSpecName: "kube-api-access-kxct2") pod "95e1140c-8da7-488d-a58d-f4d40407d934" (UID: "95e1140c-8da7-488d-a58d-f4d40407d934"). InnerVolumeSpecName "kube-api-access-kxct2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:20.737475 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.737456    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff02b33a-c681-4f2d-8a58-5a36a28c9355-kube-api-access-fhdlt" (OuterVolumeSpecName: "kube-api-access-fhdlt") pod "ff02b33a-c681-4f2d-8a58-5a36a28c9355" (UID: "ff02b33a-c681-4f2d-8a58-5a36a28c9355"). InnerVolumeSpecName "kube-api-access-fhdlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:20.740186 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.740144    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-util" (OuterVolumeSpecName: "util") pod "ff02b33a-c681-4f2d-8a58-5a36a28c9355" (UID: "ff02b33a-c681-4f2d-8a58-5a36a28c9355"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:14:20.742026 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.742008    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-util" (OuterVolumeSpecName: "util") pod "95e1140c-8da7-488d-a58d-f4d40407d934" (UID: "95e1140c-8da7-488d-a58d-f4d40407d934"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:14:20.836272 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.836228    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhdlt\" (UniqueName: \"kubernetes.io/projected/ff02b33a-c681-4f2d-8a58-5a36a28c9355-kube-api-access-fhdlt\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:20.836272 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.836267    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-util\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:20.836272 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.836279    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-util\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:20.836453 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.836290    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff02b33a-c681-4f2d-8a58-5a36a28c9355-bundle\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:20.836453 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.836313    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxct2\" (UniqueName: \"kubernetes.io/projected/95e1140c-8da7-488d-a58d-f4d40407d934-kube-api-access-kxct2\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:20.836453 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:20.836324    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e1140c-8da7-488d-a58d-f4d40407d934-bundle\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:14:21.374567 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:21.374543    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms"
Jul 24 16:14:21.374567 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:21.374560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms" event={"ID":"347ace90-6984-4515-8f91-7851f7b23e3e","Type":"ContainerDied","Data":"84e68a40512a76c9f38316843f280b789b1390c2b8a34f7e057c42a74ed45e0f"}
Jul 24 16:14:21.374812 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:21.374603    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84e68a40512a76c9f38316843f280b789b1390c2b8a34f7e057c42a74ed45e0f"
Jul 24 16:14:21.376250 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:21.376232    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb"
Jul 24 16:14:21.376344 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:21.376261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb" event={"ID":"95e1140c-8da7-488d-a58d-f4d40407d934","Type":"ContainerDied","Data":"8c1df70affc23a4845fd9ae743596cfa1ac35bf73d33157db1c9a981e9239014"}
Jul 24 16:14:21.376344 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:21.376302    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c1df70affc23a4845fd9ae743596cfa1ac35bf73d33157db1c9a981e9239014"
Jul 24 16:14:21.378078 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:21.378061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb" event={"ID":"ff02b33a-c681-4f2d-8a58-5a36a28c9355","Type":"ContainerDied","Data":"22df17d680ca68767058a7b5bb5a13352b0e1c44c7315c46de7268946a2efbc6"}
Jul 24 16:14:21.378133 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:21.378091    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22df17d680ca68767058a7b5bb5a13352b0e1c44c7315c46de7268946a2efbc6"
Jul 24 16:14:21.378133 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:14:21.378114    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb"
Jul 24 16:15:28.564439 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564401    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564763    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f086180-ee5b-4467-914e-61ef3499c53b" containerName="util"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564781    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f086180-ee5b-4467-914e-61ef3499c53b" containerName="util"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564794    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="347ace90-6984-4515-8f91-7851f7b23e3e" containerName="util"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564802    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="347ace90-6984-4515-8f91-7851f7b23e3e" containerName="util"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564816    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e1140c-8da7-488d-a58d-f4d40407d934" containerName="pull"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564825    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e1140c-8da7-488d-a58d-f4d40407d934" containerName="pull"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564835    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f086180-ee5b-4467-914e-61ef3499c53b" containerName="pull"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564842    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f086180-ee5b-4467-914e-61ef3499c53b" containerName="pull"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564852    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e1140c-8da7-488d-a58d-f4d40407d934" containerName="extract"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564859    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e1140c-8da7-488d-a58d-f4d40407d934" containerName="extract"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564893    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerName="pull"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564902    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerName="pull"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564914    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f086180-ee5b-4467-914e-61ef3499c53b" containerName="extract"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564921    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f086180-ee5b-4467-914e-61ef3499c53b" containerName="extract"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564930    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="347ace90-6984-4515-8f91-7851f7b23e3e" containerName="pull"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564938    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="347ace90-6984-4515-8f91-7851f7b23e3e" containerName="pull"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564949    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="347ace90-6984-4515-8f91-7851f7b23e3e" containerName="extract"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564957    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="347ace90-6984-4515-8f91-7851f7b23e3e" containerName="extract"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564968    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerName="extract"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564976    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerName="extract"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564987    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e1140c-8da7-488d-a58d-f4d40407d934" containerName="util"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.564996    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e1140c-8da7-488d-a58d-f4d40407d934" containerName="util"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.565011    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerName="util"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.565018    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerName="util"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.565083    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f086180-ee5b-4467-914e-61ef3499c53b" containerName="extract"
Jul 24 16:15:28.565079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.565093    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff02b33a-c681-4f2d-8a58-5a36a28c9355" containerName="extract"
Jul 24 16:15:28.566164 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.565103    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="347ace90-6984-4515-8f91-7851f7b23e3e" containerName="extract"
Jul 24 16:15:28.566164 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.565112    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e1140c-8da7-488d-a58d-f4d40407d934" containerName="extract"
Jul 24 16:15:28.568118 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.568084    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:15:28.572687 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.572669    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 16:15:28.572806 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.572727    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 16:15:28.573161 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.573145    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 16:15:28.573219 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.573148    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w6clx\""
Jul 24 16:15:28.584237 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.584221    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:15:28.631925 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.631893    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:15:28.653580 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.653559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlgtz\" (UniqueName: \"kubernetes.io/projected/842325ce-cfa1-4a9a-b5df-79201063e822-kube-api-access-vlgtz\") pod \"limitador-limitador-54d6d988d5-j7k46\" (UID: \"842325ce-cfa1-4a9a-b5df-79201063e822\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:15:28.653705 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.653608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/842325ce-cfa1-4a9a-b5df-79201063e822-config-file\") pod \"limitador-limitador-54d6d988d5-j7k46\" (UID: \"842325ce-cfa1-4a9a-b5df-79201063e822\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:15:28.754957 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.754924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlgtz\" (UniqueName: \"kubernetes.io/projected/842325ce-cfa1-4a9a-b5df-79201063e822-kube-api-access-vlgtz\") pod \"limitador-limitador-54d6d988d5-j7k46\" (UID: \"842325ce-cfa1-4a9a-b5df-79201063e822\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:15:28.755101 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.754978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/842325ce-cfa1-4a9a-b5df-79201063e822-config-file\") pod \"limitador-limitador-54d6d988d5-j7k46\" (UID: \"842325ce-cfa1-4a9a-b5df-79201063e822\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:15:28.755525 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.755507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/842325ce-cfa1-4a9a-b5df-79201063e822-config-file\") pod \"limitador-limitador-54d6d988d5-j7k46\" (UID: \"842325ce-cfa1-4a9a-b5df-79201063e822\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:15:28.769320 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.769296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlgtz\" (UniqueName: \"kubernetes.io/projected/842325ce-cfa1-4a9a-b5df-79201063e822-kube-api-access-vlgtz\") pod \"limitador-limitador-54d6d988d5-j7k46\" (UID: \"842325ce-cfa1-4a9a-b5df-79201063e822\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:15:28.878399 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:28.878371    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:15:29.019284 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:29.015575    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:15:29.664912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:29.664882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46" event={"ID":"842325ce-cfa1-4a9a-b5df-79201063e822","Type":"ContainerStarted","Data":"557fc3e9bfa4430618d5b846b59293bd6f83a781a6a241826484ef7ea5f71ab3"}
Jul 24 16:15:32.679872 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:32.679839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46" event={"ID":"842325ce-cfa1-4a9a-b5df-79201063e822","Type":"ContainerStarted","Data":"3fb51a3552da66719d976e2d8898a5df78a48c0ff7ba0b417c8615b0161bdc1b"}
Jul 24 16:15:32.680287 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:32.680068    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:15:32.700434 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:32.700390    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46" podStartSLOduration=1.845367461 podStartE2EDuration="4.70037549s" totalImagesPullingTime="2.855008029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:32.698756357 +0000 UTC m=+566.683447139" watchObservedRunningTime="2026-07-24 16:15:32.70037549 +0000 UTC m=+566.685066290"
Jul 24 16:15:43.686219 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:15:43.686187    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7k46"
Jul 24 16:16:45.308043 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:16:45.308009    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:17:00.545467 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:00.545423    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:17:12.151965 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:12.151930    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:17:24.057027 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:24.056988    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:17:34.855768 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:34.855732    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:17:48.249441 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.249403    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"]
Jul 24 16:17:48.252612 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.252593    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.254893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.254870    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 16:17:48.255011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.254929    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 16:17:48.255011 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.254967    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7bv6s\""
Jul 24 16:17:48.255608 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.255594    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 16:17:48.262554 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.262530    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"]
Jul 24 16:17:48.323235 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.323197    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.323381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.323253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.323381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.323320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spg5f\" (UniqueName: \"kubernetes.io/projected/2acd6484-5c3c-4381-a077-95aa184f9e2a-kube-api-access-spg5f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.323381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.323369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.323581 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.323440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.323581 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.323487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2acd6484-5c3c-4381-a077-95aa184f9e2a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.424339 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.424303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.424514 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.424352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2acd6484-5c3c-4381-a077-95aa184f9e2a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.424514 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.424374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.424514 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.424395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.424514 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.424414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spg5f\" (UniqueName: \"kubernetes.io/projected/2acd6484-5c3c-4381-a077-95aa184f9e2a-kube-api-access-spg5f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.424514 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.424440    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.424800 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.424744    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.424874 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.424857    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.424915 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.424885    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.426804 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.426780    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2acd6484-5c3c-4381-a077-95aa184f9e2a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.426983 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.426963    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2acd6484-5c3c-4381-a077-95aa184f9e2a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.432319 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.432297    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spg5f\" (UniqueName: \"kubernetes.io/projected/2acd6484-5c3c-4381-a077-95aa184f9e2a-kube-api-access-spg5f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klfp9\" (UID: \"2acd6484-5c3c-4381-a077-95aa184f9e2a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.563811 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.563733    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:48.687736 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.687569    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"]
Jul 24 16:17:48.689788 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:17:48.689763    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2acd6484_5c3c_4381_a077_95aa184f9e2a.slice/crio-7ff8c3b1cb2cc2705b1c8f861ae12b4ec6754724e1ee2cfe489cf9c9dc0e88d5 WatchSource:0}: Error finding container 7ff8c3b1cb2cc2705b1c8f861ae12b4ec6754724e1ee2cfe489cf9c9dc0e88d5: Status 404 returned error can't find the container with id 7ff8c3b1cb2cc2705b1c8f861ae12b4ec6754724e1ee2cfe489cf9c9dc0e88d5
Jul 24 16:17:48.691195 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:48.691178    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:17:49.274338 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:49.274264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9" event={"ID":"2acd6484-5c3c-4381-a077-95aa184f9e2a","Type":"ContainerStarted","Data":"7ff8c3b1cb2cc2705b1c8f861ae12b4ec6754724e1ee2cfe489cf9c9dc0e88d5"}
Jul 24 16:17:50.150802 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:50.150769    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:17:50.280193 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:50.280161    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9" event={"ID":"2acd6484-5c3c-4381-a077-95aa184f9e2a","Type":"ContainerStarted","Data":"3e85b40c73c462b59645a6da7ebaa6e571ac8c6c8c7667a051af6c8606af9b0c"}
Jul 24 16:17:50.298179 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:50.298127    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9" podStartSLOduration=1.220601901 podStartE2EDuration="2.298112643s" totalImagesPullingTime="1.077510742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:17:50.296419823 +0000 UTC m=+704.281110604" watchObservedRunningTime="2026-07-24 16:17:50.298112643 +0000 UTC m=+704.282803425"
Jul 24 16:17:58.564357 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:58.564274    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:58.564357 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:58.564333    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:58.576346 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:58.576324    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:17:59.330299 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:17:59.330270    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klfp9"
Jul 24 16:18:02.750957 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:18:02.750925    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:19:24.957156 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:19:24.957123    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:19:36.452731 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:19:36.452629    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:19:46.646297 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:19:46.646264    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:21:28.047276 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:21:28.047240    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:21:41.847390 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:21:41.847355    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:22:15.344054 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:22:15.344018    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:22:25.048080 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:22:25.048040    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:22:33.954944 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:22:33.954862    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:22:42.951295 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:22:42.951260    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:22:53.748588 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:22:53.748551    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:23:03.252574 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:23:03.252538    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:23:14.446685 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:23:14.446631    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:23:24.349542 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:23:24.349505    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:23:46.552886 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:23:46.552846    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:23:56.844509 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:23:56.844472    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:24:18.149517 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:24:18.149481    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:24:30.843963 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:24:30.843929    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:24:46.443931 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:24:46.443898    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:24:54.643859 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:24:54.643820    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:25:05.350919 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:25:05.350881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:25:19.348185 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:25:19.348148    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:27:12.944775 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:27:12.944743    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:27:23.051174 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:27:23.051135    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:27:33.850449 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:27:33.850418    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:27:44.245144 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:27:44.245107    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:27:55.751660 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:27:55.751608    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:28:04.649324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:28:04.649286    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:28:15.152393 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:28:15.152354    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:28:25.450950 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:28:25.450916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:28:37.062398 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:28:37.061950    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:28:45.751685 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:28:45.751652    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:28:56.558936 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:28:56.558907    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:29:17.950688 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:29:17.950650    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:29:28.156955 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:29:28.156915    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:29:48.552176 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:29:48.552135    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:30:00.146128 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:00.146050    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95"]
Jul 24 16:30:00.149130 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:00.149110    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95"
Jul 24 16:30:00.151542 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:00.151518    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wtjsm\""
Jul 24 16:30:00.155487 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:00.155464    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95"]
Jul 24 16:30:00.160495 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:00.160473    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95"
Jul 24 16:30:00.286326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:00.286302    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95"]
Jul 24 16:30:00.288367 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:30:00.288342    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868e1076_b04c_4e59_88f4_d67389686529.slice/crio-cf9678d4601344359753f9ee745e877a1989f9510b50298340dd799458a7a722 WatchSource:0}: Error finding container cf9678d4601344359753f9ee745e877a1989f9510b50298340dd799458a7a722: Status 404 returned error can't find the container with id cf9678d4601344359753f9ee745e877a1989f9510b50298340dd799458a7a722
Jul 24 16:30:00.290287 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:00.290270    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:30:00.436590 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:00.436499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95" event={"ID":"868e1076-b04c-4e59-88f4-d67389686529","Type":"ContainerStarted","Data":"cf9678d4601344359753f9ee745e877a1989f9510b50298340dd799458a7a722"}
Jul 24 16:30:03.453020 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:03.452981    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95" event={"ID":"868e1076-b04c-4e59-88f4-d67389686529","Type":"ContainerStarted","Data":"b396d2d61d142a1606c940fe371b90b09831eff7c1b04d5d8e230bf4d7a84e13"}
Jul 24 16:30:03.473877 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:03.473830    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95" podStartSLOduration=1.035000213 podStartE2EDuration="3.473811566s" totalImagesPullingTime="2.438811353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:30:03.472685384 +0000 UTC m=+1437.457376174" watchObservedRunningTime="2026-07-24 16:30:03.473811566 +0000 UTC m=+1437.458502347"
Jul 24 16:30:04.458568 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:04.458533    2561 generic.go:356] "Generic (PLEG): container finished" podID="868e1076-b04c-4e59-88f4-d67389686529" containerID="b396d2d61d142a1606c940fe371b90b09831eff7c1b04d5d8e230bf4d7a84e13" exitCode=0
Jul 24 16:30:04.459019 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:04.458624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95" event={"ID":"868e1076-b04c-4e59-88f4-d67389686529","Type":"ContainerDied","Data":"b396d2d61d142a1606c940fe371b90b09831eff7c1b04d5d8e230bf4d7a84e13"}
Jul 24 16:30:05.586309 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:05.586286    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95"
Jul 24 16:30:06.468860 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:06.468829    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95"
Jul 24 16:30:06.468860 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:06.468845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-xss95" event={"ID":"868e1076-b04c-4e59-88f4-d67389686529","Type":"ContainerDied","Data":"cf9678d4601344359753f9ee745e877a1989f9510b50298340dd799458a7a722"}
Jul 24 16:30:06.469055 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:06.468889    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf9678d4601344359753f9ee745e877a1989f9510b50298340dd799458a7a722"
Jul 24 16:30:31.755498 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:31.755463    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:30:44.354779 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:44.354742    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:30:50.854415 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:30:50.854379    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:31:06.957056 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:31:06.957021    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:31:20.751147 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:31:20.751118    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:31:30.442192 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:31:30.442102    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:31:44.548913 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:31:44.548877    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:31:53.847845 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:31:53.847810    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:32:07.645219 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:32:07.645182    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:32:16.565328 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:32:16.565290    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:32:26.051674 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:32:26.051627    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:32:35.349571 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:32:35.349534    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:32:55.157525 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:32:55.157490    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:33:06.957378 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:33:06.957289    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:33:18.750670 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:33:18.750621    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:33:30.446479 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:33:30.446437    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:33:41.454067 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:33:41.454032    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:34:04.143159 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:04.143124    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:34:11.509215 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.509177    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"]
Jul 24 16:34:11.509801 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.509456    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868e1076-b04c-4e59-88f4-d67389686529" containerName="cleanup"
Jul 24 16:34:11.509801 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.509468    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="868e1076-b04c-4e59-88f4-d67389686529" containerName="cleanup"
Jul 24 16:34:11.509801 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.509531    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="868e1076-b04c-4e59-88f4-d67389686529" containerName="cleanup"
Jul 24 16:34:11.512348 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.512328    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:11.514676 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.514624    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3ee04f89-serving-cert\""
Jul 24 16:34:11.514786 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.514716    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:34:11.514984 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.514961    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w22br\""
Jul 24 16:34:11.515516 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.515499    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:34:11.525513 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.525494    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"]
Jul 24 16:34:11.611707 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.611670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb61b51-189e-48e1-b6a3-069735897f1b-maas-api-tls\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:11.612026 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.611849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wrf6\" (UniqueName: \"kubernetes.io/projected/4fb61b51-189e-48e1-b6a3-069735897f1b-kube-api-access-2wrf6\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:11.612026 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.611899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb61b51-189e-48e1-b6a3-069735897f1b-openshift-service-ca\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:11.712531 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.712491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb61b51-189e-48e1-b6a3-069735897f1b-maas-api-tls\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:11.712759 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.712582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrf6\" (UniqueName: \"kubernetes.io/projected/4fb61b51-189e-48e1-b6a3-069735897f1b-kube-api-access-2wrf6\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:11.712759 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.712618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb61b51-189e-48e1-b6a3-069735897f1b-openshift-service-ca\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:11.712759 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:34:11.712663    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-serving-cert: secret "maas-api-e2e-ait-3ee04f89-serving-cert" not found
Jul 24 16:34:11.712759 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:34:11.712740    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fb61b51-189e-48e1-b6a3-069735897f1b-maas-api-tls podName:4fb61b51-189e-48e1-b6a3-069735897f1b nodeName:}" failed. No retries permitted until 2026-07-24 16:34:12.21272292 +0000 UTC m=+1686.197413679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4fb61b51-189e-48e1-b6a3-069735897f1b-maas-api-tls") pod "maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6" (UID: "4fb61b51-189e-48e1-b6a3-069735897f1b") : secret "maas-api-e2e-ait-3ee04f89-serving-cert" not found
Jul 24 16:34:11.713276 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.713254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb61b51-189e-48e1-b6a3-069735897f1b-openshift-service-ca\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:11.722268 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:11.722248    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wrf6\" (UniqueName: \"kubernetes.io/projected/4fb61b51-189e-48e1-b6a3-069735897f1b-kube-api-access-2wrf6\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:12.217930 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:12.217898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb61b51-189e-48e1-b6a3-069735897f1b-maas-api-tls\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:12.220384 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:12.220354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb61b51-189e-48e1-b6a3-069735897f1b-maas-api-tls\") pod \"maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:12.424223 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:12.424192    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:12.556615 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:12.556588    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"]
Jul 24 16:34:12.558817 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:34:12.558790    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb61b51_189e_48e1_b6a3_069735897f1b.slice/crio-2df10ce4afcd0ff8e1808e26d94e93169360bcade6659b7749b8e955b7cf9831 WatchSource:0}: Error finding container 2df10ce4afcd0ff8e1808e26d94e93169360bcade6659b7749b8e955b7cf9831: Status 404 returned error can't find the container with id 2df10ce4afcd0ff8e1808e26d94e93169360bcade6659b7749b8e955b7cf9831
Jul 24 16:34:13.536724 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:13.536685    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6" event={"ID":"4fb61b51-189e-48e1-b6a3-069735897f1b","Type":"ContainerStarted","Data":"2df10ce4afcd0ff8e1808e26d94e93169360bcade6659b7749b8e955b7cf9831"}
Jul 24 16:34:14.648350 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:14.648314    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:34:15.547707 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:15.547673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6" event={"ID":"4fb61b51-189e-48e1-b6a3-069735897f1b","Type":"ContainerStarted","Data":"08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589"}
Jul 24 16:34:15.547851 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:15.547728    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:15.564937 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:15.564895    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6" podStartSLOduration=2.306776086 podStartE2EDuration="4.564880636s" totalImagesPullingTime="2.25810455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:34:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:34:15.564049236 +0000 UTC m=+1689.548740017" watchObservedRunningTime="2026-07-24 16:34:15.564880636 +0000 UTC m=+1689.549571417"
Jul 24 16:34:21.559077 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:21.559048    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:36.852187 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:36.852107    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"]
Jul 24 16:34:36.855279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:36.855263    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"
Jul 24 16:34:36.857563 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:36.857534    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wtjsm\""
Jul 24 16:34:36.863446 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:36.863423    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"]
Jul 24 16:34:37.025961 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:37.025931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z\" (UID: \"f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"
Jul 24 16:34:37.126392 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:37.126309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z\" (UID: \"f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"
Jul 24 16:34:37.126986 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:37.126968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z\" (UID: \"f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"
Jul 24 16:34:37.166090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:37.166065    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"
Jul 24 16:34:37.293975 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:37.293950    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"]
Jul 24 16:34:37.296277 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:34:37.296252    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ce6cdf_718e_4cb9_a8f1_8097f278ac3e.slice/crio-9aaa6ecc4d5786d492fa3a69944c1abc1bc36adf6b9aa7d3666c4f58622695a8 WatchSource:0}: Error finding container 9aaa6ecc4d5786d492fa3a69944c1abc1bc36adf6b9aa7d3666c4f58622695a8: Status 404 returned error can't find the container with id 9aaa6ecc4d5786d492fa3a69944c1abc1bc36adf6b9aa7d3666c4f58622695a8
Jul 24 16:34:37.647035 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:37.647007    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z" event={"ID":"f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e","Type":"ContainerStarted","Data":"72638d83f510a37b52e9654b75d0b902263c6137ce40e15594f407a18bdda9d1"}
Jul 24 16:34:37.647170 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:37.647062    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z" event={"ID":"f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e","Type":"ContainerStarted","Data":"9aaa6ecc4d5786d492fa3a69944c1abc1bc36adf6b9aa7d3666c4f58622695a8"}
Jul 24 16:34:37.663949 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:37.663906    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z" podStartSLOduration=1.663892551 podStartE2EDuration="1.663892551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:34:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:34:37.662977484 +0000 UTC m=+1711.647668284" watchObservedRunningTime="2026-07-24 16:34:37.663892551 +0000 UTC m=+1711.648583331"
Jul 24 16:34:38.652689 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:38.652649    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e" containerID="72638d83f510a37b52e9654b75d0b902263c6137ce40e15594f407a18bdda9d1" exitCode=0
Jul 24 16:34:38.653116 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:38.652701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z" event={"ID":"f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e","Type":"ContainerDied","Data":"72638d83f510a37b52e9654b75d0b902263c6137ce40e15594f407a18bdda9d1"}
Jul 24 16:34:39.778876 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:39.778856    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"
Jul 24 16:34:39.946788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:39.946704    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e-maas-api-service-ca\") pod \"f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e\" (UID: \"f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e\") "
Jul 24 16:34:39.947092 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:39.947063    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e" (UID: "f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:40.047233 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:40.047197    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e-maas-api-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:34:40.663162 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:40.663120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z" event={"ID":"f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e","Type":"ContainerDied","Data":"9aaa6ecc4d5786d492fa3a69944c1abc1bc36adf6b9aa7d3666c4f58622695a8"}
Jul 24 16:34:40.663321 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:40.663175    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9aaa6ecc4d5786d492fa3a69944c1abc1bc36adf6b9aa7d3666c4f58622695a8"
Jul 24 16:34:40.663321 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:40.663135    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"
Jul 24 16:34:47.298041 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.297969    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"]
Jul 24 16:34:47.298606 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.298306    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6" podUID="4fb61b51-189e-48e1-b6a3-069735897f1b" containerName="maas-api" containerID="cri-o://08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589" gracePeriod=30
Jul 24 16:34:47.539888 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.539855    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:47.606496 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.606469    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb61b51-189e-48e1-b6a3-069735897f1b-maas-api-tls\") pod \"4fb61b51-189e-48e1-b6a3-069735897f1b\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") "
Jul 24 16:34:47.606664 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.606515    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb61b51-189e-48e1-b6a3-069735897f1b-openshift-service-ca\") pod \"4fb61b51-189e-48e1-b6a3-069735897f1b\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") "
Jul 24 16:34:47.606664 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.606542    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wrf6\" (UniqueName: \"kubernetes.io/projected/4fb61b51-189e-48e1-b6a3-069735897f1b-kube-api-access-2wrf6\") pod \"4fb61b51-189e-48e1-b6a3-069735897f1b\" (UID: \"4fb61b51-189e-48e1-b6a3-069735897f1b\") "
Jul 24 16:34:47.606937 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.606912    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb61b51-189e-48e1-b6a3-069735897f1b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4fb61b51-189e-48e1-b6a3-069735897f1b" (UID: "4fb61b51-189e-48e1-b6a3-069735897f1b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:47.608905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.608876    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb61b51-189e-48e1-b6a3-069735897f1b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4fb61b51-189e-48e1-b6a3-069735897f1b" (UID: "4fb61b51-189e-48e1-b6a3-069735897f1b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:34:47.609007 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.608905    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb61b51-189e-48e1-b6a3-069735897f1b-kube-api-access-2wrf6" (OuterVolumeSpecName: "kube-api-access-2wrf6") pod "4fb61b51-189e-48e1-b6a3-069735897f1b" (UID: "4fb61b51-189e-48e1-b6a3-069735897f1b"). InnerVolumeSpecName "kube-api-access-2wrf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:47.701150 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.701113    2561 generic.go:356] "Generic (PLEG): container finished" podID="4fb61b51-189e-48e1-b6a3-069735897f1b" containerID="08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589" exitCode=0
Jul 24 16:34:47.701326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.701187    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"
Jul 24 16:34:47.701326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.701199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6" event={"ID":"4fb61b51-189e-48e1-b6a3-069735897f1b","Type":"ContainerDied","Data":"08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589"}
Jul 24 16:34:47.701326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.701293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6" event={"ID":"4fb61b51-189e-48e1-b6a3-069735897f1b","Type":"ContainerDied","Data":"2df10ce4afcd0ff8e1808e26d94e93169360bcade6659b7749b8e955b7cf9831"}
Jul 24 16:34:47.701326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.701324    2561 scope.go:117] "RemoveContainer" containerID="08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589"
Jul 24 16:34:47.707326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.707305    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb61b51-189e-48e1-b6a3-069735897f1b-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:34:47.707326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.707327    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb61b51-189e-48e1-b6a3-069735897f1b-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:34:47.707463 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.707336    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wrf6\" (UniqueName: \"kubernetes.io/projected/4fb61b51-189e-48e1-b6a3-069735897f1b-kube-api-access-2wrf6\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:34:47.710779 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.710765    2561 scope.go:117] "RemoveContainer" containerID="08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589"
Jul 24 16:34:47.711048 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:34:47.711029    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589\": container with ID starting with 08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589 not found: ID does not exist" containerID="08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589"
Jul 24 16:34:47.711101 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.711056    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589"} err="failed to get container status \"08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589\": rpc error: code = NotFound desc = could not find container \"08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589\": container with ID starting with 08d32de98322e468c3efb7449a9a74fc70f1e12556ca2d1308f03fea7511a589 not found: ID does not exist"
Jul 24 16:34:47.724572 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.724552    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"]
Jul 24 16:34:47.730684 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:47.730663    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ee04f89-5dd4d98769-5b8j6"]
Jul 24 16:34:48.507443 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:48.507410    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb61b51-189e-48e1-b6a3-069735897f1b" path="/var/lib/kubelet/pods/4fb61b51-189e-48e1-b6a3-069735897f1b/volumes"
Jul 24 16:34:50.443486 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:50.443446    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:34:51.929687 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:51.929655    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"]
Jul 24 16:34:51.932385 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:51.932356    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ee04f89-7zd7z"]
Jul 24 16:34:52.507536 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:52.507506    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e" path="/var/lib/kubelet/pods/f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e/volumes"
Jul 24 16:34:55.781368 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.781336    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"]
Jul 24 16:34:55.781738 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.781610    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb61b51-189e-48e1-b6a3-069735897f1b" containerName="maas-api"
Jul 24 16:34:55.781738 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.781621    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb61b51-189e-48e1-b6a3-069735897f1b" containerName="maas-api"
Jul 24 16:34:55.781738 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.781633    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e" containerName="revoke-keys"
Jul 24 16:34:55.781738 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.781655    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e" containerName="revoke-keys"
Jul 24 16:34:55.781738 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.781714    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ce6cdf-718e-4cb9-a8f1-8097f278ac3e" containerName="revoke-keys"
Jul 24 16:34:55.781738 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.781723    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb61b51-189e-48e1-b6a3-069735897f1b" containerName="maas-api"
Jul 24 16:34:55.785969 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.785951    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:55.788488 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.788464    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:34:55.789197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.789178    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-b12e1c2f-serving-cert\""
Jul 24 16:34:55.789295 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.789215    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w22br\""
Jul 24 16:34:55.789295 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.789219    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:34:55.793016 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.792885    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"]
Jul 24 16:34:55.867113 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.867078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n72z\" (UniqueName: \"kubernetes.io/projected/95159513-e537-48bb-8e98-4a5220863d4a-kube-api-access-4n72z\") pod \"maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:55.867291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.867128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95159513-e537-48bb-8e98-4a5220863d4a-maas-api-tls\") pod \"maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:55.867291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.867148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95159513-e537-48bb-8e98-4a5220863d4a-openshift-service-ca\") pod \"maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:55.967820 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.967789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n72z\" (UniqueName: \"kubernetes.io/projected/95159513-e537-48bb-8e98-4a5220863d4a-kube-api-access-4n72z\") pod \"maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:55.967974 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.967842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95159513-e537-48bb-8e98-4a5220863d4a-maas-api-tls\") pod \"maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:55.967974 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.967864    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95159513-e537-48bb-8e98-4a5220863d4a-openshift-service-ca\") pod \"maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:55.968482 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.968464    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95159513-e537-48bb-8e98-4a5220863d4a-openshift-service-ca\") pod \"maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:55.970401 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.970385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95159513-e537-48bb-8e98-4a5220863d4a-maas-api-tls\") pod \"maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:55.975964 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:55.975939    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n72z\" (UniqueName: \"kubernetes.io/projected/95159513-e537-48bb-8e98-4a5220863d4a-kube-api-access-4n72z\") pod \"maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:56.098326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:56.098302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:56.228107 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:56.228071    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"]
Jul 24 16:34:56.230163 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:34:56.230135    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95159513_e537_48bb_8e98_4a5220863d4a.slice/crio-25070ae0d57ace05708c0822f6cd56651fe16c40fe346f2b523e5975cb45203b WatchSource:0}: Error finding container 25070ae0d57ace05708c0822f6cd56651fe16c40fe346f2b523e5975cb45203b: Status 404 returned error can't find the container with id 25070ae0d57ace05708c0822f6cd56651fe16c40fe346f2b523e5975cb45203b
Jul 24 16:34:56.746973 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:56.746935    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6" event={"ID":"95159513-e537-48bb-8e98-4a5220863d4a","Type":"ContainerStarted","Data":"d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739"}
Jul 24 16:34:56.747147 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:56.746992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6" event={"ID":"95159513-e537-48bb-8e98-4a5220863d4a","Type":"ContainerStarted","Data":"25070ae0d57ace05708c0822f6cd56651fe16c40fe346f2b523e5975cb45203b"}
Jul 24 16:34:56.747147 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:56.747066    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:34:56.762972 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:34:56.762914    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6" podStartSLOduration=1.4176490720000001 podStartE2EDuration="1.762895234s" totalImagesPullingTime="345.246162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:34:56.762614468 +0000 UTC m=+1730.747305251" watchObservedRunningTime="2026-07-24 16:34:56.762895234 +0000 UTC m=+1730.747585993"
Jul 24 16:35:02.041413 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:02.041363    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:35:02.757316 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:02.757291    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:35:20.696804 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:20.696772    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"]
Jul 24 16:35:20.701284 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:20.701268    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"
Jul 24 16:35:20.703750 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:20.703553    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wtjsm\""
Jul 24 16:35:20.706263 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:20.706240    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"]
Jul 24 16:35:20.780812 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:20.780778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e59b2a4c-1a9f-4981-b270-bf966fe5723e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk\" (UID: \"e59b2a4c-1a9f-4981-b270-bf966fe5723e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"
Jul 24 16:35:20.881546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:20.881516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e59b2a4c-1a9f-4981-b270-bf966fe5723e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk\" (UID: \"e59b2a4c-1a9f-4981-b270-bf966fe5723e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"
Jul 24 16:35:20.882115 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:20.882095    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e59b2a4c-1a9f-4981-b270-bf966fe5723e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk\" (UID: \"e59b2a4c-1a9f-4981-b270-bf966fe5723e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"
Jul 24 16:35:21.012784 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:21.012701    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"
Jul 24 16:35:21.138444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:21.138402    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"]
Jul 24 16:35:21.141149 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:35:21.141126    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59b2a4c_1a9f_4981_b270_bf966fe5723e.slice/crio-021924ca5299d50d9e77f0a980eac7b59bcb0d68b3c8785ef6c92e50d4e2e1b7 WatchSource:0}: Error finding container 021924ca5299d50d9e77f0a980eac7b59bcb0d68b3c8785ef6c92e50d4e2e1b7: Status 404 returned error can't find the container with id 021924ca5299d50d9e77f0a980eac7b59bcb0d68b3c8785ef6c92e50d4e2e1b7
Jul 24 16:35:21.864981 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:21.864953    2561 generic.go:356] "Generic (PLEG): container finished" podID="e59b2a4c-1a9f-4981-b270-bf966fe5723e" containerID="8a9daece6c495c5f21800abc7b49b5b63baf2da21afc84c063767f481e5e8bbe" exitCode=0
Jul 24 16:35:21.865324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:21.865044    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk" event={"ID":"e59b2a4c-1a9f-4981-b270-bf966fe5723e","Type":"ContainerDied","Data":"8a9daece6c495c5f21800abc7b49b5b63baf2da21afc84c063767f481e5e8bbe"}
Jul 24 16:35:21.865324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:21.865103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk" event={"ID":"e59b2a4c-1a9f-4981-b270-bf966fe5723e","Type":"ContainerStarted","Data":"021924ca5299d50d9e77f0a980eac7b59bcb0d68b3c8785ef6c92e50d4e2e1b7"}
Jul 24 16:35:22.994821 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:22.994797    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"
Jul 24 16:35:23.098869 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:23.098832    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e59b2a4c-1a9f-4981-b270-bf966fe5723e-maas-api-service-ca\") pod \"e59b2a4c-1a9f-4981-b270-bf966fe5723e\" (UID: \"e59b2a4c-1a9f-4981-b270-bf966fe5723e\") "
Jul 24 16:35:23.099169 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:23.099146    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59b2a4c-1a9f-4981-b270-bf966fe5723e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e59b2a4c-1a9f-4981-b270-bf966fe5723e" (UID: "e59b2a4c-1a9f-4981-b270-bf966fe5723e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:35:23.199610 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:23.199539    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e59b2a4c-1a9f-4981-b270-bf966fe5723e-maas-api-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:35:23.877573 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:23.877544    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"
Jul 24 16:35:23.877781 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:23.877542    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk" event={"ID":"e59b2a4c-1a9f-4981-b270-bf966fe5723e","Type":"ContainerDied","Data":"021924ca5299d50d9e77f0a980eac7b59bcb0d68b3c8785ef6c92e50d4e2e1b7"}
Jul 24 16:35:23.877781 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:23.877685    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="021924ca5299d50d9e77f0a980eac7b59bcb0d68b3c8785ef6c92e50d4e2e1b7"
Jul 24 16:35:31.121821 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.121753    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"]
Jul 24 16:35:31.122253 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.122024    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6" podUID="95159513-e537-48bb-8e98-4a5220863d4a" containerName="maas-api" containerID="cri-o://d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739" gracePeriod=30
Jul 24 16:35:31.363056 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.363034    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:35:31.463208 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.463121    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95159513-e537-48bb-8e98-4a5220863d4a-maas-api-tls\") pod \"95159513-e537-48bb-8e98-4a5220863d4a\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") "
Jul 24 16:35:31.463208 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.463165    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n72z\" (UniqueName: \"kubernetes.io/projected/95159513-e537-48bb-8e98-4a5220863d4a-kube-api-access-4n72z\") pod \"95159513-e537-48bb-8e98-4a5220863d4a\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") "
Jul 24 16:35:31.463208 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.463207    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95159513-e537-48bb-8e98-4a5220863d4a-openshift-service-ca\") pod \"95159513-e537-48bb-8e98-4a5220863d4a\" (UID: \"95159513-e537-48bb-8e98-4a5220863d4a\") "
Jul 24 16:35:31.463595 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.463571    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95159513-e537-48bb-8e98-4a5220863d4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95159513-e537-48bb-8e98-4a5220863d4a" (UID: "95159513-e537-48bb-8e98-4a5220863d4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:35:31.465409 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.465381    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95159513-e537-48bb-8e98-4a5220863d4a-kube-api-access-4n72z" (OuterVolumeSpecName: "kube-api-access-4n72z") pod "95159513-e537-48bb-8e98-4a5220863d4a" (UID: "95159513-e537-48bb-8e98-4a5220863d4a"). InnerVolumeSpecName "kube-api-access-4n72z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:35:31.465409 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.465396    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95159513-e537-48bb-8e98-4a5220863d4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95159513-e537-48bb-8e98-4a5220863d4a" (UID: "95159513-e537-48bb-8e98-4a5220863d4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:35:31.564574 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.564535    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95159513-e537-48bb-8e98-4a5220863d4a-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:35:31.564574 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.564566    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95159513-e537-48bb-8e98-4a5220863d4a-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:35:31.564574 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.564575    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n72z\" (UniqueName: \"kubernetes.io/projected/95159513-e537-48bb-8e98-4a5220863d4a-kube-api-access-4n72z\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:35:31.915361 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.915328    2561 generic.go:356] "Generic (PLEG): container finished" podID="95159513-e537-48bb-8e98-4a5220863d4a" containerID="d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739" exitCode=0
Jul 24 16:35:31.915533 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.915371    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"
Jul 24 16:35:31.915533 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.915411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6" event={"ID":"95159513-e537-48bb-8e98-4a5220863d4a","Type":"ContainerDied","Data":"d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739"}
Jul 24 16:35:31.915533 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.915462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6" event={"ID":"95159513-e537-48bb-8e98-4a5220863d4a","Type":"ContainerDied","Data":"25070ae0d57ace05708c0822f6cd56651fe16c40fe346f2b523e5975cb45203b"}
Jul 24 16:35:31.915533 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.915485    2561 scope.go:117] "RemoveContainer" containerID="d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739"
Jul 24 16:35:31.924166 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.924151    2561 scope.go:117] "RemoveContainer" containerID="d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739"
Jul 24 16:35:31.924427 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:35:31.924409    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739\": container with ID starting with d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739 not found: ID does not exist" containerID="d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739"
Jul 24 16:35:31.924473 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.924438    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739"} err="failed to get container status \"d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739\": rpc error: code = NotFound desc = could not find container \"d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739\": container with ID starting with d1b271fd47e74e1e87c9e39f3d26b75efeccabe96f5d47c7e75ecb3b81298739 not found: ID does not exist"
Jul 24 16:35:31.936758 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.936733    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"]
Jul 24 16:35:31.940720 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:31.940700    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b12e1c2f-65758fc7cb-8h9d6"]
Jul 24 16:35:32.506694 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:32.506664    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95159513-e537-48bb-8e98-4a5220863d4a" path="/var/lib/kubelet/pods/95159513-e537-48bb-8e98-4a5220863d4a/volumes"
Jul 24 16:35:34.245632 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:34.245595    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:35:35.780847 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:35.780815    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"]
Jul 24 16:35:35.783895 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:35.783870    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b12e1c2f-lmbnk"]
Jul 24 16:35:36.506995 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:36.506967    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59b2a4c-1a9f-4981-b270-bf966fe5723e" path="/var/lib/kubelet/pods/e59b2a4c-1a9f-4981-b270-bf966fe5723e/volumes"
Jul 24 16:35:38.985629 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.985585    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"]
Jul 24 16:35:38.985998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.985864    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95159513-e537-48bb-8e98-4a5220863d4a" containerName="maas-api"
Jul 24 16:35:38.985998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.985875    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95159513-e537-48bb-8e98-4a5220863d4a" containerName="maas-api"
Jul 24 16:35:38.985998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.985884    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59b2a4c-1a9f-4981-b270-bf966fe5723e" containerName="revoke-keys"
Jul 24 16:35:38.985998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.985889    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59b2a4c-1a9f-4981-b270-bf966fe5723e" containerName="revoke-keys"
Jul 24 16:35:38.985998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.985932    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59b2a4c-1a9f-4981-b270-bf966fe5723e" containerName="revoke-keys"
Jul 24 16:35:38.985998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.985942    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="95159513-e537-48bb-8e98-4a5220863d4a" containerName="maas-api"
Jul 24 16:35:38.988766 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.988745    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:38.991433 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.991412    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w22br\""
Jul 24 16:35:38.991547 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.991492    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:35:38.992258 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.992237    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9c399289-serving-cert\""
Jul 24 16:35:38.992518 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:38.992503    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:35:39.057103 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.057069    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"]
Jul 24 16:35:39.125260 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.125228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-openshift-service-ca\") pod \"maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.125260 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.125261    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95hb4\" (UniqueName: \"kubernetes.io/projected/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-kube-api-access-95hb4\") pod \"maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.125434 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.125348    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-maas-api-tls\") pod \"maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.225962 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.225932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-openshift-service-ca\") pod \"maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.225962 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.225966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95hb4\" (UniqueName: \"kubernetes.io/projected/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-kube-api-access-95hb4\") pod \"maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.226159 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.226023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-maas-api-tls\") pod \"maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.226582 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.226562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-openshift-service-ca\") pod \"maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.228571 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.228551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-maas-api-tls\") pod \"maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.234844 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.234817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95hb4\" (UniqueName: \"kubernetes.io/projected/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-kube-api-access-95hb4\") pod \"maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.299571 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.299500    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:39.427469 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.427444    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"]
Jul 24 16:35:39.429318 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:35:39.429291    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127183a5_fb7a_4f53_9a1a_2cfae4eca9f1.slice/crio-6f5df818973c955b743ddf3becfaa6cf23f61ab236ddbae89868136f710b0e7b WatchSource:0}: Error finding container 6f5df818973c955b743ddf3becfaa6cf23f61ab236ddbae89868136f710b0e7b: Status 404 returned error can't find the container with id 6f5df818973c955b743ddf3becfaa6cf23f61ab236ddbae89868136f710b0e7b
Jul 24 16:35:39.430701 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.430684    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:35:39.772005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.771975    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"]
Jul 24 16:35:39.776247 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.776224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:35:39.778603 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.778579    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9c399289\""
Jul 24 16:35:39.778720 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.778585    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9c399289-dockercfg-gql45\""
Jul 24 16:35:39.785127 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.785105    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"]
Jul 24 16:35:39.931160 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.931121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655d82de-85b8-48e8-861b-17e13733cf25-plugins-config-volume\") pod \"payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc\" (UID: \"655d82de-85b8-48e8-861b-17e13733cf25\") " pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:35:39.931335 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.931201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmszx\" (UniqueName: \"kubernetes.io/projected/655d82de-85b8-48e8-861b-17e13733cf25-kube-api-access-tmszx\") pod \"payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc\" (UID: \"655d82de-85b8-48e8-861b-17e13733cf25\") " pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:35:39.954907 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:39.954878    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r" event={"ID":"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1","Type":"ContainerStarted","Data":"6f5df818973c955b743ddf3becfaa6cf23f61ab236ddbae89868136f710b0e7b"}
Jul 24 16:35:40.031545 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.031519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmszx\" (UniqueName: \"kubernetes.io/projected/655d82de-85b8-48e8-861b-17e13733cf25-kube-api-access-tmszx\") pod \"payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc\" (UID: \"655d82de-85b8-48e8-861b-17e13733cf25\") " pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:35:40.031903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.031565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655d82de-85b8-48e8-861b-17e13733cf25-plugins-config-volume\") pod \"payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc\" (UID: \"655d82de-85b8-48e8-861b-17e13733cf25\") " pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:35:40.032198 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.032181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655d82de-85b8-48e8-861b-17e13733cf25-plugins-config-volume\") pod \"payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc\" (UID: \"655d82de-85b8-48e8-861b-17e13733cf25\") " pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:35:40.043377 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.043354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmszx\" (UniqueName: \"kubernetes.io/projected/655d82de-85b8-48e8-861b-17e13733cf25-kube-api-access-tmszx\") pod \"payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc\" (UID: \"655d82de-85b8-48e8-861b-17e13733cf25\") " pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:35:40.088272 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.088246    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:35:40.224253 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.224225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"]
Jul 24 16:35:40.225860 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:35:40.225833    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655d82de_85b8_48e8_861b_17e13733cf25.slice/crio-6eabd0d8c87cbc9ac97c1ba9bf2eaf930ab39b132c358c502964d66914cf5e03 WatchSource:0}: Error finding container 6eabd0d8c87cbc9ac97c1ba9bf2eaf930ab39b132c358c502964d66914cf5e03: Status 404 returned error can't find the container with id 6eabd0d8c87cbc9ac97c1ba9bf2eaf930ab39b132c358c502964d66914cf5e03
Jul 24 16:35:40.962255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.962218    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r" event={"ID":"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1","Type":"ContainerStarted","Data":"056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91"}
Jul 24 16:35:40.962421 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.962305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:40.963438 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.963417    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc" event={"ID":"655d82de-85b8-48e8-861b-17e13733cf25","Type":"ContainerStarted","Data":"6eabd0d8c87cbc9ac97c1ba9bf2eaf930ab39b132c358c502964d66914cf5e03"}
Jul 24 16:35:40.979416 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:40.979339    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r" podStartSLOduration=2.431297294 podStartE2EDuration="2.979324554s" totalImagesPullingTime="548.02726ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:35:40.978948654 +0000 UTC m=+1774.963639445" watchObservedRunningTime="2026-07-24 16:35:40.979324554 +0000 UTC m=+1774.964015336"
Jul 24 16:35:42.974339 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:42.974300    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc" event={"ID":"655d82de-85b8-48e8-861b-17e13733cf25","Type":"ContainerStarted","Data":"a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec"}
Jul 24 16:35:42.974723 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:42.974403    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:35:42.992480 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:42.992435    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc" podStartSLOduration=1.914034981 podStartE2EDuration="3.992422533s" totalImagesPullingTime="2.078387552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:35:42.990002572 +0000 UTC m=+1776.974693353" watchObservedRunningTime="2026-07-24 16:35:42.992422533 +0000 UTC m=+1776.977113314"
Jul 24 16:35:45.349889 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:45.349849    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:35:46.975199 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:46.975170    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:35:53.980166 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:35:53.980137    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:36:15.092353 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.092322    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"]
Jul 24 16:36:15.092762 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.092545    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r" podUID="127183a5-fb7a-4f53-9a1a-2cfae4eca9f1" containerName="maas-api" containerID="cri-o://056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91" gracePeriod=30
Jul 24 16:36:15.145135 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.145106    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"]
Jul 24 16:36:15.145321 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.145292    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc" podUID="655d82de-85b8-48e8-861b-17e13733cf25" containerName="payload-processing" containerID="cri-o://a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec" gracePeriod=30
Jul 24 16:36:15.383627 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.383597    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:36:15.422625 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.422602    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:36:15.514623 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.514592    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95hb4\" (UniqueName: \"kubernetes.io/projected/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-kube-api-access-95hb4\") pod \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") "
Jul 24 16:36:15.514789 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.514690    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-openshift-service-ca\") pod \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") "
Jul 24 16:36:15.514789 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.514716    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655d82de-85b8-48e8-861b-17e13733cf25-plugins-config-volume\") pod \"655d82de-85b8-48e8-861b-17e13733cf25\" (UID: \"655d82de-85b8-48e8-861b-17e13733cf25\") "
Jul 24 16:36:15.514789 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.514746    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmszx\" (UniqueName: \"kubernetes.io/projected/655d82de-85b8-48e8-861b-17e13733cf25-kube-api-access-tmszx\") pod \"655d82de-85b8-48e8-861b-17e13733cf25\" (UID: \"655d82de-85b8-48e8-861b-17e13733cf25\") "
Jul 24 16:36:15.514938 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.514794    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-maas-api-tls\") pod \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\" (UID: \"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1\") "
Jul 24 16:36:15.515121 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.515089    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "127183a5-fb7a-4f53-9a1a-2cfae4eca9f1" (UID: "127183a5-fb7a-4f53-9a1a-2cfae4eca9f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:15.515121 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.515098    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/655d82de-85b8-48e8-861b-17e13733cf25-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "655d82de-85b8-48e8-861b-17e13733cf25" (UID: "655d82de-85b8-48e8-861b-17e13733cf25"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:15.516903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.516872    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "127183a5-fb7a-4f53-9a1a-2cfae4eca9f1" (UID: "127183a5-fb7a-4f53-9a1a-2cfae4eca9f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:36:15.517024 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.517008    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655d82de-85b8-48e8-861b-17e13733cf25-kube-api-access-tmszx" (OuterVolumeSpecName: "kube-api-access-tmszx") pod "655d82de-85b8-48e8-861b-17e13733cf25" (UID: "655d82de-85b8-48e8-861b-17e13733cf25"). InnerVolumeSpecName "kube-api-access-tmszx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:15.517071 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.517019    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-kube-api-access-95hb4" (OuterVolumeSpecName: "kube-api-access-95hb4") pod "127183a5-fb7a-4f53-9a1a-2cfae4eca9f1" (UID: "127183a5-fb7a-4f53-9a1a-2cfae4eca9f1"). InnerVolumeSpecName "kube-api-access-95hb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:15.616070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.616042    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:15.616070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.616067    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655d82de-85b8-48e8-861b-17e13733cf25-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:15.616198 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.616077    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmszx\" (UniqueName: \"kubernetes.io/projected/655d82de-85b8-48e8-861b-17e13733cf25-kube-api-access-tmszx\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:15.616198 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.616086    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:15.616198 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:15.616094    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95hb4\" (UniqueName: \"kubernetes.io/projected/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1-kube-api-access-95hb4\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:16.125992 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.125958    2561 generic.go:356] "Generic (PLEG): container finished" podID="127183a5-fb7a-4f53-9a1a-2cfae4eca9f1" containerID="056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91" exitCode=0
Jul 24 16:36:16.126378 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.125998    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"
Jul 24 16:36:16.126378 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.126042    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r" event={"ID":"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1","Type":"ContainerDied","Data":"056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91"}
Jul 24 16:36:16.126378 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.126093    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r" event={"ID":"127183a5-fb7a-4f53-9a1a-2cfae4eca9f1","Type":"ContainerDied","Data":"6f5df818973c955b743ddf3becfaa6cf23f61ab236ddbae89868136f710b0e7b"}
Jul 24 16:36:16.126378 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.126115    2561 scope.go:117] "RemoveContainer" containerID="056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91"
Jul 24 16:36:16.127454 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.127431    2561 generic.go:356] "Generic (PLEG): container finished" podID="655d82de-85b8-48e8-861b-17e13733cf25" containerID="a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec" exitCode=0
Jul 24 16:36:16.127573 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.127475    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"
Jul 24 16:36:16.127573 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.127512    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc" event={"ID":"655d82de-85b8-48e8-861b-17e13733cf25","Type":"ContainerDied","Data":"a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec"}
Jul 24 16:36:16.127573 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.127559    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc" event={"ID":"655d82de-85b8-48e8-861b-17e13733cf25","Type":"ContainerDied","Data":"6eabd0d8c87cbc9ac97c1ba9bf2eaf930ab39b132c358c502964d66914cf5e03"}
Jul 24 16:36:16.136371 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.136354    2561 scope.go:117] "RemoveContainer" containerID="056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91"
Jul 24 16:36:16.136690 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:36:16.136666    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91\": container with ID starting with 056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91 not found: ID does not exist" containerID="056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91"
Jul 24 16:36:16.136788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.136700    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91"} err="failed to get container status \"056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91\": rpc error: code = NotFound desc = could not find container \"056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91\": container with ID starting with 056cf5a28b40bc96780fae6daf74e7977cf9ca9fc8bafb60235538171702cf91 not found: ID does not exist"
Jul 24 16:36:16.136788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.136723    2561 scope.go:117] "RemoveContainer" containerID="a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec"
Jul 24 16:36:16.146426 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.146371    2561 scope.go:117] "RemoveContainer" containerID="a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec"
Jul 24 16:36:16.146877 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:36:16.146857    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec\": container with ID starting with a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec not found: ID does not exist" containerID="a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec"
Jul 24 16:36:16.146955 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.146882    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec"} err="failed to get container status \"a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec\": rpc error: code = NotFound desc = could not find container \"a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec\": container with ID starting with a51339a58b1448c70f79907abbac189cdafdabe359520f8766b02f8ee47414ec not found: ID does not exist"
Jul 24 16:36:16.148450 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.148430    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"]
Jul 24 16:36:16.151117 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.151097    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c399289-fbfcd66d5-h6h4r"]
Jul 24 16:36:16.160209 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.160192    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"]
Jul 24 16:36:16.163734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.163716    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9c399289-6b597d5796-s6jlc"]
Jul 24 16:36:16.507047 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.506969    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="127183a5-fb7a-4f53-9a1a-2cfae4eca9f1" path="/var/lib/kubelet/pods/127183a5-fb7a-4f53-9a1a-2cfae4eca9f1/volumes"
Jul 24 16:36:16.507324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:16.507310    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="655d82de-85b8-48e8-861b-17e13733cf25" path="/var/lib/kubelet/pods/655d82de-85b8-48e8-861b-17e13733cf25/volumes"
Jul 24 16:36:18.041726 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:18.041692    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:36:24.323167 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.323137    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"]
Jul 24 16:36:24.323551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.323414    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655d82de-85b8-48e8-861b-17e13733cf25" containerName="payload-processing"
Jul 24 16:36:24.323551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.323426    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="655d82de-85b8-48e8-861b-17e13733cf25" containerName="payload-processing"
Jul 24 16:36:24.323551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.323434    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127183a5-fb7a-4f53-9a1a-2cfae4eca9f1" containerName="maas-api"
Jul 24 16:36:24.323551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.323439    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="127183a5-fb7a-4f53-9a1a-2cfae4eca9f1" containerName="maas-api"
Jul 24 16:36:24.323551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.323483    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="655d82de-85b8-48e8-861b-17e13733cf25" containerName="payload-processing"
Jul 24 16:36:24.323551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.323490    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="127183a5-fb7a-4f53-9a1a-2cfae4eca9f1" containerName="maas-api"
Jul 24 16:36:24.326504 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.326485    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.329744 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.329721    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:36:24.329858 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.329785    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w22br\""
Jul 24 16:36:24.330503 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.330479    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-13a053f7-serving-cert\""
Jul 24 16:36:24.330616 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.330494    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:36:24.337466 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.337444    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"]
Jul 24 16:36:24.388850 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.388817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2rng\" (UniqueName: \"kubernetes.io/projected/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-kube-api-access-s2rng\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.389008 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.388868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-maas-api-tls\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.389008 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.388889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-openshift-service-ca\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.489527 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.489495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2rng\" (UniqueName: \"kubernetes.io/projected/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-kube-api-access-s2rng\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.489710 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.489546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-maas-api-tls\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.489710 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:36:24.489669    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-serving-cert: secret "maas-api-e2e-derive-13a053f7-serving-cert" not found
Jul 24 16:36:24.489807 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.489670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-openshift-service-ca\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.489807 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:36:24.489740    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-maas-api-tls podName:ccb6c92c-3eb7-4186-aaea-9be7824c88b0 nodeName:}" failed. No retries permitted until 2026-07-24 16:36:24.989720011 +0000 UTC m=+1818.974410776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-maas-api-tls") pod "maas-api-e2e-derive-13a053f7-798c74d988-v7dwn" (UID: "ccb6c92c-3eb7-4186-aaea-9be7824c88b0") : secret "maas-api-e2e-derive-13a053f7-serving-cert" not found
Jul 24 16:36:24.490265 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.490246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-openshift-service-ca\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.500287 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.500268    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2rng\" (UniqueName: \"kubernetes.io/projected/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-kube-api-access-s2rng\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.947474 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.947441    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"]
Jul 24 16:36:24.950809 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.950789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:24.953260 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.953237    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-13a053f7\""
Jul 24 16:36:24.963715 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.963690    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"]
Jul 24 16:36:24.979708 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.979681    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"]
Jul 24 16:36:24.982818 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.982801    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:24.985145 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.985121    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-13a053f7-dockercfg-cjg96\""
Jul 24 16:36:24.993777 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.993755    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"]
Jul 24 16:36:24.994032 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.994011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-maas-api-tls\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:24.996557 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:24.996531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-maas-api-tls\") pod \"maas-api-e2e-derive-13a053f7-798c74d988-v7dwn\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:25.095444 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.095412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpmzj\" (UniqueName: \"kubernetes.io/projected/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-kube-api-access-qpmzj\") pod \"payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc\" (UID: \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:25.095727 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.095452    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68230199-0a00-411d-a844-09464dbd1d12-plugins-config-volume\") pod \"payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f\" (UID: \"68230199-0a00-411d-a844-09464dbd1d12\") " pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:25.095727 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.095489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kml9g\" (UniqueName: \"kubernetes.io/projected/68230199-0a00-411d-a844-09464dbd1d12-kube-api-access-kml9g\") pod \"payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f\" (UID: \"68230199-0a00-411d-a844-09464dbd1d12\") " pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:25.095727 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.095598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc\" (UID: \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:25.196412 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.196380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc\" (UID: \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:25.196569 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.196420    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpmzj\" (UniqueName: \"kubernetes.io/projected/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-kube-api-access-qpmzj\") pod \"payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc\" (UID: \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:25.196569 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.196452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68230199-0a00-411d-a844-09464dbd1d12-plugins-config-volume\") pod \"payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f\" (UID: \"68230199-0a00-411d-a844-09464dbd1d12\") " pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:25.196569 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.196501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kml9g\" (UniqueName: \"kubernetes.io/projected/68230199-0a00-411d-a844-09464dbd1d12-kube-api-access-kml9g\") pod \"payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f\" (UID: \"68230199-0a00-411d-a844-09464dbd1d12\") " pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:25.197182 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.197163    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc\" (UID: \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:25.197222 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.197196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68230199-0a00-411d-a844-09464dbd1d12-plugins-config-volume\") pod \"payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f\" (UID: \"68230199-0a00-411d-a844-09464dbd1d12\") " pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:25.206546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.206485    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpmzj\" (UniqueName: \"kubernetes.io/projected/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-kube-api-access-qpmzj\") pod \"payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc\" (UID: \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:25.206666 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.206625    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kml9g\" (UniqueName: \"kubernetes.io/projected/68230199-0a00-411d-a844-09464dbd1d12-kube-api-access-kml9g\") pod \"payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f\" (UID: \"68230199-0a00-411d-a844-09464dbd1d12\") " pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:25.237411 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.237388    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:25.261397 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.261376    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:25.292547 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.292520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:25.389550 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.389510    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"]
Jul 24 16:36:25.415741 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.415377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"]
Jul 24 16:36:25.417143 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:36:25.417115    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7ccb1c_224d_4b4c_83a4_64e267216ae9.slice/crio-59d3a1112eda1379fca183ccec21632088ce79709a0909d47d6989efcd15fb1c WatchSource:0}: Error finding container 59d3a1112eda1379fca183ccec21632088ce79709a0909d47d6989efcd15fb1c: Status 404 returned error can't find the container with id 59d3a1112eda1379fca183ccec21632088ce79709a0909d47d6989efcd15fb1c
Jul 24 16:36:25.446864 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:25.446727    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"]
Jul 24 16:36:25.452707 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:36:25.452682    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68230199_0a00_411d_a844_09464dbd1d12.slice/crio-6f7a62a81dd5aee89977a929be0af61bbff77d6f8a0278339e93cd60cf9450c7 WatchSource:0}: Error finding container 6f7a62a81dd5aee89977a929be0af61bbff77d6f8a0278339e93cd60cf9450c7: Status 404 returned error can't find the container with id 6f7a62a81dd5aee89977a929be0af61bbff77d6f8a0278339e93cd60cf9450c7
Jul 24 16:36:26.178179 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.178139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc" event={"ID":"1f7ccb1c-224d-4b4c-83a4-64e267216ae9","Type":"ContainerStarted","Data":"1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae"}
Jul 24 16:36:26.178368 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.178200    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc" event={"ID":"1f7ccb1c-224d-4b4c-83a4-64e267216ae9","Type":"ContainerStarted","Data":"59d3a1112eda1379fca183ccec21632088ce79709a0909d47d6989efcd15fb1c"}
Jul 24 16:36:26.178368 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.178243    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:26.179658 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.179624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f" event={"ID":"68230199-0a00-411d-a844-09464dbd1d12","Type":"ContainerStarted","Data":"44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a"}
Jul 24 16:36:26.179770 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.179666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f" event={"ID":"68230199-0a00-411d-a844-09464dbd1d12","Type":"ContainerStarted","Data":"6f7a62a81dd5aee89977a929be0af61bbff77d6f8a0278339e93cd60cf9450c7"}
Jul 24 16:36:26.179770 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.179694    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:26.181096 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.181079    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn" event={"ID":"ccb6c92c-3eb7-4186-aaea-9be7824c88b0","Type":"ContainerStarted","Data":"d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274"}
Jul 24 16:36:26.181189 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.181109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn" event={"ID":"ccb6c92c-3eb7-4186-aaea-9be7824c88b0","Type":"ContainerStarted","Data":"d89398524c9fe6bb0d033ed7f52c241452413d8a59973aa3566a484e2b81280f"}
Jul 24 16:36:26.181189 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.181161    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:26.194829 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.194791    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc" podStartSLOduration=2.194779139 podStartE2EDuration="2.194779139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:36:26.19360907 +0000 UTC m=+1820.178299857" watchObservedRunningTime="2026-07-24 16:36:26.194779139 +0000 UTC m=+1820.179469898"
Jul 24 16:36:26.209416 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.209377    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f" podStartSLOduration=2.209364402 podStartE2EDuration="2.209364402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:36:26.208132568 +0000 UTC m=+1820.192823350" watchObservedRunningTime="2026-07-24 16:36:26.209364402 +0000 UTC m=+1820.194055183"
Jul 24 16:36:26.226604 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:26.226563    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn" podStartSLOduration=1.824112917 podStartE2EDuration="2.226550677s" totalImagesPullingTime="402.43776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:36:26.225533766 +0000 UTC m=+1820.210224547" watchObservedRunningTime="2026-07-24 16:36:26.226550677 +0000 UTC m=+1820.211241509"
Jul 24 16:36:27.145337 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:27.145303    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:36:32.191334 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:32.191304    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:37.187600 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:37.187568    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:37.188042 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:37.187662    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:59.451578 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.451544    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"]
Jul 24 16:36:59.452120 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.451819    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn" podUID="ccb6c92c-3eb7-4186-aaea-9be7824c88b0" containerName="maas-api" containerID="cri-o://d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274" gracePeriod=30
Jul 24 16:36:59.564248 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.564219    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"]
Jul 24 16:36:59.564445 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.564416    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f" podUID="68230199-0a00-411d-a844-09464dbd1d12" containerName="payload-processing" containerID="cri-o://44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a" gracePeriod=30
Jul 24 16:36:59.580002 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.579969    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"]
Jul 24 16:36:59.580282 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.580248    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc" podUID="1f7ccb1c-224d-4b4c-83a4-64e267216ae9" containerName="payload-pre-processing" containerID="cri-o://1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae" gracePeriod=30
Jul 24 16:36:59.722253 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.722228    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:36:59.783860 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.783832    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-openshift-service-ca\") pod \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") "
Jul 24 16:36:59.784019 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.783871    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-maas-api-tls\") pod \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") "
Jul 24 16:36:59.784019 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.783908    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2rng\" (UniqueName: \"kubernetes.io/projected/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-kube-api-access-s2rng\") pod \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\" (UID: \"ccb6c92c-3eb7-4186-aaea-9be7824c88b0\") "
Jul 24 16:36:59.784186 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.784160    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccb6c92c-3eb7-4186-aaea-9be7824c88b0" (UID: "ccb6c92c-3eb7-4186-aaea-9be7824c88b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:59.786695 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.786667    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-kube-api-access-s2rng" (OuterVolumeSpecName: "kube-api-access-s2rng") pod "ccb6c92c-3eb7-4186-aaea-9be7824c88b0" (UID: "ccb6c92c-3eb7-4186-aaea-9be7824c88b0"). InnerVolumeSpecName "kube-api-access-s2rng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:59.786815 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.786737    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccb6c92c-3eb7-4186-aaea-9be7824c88b0" (UID: "ccb6c92c-3eb7-4186-aaea-9be7824c88b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:36:59.836736 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.836709    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:36:59.843606 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.843581    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:36:59.884704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.884673    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68230199-0a00-411d-a844-09464dbd1d12-plugins-config-volume\") pod \"68230199-0a00-411d-a844-09464dbd1d12\" (UID: \"68230199-0a00-411d-a844-09464dbd1d12\") "
Jul 24 16:36:59.884877 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.884723    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-plugins-config-volume\") pod \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\" (UID: \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\") "
Jul 24 16:36:59.884877 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.884772    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kml9g\" (UniqueName: \"kubernetes.io/projected/68230199-0a00-411d-a844-09464dbd1d12-kube-api-access-kml9g\") pod \"68230199-0a00-411d-a844-09464dbd1d12\" (UID: \"68230199-0a00-411d-a844-09464dbd1d12\") "
Jul 24 16:36:59.884877 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.884792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpmzj\" (UniqueName: \"kubernetes.io/projected/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-kube-api-access-qpmzj\") pod \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\" (UID: \"1f7ccb1c-224d-4b4c-83a4-64e267216ae9\") "
Jul 24 16:36:59.885083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.885054    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2rng\" (UniqueName: \"kubernetes.io/projected/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-kube-api-access-s2rng\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:59.885155 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.885055    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68230199-0a00-411d-a844-09464dbd1d12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68230199-0a00-411d-a844-09464dbd1d12" (UID: "68230199-0a00-411d-a844-09464dbd1d12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:59.885155 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.885130    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:59.885155 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.885148    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccb6c92c-3eb7-4186-aaea-9be7824c88b0-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:59.885277 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.885188    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f7ccb1c-224d-4b4c-83a4-64e267216ae9" (UID: "1f7ccb1c-224d-4b4c-83a4-64e267216ae9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:59.886966 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.886940    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68230199-0a00-411d-a844-09464dbd1d12-kube-api-access-kml9g" (OuterVolumeSpecName: "kube-api-access-kml9g") pod "68230199-0a00-411d-a844-09464dbd1d12" (UID: "68230199-0a00-411d-a844-09464dbd1d12"). InnerVolumeSpecName "kube-api-access-kml9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:59.887064 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.887011    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-kube-api-access-qpmzj" (OuterVolumeSpecName: "kube-api-access-qpmzj") pod "1f7ccb1c-224d-4b4c-83a4-64e267216ae9" (UID: "1f7ccb1c-224d-4b4c-83a4-64e267216ae9"). InnerVolumeSpecName "kube-api-access-qpmzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:59.986060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.985990    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kml9g\" (UniqueName: \"kubernetes.io/projected/68230199-0a00-411d-a844-09464dbd1d12-kube-api-access-kml9g\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:59.986060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.986013    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpmzj\" (UniqueName: \"kubernetes.io/projected/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-kube-api-access-qpmzj\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:59.986060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.986022    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68230199-0a00-411d-a844-09464dbd1d12-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:36:59.986060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:36:59.986033    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7ccb1c-224d-4b4c-83a4-64e267216ae9-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:37:00.340869 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.340774    2561 generic.go:356] "Generic (PLEG): container finished" podID="1f7ccb1c-224d-4b4c-83a4-64e267216ae9" containerID="1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae" exitCode=0
Jul 24 16:37:00.340869 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.340825    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"
Jul 24 16:37:00.341075 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.340863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc" event={"ID":"1f7ccb1c-224d-4b4c-83a4-64e267216ae9","Type":"ContainerDied","Data":"1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae"}
Jul 24 16:37:00.341075 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.340923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc" event={"ID":"1f7ccb1c-224d-4b4c-83a4-64e267216ae9","Type":"ContainerDied","Data":"59d3a1112eda1379fca183ccec21632088ce79709a0909d47d6989efcd15fb1c"}
Jul 24 16:37:00.341075 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.340950    2561 scope.go:117] "RemoveContainer" containerID="1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae"
Jul 24 16:37:00.342179 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.342155    2561 generic.go:356] "Generic (PLEG): container finished" podID="68230199-0a00-411d-a844-09464dbd1d12" containerID="44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a" exitCode=0
Jul 24 16:37:00.342286 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.342186    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f" event={"ID":"68230199-0a00-411d-a844-09464dbd1d12","Type":"ContainerDied","Data":"44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a"}
Jul 24 16:37:00.342286 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.342209    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"
Jul 24 16:37:00.342387 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.342247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f" event={"ID":"68230199-0a00-411d-a844-09464dbd1d12","Type":"ContainerDied","Data":"6f7a62a81dd5aee89977a929be0af61bbff77d6f8a0278339e93cd60cf9450c7"}
Jul 24 16:37:00.343625 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.343599    2561 generic.go:356] "Generic (PLEG): container finished" podID="ccb6c92c-3eb7-4186-aaea-9be7824c88b0" containerID="d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274" exitCode=0
Jul 24 16:37:00.343759 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.343629    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"
Jul 24 16:37:00.343759 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.343631    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn" event={"ID":"ccb6c92c-3eb7-4186-aaea-9be7824c88b0","Type":"ContainerDied","Data":"d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274"}
Jul 24 16:37:00.343759 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.343725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn" event={"ID":"ccb6c92c-3eb7-4186-aaea-9be7824c88b0","Type":"ContainerDied","Data":"d89398524c9fe6bb0d033ed7f52c241452413d8a59973aa3566a484e2b81280f"}
Jul 24 16:37:00.351326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.351308    2561 scope.go:117] "RemoveContainer" containerID="1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae"
Jul 24 16:37:00.351621 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:37:00.351597    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae\": container with ID starting with 1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae not found: ID does not exist" containerID="1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae"
Jul 24 16:37:00.351706 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.351633    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae"} err="failed to get container status \"1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae\": rpc error: code = NotFound desc = could not find container \"1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae\": container with ID starting with 1802ac8d38c0fca9df44bbc7c35f96f3f058676f358e73503c208170bb0944ae not found: ID does not exist"
Jul 24 16:37:00.351706 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.351689    2561 scope.go:117] "RemoveContainer" containerID="44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a"
Jul 24 16:37:00.359464 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.359444    2561 scope.go:117] "RemoveContainer" containerID="44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a"
Jul 24 16:37:00.360133 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:37:00.360114    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a\": container with ID starting with 44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a not found: ID does not exist" containerID="44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a"
Jul 24 16:37:00.360191 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.360140    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a"} err="failed to get container status \"44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a\": rpc error: code = NotFound desc = could not find container \"44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a\": container with ID starting with 44d4dc59a0c146ccbe75aa3f9af115a31ce4b822cf64699161c50a6e10b3729a not found: ID does not exist"
Jul 24 16:37:00.360191 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.360156    2561 scope.go:117] "RemoveContainer" containerID="d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274"
Jul 24 16:37:00.364620 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.364598    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"]
Jul 24 16:37:00.367779 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.367759    2561 scope.go:117] "RemoveContainer" containerID="d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274"
Jul 24 16:37:00.368041 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:37:00.368022    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274\": container with ID starting with d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274 not found: ID does not exist" containerID="d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274"
Jul 24 16:37:00.368108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.368049    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274"} err="failed to get container status \"d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274\": rpc error: code = NotFound desc = could not find container \"d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274\": container with ID starting with d23e33fc4b376811a4e8e1da1381dfc52c25157f9581207abca32199ce7e4274 not found: ID does not exist"
Jul 24 16:37:00.368424 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.368407    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-13a053f7-85d589fbbd-wvzpc"]
Jul 24 16:37:00.379050 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.379030    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"]
Jul 24 16:37:00.384680 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.384661    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-13a053f7-58fc7c994b-lsz9f"]
Jul 24 16:37:00.394422 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.394402    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"]
Jul 24 16:37:00.397775 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.397755    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-13a053f7-798c74d988-v7dwn"]
Jul 24 16:37:00.514921 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.514892    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7ccb1c-224d-4b4c-83a4-64e267216ae9" path="/var/lib/kubelet/pods/1f7ccb1c-224d-4b4c-83a4-64e267216ae9/volumes"
Jul 24 16:37:00.515349 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.515208    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68230199-0a00-411d-a844-09464dbd1d12" path="/var/lib/kubelet/pods/68230199-0a00-411d-a844-09464dbd1d12/volumes"
Jul 24 16:37:00.515541 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:00.515529    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccb6c92c-3eb7-4186-aaea-9be7824c88b0" path="/var/lib/kubelet/pods/ccb6c92c-3eb7-4186-aaea-9be7824c88b0/volumes"
Jul 24 16:37:02.345599 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:37:02.345565    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:38:29.843826 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:29.843785    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:38:38.842955 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:38.842923    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:38:44.670375 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670345    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"]
Jul 24 16:38:44.670732 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670616    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f7ccb1c-224d-4b4c-83a4-64e267216ae9" containerName="payload-pre-processing"
Jul 24 16:38:44.670732 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670626    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f7ccb1c-224d-4b4c-83a4-64e267216ae9" containerName="payload-pre-processing"
Jul 24 16:38:44.670732 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670655    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68230199-0a00-411d-a844-09464dbd1d12" containerName="payload-processing"
Jul 24 16:38:44.670732 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670663    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68230199-0a00-411d-a844-09464dbd1d12" containerName="payload-processing"
Jul 24 16:38:44.670732 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670677    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccb6c92c-3eb7-4186-aaea-9be7824c88b0" containerName="maas-api"
Jul 24 16:38:44.670732 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670682    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccb6c92c-3eb7-4186-aaea-9be7824c88b0" containerName="maas-api"
Jul 24 16:38:44.670732 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670720    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7ccb1c-224d-4b4c-83a4-64e267216ae9" containerName="payload-pre-processing"
Jul 24 16:38:44.670732 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670727    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccb6c92c-3eb7-4186-aaea-9be7824c88b0" containerName="maas-api"
Jul 24 16:38:44.670732 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.670734    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="68230199-0a00-411d-a844-09464dbd1d12" containerName="payload-processing"
Jul 24 16:38:44.673488 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.673472    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.676654 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.676622    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:38:44.676913 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.676895    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ebaa9e95-serving-cert\""
Jul 24 16:38:44.677558 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.677545    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w22br\""
Jul 24 16:38:44.677797 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.677782    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:38:44.686612 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.686588    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"]
Jul 24 16:38:44.796838 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.796801    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4add681-5cfd-4132-a984-1b0ce6715b94-openshift-service-ca\") pod \"maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.796838 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.796838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxlpq\" (UniqueName: \"kubernetes.io/projected/c4add681-5cfd-4132-a984-1b0ce6715b94-kube-api-access-rxlpq\") pod \"maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.797064 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.796857    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4add681-5cfd-4132-a984-1b0ce6715b94-maas-api-tls\") pod \"maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.898168 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.898140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxlpq\" (UniqueName: \"kubernetes.io/projected/c4add681-5cfd-4132-a984-1b0ce6715b94-kube-api-access-rxlpq\") pod \"maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.898335 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.898176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4add681-5cfd-4132-a984-1b0ce6715b94-maas-api-tls\") pod \"maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.898335 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.898265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4add681-5cfd-4132-a984-1b0ce6715b94-openshift-service-ca\") pod \"maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.898905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.898888    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4add681-5cfd-4132-a984-1b0ce6715b94-openshift-service-ca\") pod \"maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.900827 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.900808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4add681-5cfd-4132-a984-1b0ce6715b94-maas-api-tls\") pod \"maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.916095 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.916071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxlpq\" (UniqueName: \"kubernetes.io/projected/c4add681-5cfd-4132-a984-1b0ce6715b94-kube-api-access-rxlpq\") pod \"maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:44.983605 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:44.983538    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:45.111818 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.111790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"]
Jul 24 16:38:45.113974 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:38:45.113938    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4add681_5cfd_4132_a984_1b0ce6715b94.slice/crio-ccd2fb46899f303eb71b9d7d4be0ecf9600ab43ca141dd42ca5eebca5bccbae4 WatchSource:0}: Error finding container ccd2fb46899f303eb71b9d7d4be0ecf9600ab43ca141dd42ca5eebca5bccbae4: Status 404 returned error can't find the container with id ccd2fb46899f303eb71b9d7d4be0ecf9600ab43ca141dd42ca5eebca5bccbae4
Jul 24 16:38:45.472959 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.472922    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"]
Jul 24 16:38:45.477001 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.476984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:38:45.479661 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.479632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ebaa9e95-dockercfg-sp6m7\""
Jul 24 16:38:45.480023 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.480003    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ebaa9e95\""
Jul 24 16:38:45.489709 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.489682    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"]
Jul 24 16:38:45.603243 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.603200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49d1f1-e731-45ba-8c5d-4af73ba11384-plugins-config-volume\") pod \"payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn\" (UID: \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\") " pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:38:45.603400 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.603327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptcw6\" (UniqueName: \"kubernetes.io/projected/0e49d1f1-e731-45ba-8c5d-4af73ba11384-kube-api-access-ptcw6\") pod \"payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn\" (UID: \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\") " pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:38:45.704617 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.704586    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49d1f1-e731-45ba-8c5d-4af73ba11384-plugins-config-volume\") pod \"payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn\" (UID: \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\") " pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:38:45.705024 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.704653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptcw6\" (UniqueName: \"kubernetes.io/projected/0e49d1f1-e731-45ba-8c5d-4af73ba11384-kube-api-access-ptcw6\") pod \"payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn\" (UID: \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\") " pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:38:45.705355 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.705331    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49d1f1-e731-45ba-8c5d-4af73ba11384-plugins-config-volume\") pod \"payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn\" (UID: \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\") " pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:38:45.712238 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.712213    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptcw6\" (UniqueName: \"kubernetes.io/projected/0e49d1f1-e731-45ba-8c5d-4af73ba11384-kube-api-access-ptcw6\") pod \"payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn\" (UID: \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\") " pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:38:45.791418 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.791339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:38:45.817729 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.817685    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck" event={"ID":"c4add681-5cfd-4132-a984-1b0ce6715b94","Type":"ContainerStarted","Data":"ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed"}
Jul 24 16:38:45.817889 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.817764    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck" event={"ID":"c4add681-5cfd-4132-a984-1b0ce6715b94","Type":"ContainerStarted","Data":"ccd2fb46899f303eb71b9d7d4be0ecf9600ab43ca141dd42ca5eebca5bccbae4"}
Jul 24 16:38:45.817889 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.817882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:45.866710 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.866633    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck" podStartSLOduration=1.363117439 podStartE2EDuration="1.866615742s" totalImagesPullingTime="503.498303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:38:45.864905273 +0000 UTC m=+1959.849596055" watchObservedRunningTime="2026-07-24 16:38:45.866615742 +0000 UTC m=+1959.851306526"
Jul 24 16:38:45.938299 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:45.938277    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"]
Jul 24 16:38:45.940030 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:38:45.940001    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e49d1f1_e731_45ba_8c5d_4af73ba11384.slice/crio-41c5c41963ea376c1fe99feeee2db0d54ea864ab87ecdeac60ea227f2786f986 WatchSource:0}: Error finding container 41c5c41963ea376c1fe99feeee2db0d54ea864ab87ecdeac60ea227f2786f986: Status 404 returned error can't find the container with id 41c5c41963ea376c1fe99feeee2db0d54ea864ab87ecdeac60ea227f2786f986
Jul 24 16:38:46.824519 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:46.824473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn" event={"ID":"0e49d1f1-e731-45ba-8c5d-4af73ba11384","Type":"ContainerStarted","Data":"dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b"}
Jul 24 16:38:46.825038 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:46.824541    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn" event={"ID":"0e49d1f1-e731-45ba-8c5d-4af73ba11384","Type":"ContainerStarted","Data":"41c5c41963ea376c1fe99feeee2db0d54ea864ab87ecdeac60ea227f2786f986"}
Jul 24 16:38:46.825038 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:46.824666    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:38:46.840665 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:46.840596    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn" podStartSLOduration=1.840581289 podStartE2EDuration="1.840581289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:38:46.83937105 +0000 UTC m=+1960.824061827" watchObservedRunningTime="2026-07-24 16:38:46.840581289 +0000 UTC m=+1960.825272093"
Jul 24 16:38:49.054326 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:49.054289    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:38:51.829851 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:51.829822    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:38:57.833090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:38:57.833011    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:39:06.553521 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.553488    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"]
Jul 24 16:39:06.554156 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.553696    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck" podUID="c4add681-5cfd-4132-a984-1b0ce6715b94" containerName="maas-api" containerID="cri-o://ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed" gracePeriod=30
Jul 24 16:39:06.602161 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.602120    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"]
Jul 24 16:39:06.602377 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.602348    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn" podUID="0e49d1f1-e731-45ba-8c5d-4af73ba11384" containerName="payload-processing" containerID="cri-o://dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b" gracePeriod=30
Jul 24 16:39:06.844377 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.844354    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:39:06.873392 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.873370    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:39:06.921896 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.921863    2561 generic.go:356] "Generic (PLEG): container finished" podID="0e49d1f1-e731-45ba-8c5d-4af73ba11384" containerID="dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b" exitCode=0
Jul 24 16:39:06.922070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.921907    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"
Jul 24 16:39:06.922070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.921947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn" event={"ID":"0e49d1f1-e731-45ba-8c5d-4af73ba11384","Type":"ContainerDied","Data":"dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b"}
Jul 24 16:39:06.922070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.921994    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn" event={"ID":"0e49d1f1-e731-45ba-8c5d-4af73ba11384","Type":"ContainerDied","Data":"41c5c41963ea376c1fe99feeee2db0d54ea864ab87ecdeac60ea227f2786f986"}
Jul 24 16:39:06.922070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.922020    2561 scope.go:117] "RemoveContainer" containerID="dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b"
Jul 24 16:39:06.923243 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.923209    2561 generic.go:356] "Generic (PLEG): container finished" podID="c4add681-5cfd-4132-a984-1b0ce6715b94" containerID="ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed" exitCode=0
Jul 24 16:39:06.923354 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.923262    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"
Jul 24 16:39:06.923354 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.923303    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck" event={"ID":"c4add681-5cfd-4132-a984-1b0ce6715b94","Type":"ContainerDied","Data":"ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed"}
Jul 24 16:39:06.923354 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.923350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck" event={"ID":"c4add681-5cfd-4132-a984-1b0ce6715b94","Type":"ContainerDied","Data":"ccd2fb46899f303eb71b9d7d4be0ecf9600ab43ca141dd42ca5eebca5bccbae4"}
Jul 24 16:39:06.930087 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.930072    2561 scope.go:117] "RemoveContainer" containerID="dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b"
Jul 24 16:39:06.930298 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:39:06.930280    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b\": container with ID starting with dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b not found: ID does not exist" containerID="dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b"
Jul 24 16:39:06.930342 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.930306    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b"} err="failed to get container status \"dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b\": rpc error: code = NotFound desc = could not find container \"dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b\": container with ID starting with dd5e98daa4374d56d6d8c8c315ee9f4c483faacc6e9b45eea94c6e163e71194b not found: ID does not exist"
Jul 24 16:39:06.930342 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.930322    2561 scope.go:117] "RemoveContainer" containerID="ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed"
Jul 24 16:39:06.937511 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.937496    2561 scope.go:117] "RemoveContainer" containerID="ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed"
Jul 24 16:39:06.937774 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:39:06.937756    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed\": container with ID starting with ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed not found: ID does not exist" containerID="ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed"
Jul 24 16:39:06.937850 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.937780    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed"} err="failed to get container status \"ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed\": rpc error: code = NotFound desc = could not find container \"ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed\": container with ID starting with ebd52af693eee77a298698bc4b985d40546ce9a7b4cff9e2b9b1587be1a62bed not found: ID does not exist"
Jul 24 16:39:06.977112 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.977085    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptcw6\" (UniqueName: \"kubernetes.io/projected/0e49d1f1-e731-45ba-8c5d-4af73ba11384-kube-api-access-ptcw6\") pod \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\" (UID: \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\") "
Jul 24 16:39:06.977255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.977149    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4add681-5cfd-4132-a984-1b0ce6715b94-openshift-service-ca\") pod \"c4add681-5cfd-4132-a984-1b0ce6715b94\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") "
Jul 24 16:39:06.977255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.977179    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxlpq\" (UniqueName: \"kubernetes.io/projected/c4add681-5cfd-4132-a984-1b0ce6715b94-kube-api-access-rxlpq\") pod \"c4add681-5cfd-4132-a984-1b0ce6715b94\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") "
Jul 24 16:39:06.977255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.977199    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4add681-5cfd-4132-a984-1b0ce6715b94-maas-api-tls\") pod \"c4add681-5cfd-4132-a984-1b0ce6715b94\" (UID: \"c4add681-5cfd-4132-a984-1b0ce6715b94\") "
Jul 24 16:39:06.977255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.977229    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49d1f1-e731-45ba-8c5d-4af73ba11384-plugins-config-volume\") pod \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\" (UID: \"0e49d1f1-e731-45ba-8c5d-4af73ba11384\") "
Jul 24 16:39:06.977578 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.977552    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4add681-5cfd-4132-a984-1b0ce6715b94-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4add681-5cfd-4132-a984-1b0ce6715b94" (UID: "c4add681-5cfd-4132-a984-1b0ce6715b94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:39:06.977718 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.977583    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e49d1f1-e731-45ba-8c5d-4af73ba11384-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e49d1f1-e731-45ba-8c5d-4af73ba11384" (UID: "0e49d1f1-e731-45ba-8c5d-4af73ba11384"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:39:06.979253 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.979232    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e49d1f1-e731-45ba-8c5d-4af73ba11384-kube-api-access-ptcw6" (OuterVolumeSpecName: "kube-api-access-ptcw6") pod "0e49d1f1-e731-45ba-8c5d-4af73ba11384" (UID: "0e49d1f1-e731-45ba-8c5d-4af73ba11384"). InnerVolumeSpecName "kube-api-access-ptcw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:39:06.979338 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.979249    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4add681-5cfd-4132-a984-1b0ce6715b94-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4add681-5cfd-4132-a984-1b0ce6715b94" (UID: "c4add681-5cfd-4132-a984-1b0ce6715b94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:39:06.979778 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:06.979760    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4add681-5cfd-4132-a984-1b0ce6715b94-kube-api-access-rxlpq" (OuterVolumeSpecName: "kube-api-access-rxlpq") pod "c4add681-5cfd-4132-a984-1b0ce6715b94" (UID: "c4add681-5cfd-4132-a984-1b0ce6715b94"). InnerVolumeSpecName "kube-api-access-rxlpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:39:07.082392 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:07.078609    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptcw6\" (UniqueName: \"kubernetes.io/projected/0e49d1f1-e731-45ba-8c5d-4af73ba11384-kube-api-access-ptcw6\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:39:07.082392 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:07.078692    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4add681-5cfd-4132-a984-1b0ce6715b94-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:39:07.082392 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:07.078710    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxlpq\" (UniqueName: \"kubernetes.io/projected/c4add681-5cfd-4132-a984-1b0ce6715b94-kube-api-access-rxlpq\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:39:07.082392 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:07.078725    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4add681-5cfd-4132-a984-1b0ce6715b94-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:39:07.082392 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:07.078789    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49d1f1-e731-45ba-8c5d-4af73ba11384-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:39:07.245528 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:07.245503    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"]
Jul 24 16:39:07.250710 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:07.250688    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck"]
Jul 24 16:39:07.260749 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:07.260731    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"]
Jul 24 16:39:07.264648 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:07.264617    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebaa9e95-796974fccd-zf7qn"]
Jul 24 16:39:08.507087 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:08.507045    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e49d1f1-e731-45ba-8c5d-4af73ba11384" path="/var/lib/kubelet/pods/0e49d1f1-e731-45ba-8c5d-4af73ba11384/volumes"
Jul 24 16:39:08.507620 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:08.507597    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4add681-5cfd-4132-a984-1b0ce6715b94" path="/var/lib/kubelet/pods/c4add681-5cfd-4132-a984-1b0ce6715b94/volumes"
Jul 24 16:39:09.550292 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:09.550255    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:39:09.826073 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:09.825989    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebaa9e95-7d846948b5-4cgck" podUID="c4add681-5cfd-4132-a984-1b0ce6715b94" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.37:8443/health\": context deadline exceeded"
Jul 24 16:39:41.024847 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.024809    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"]
Jul 24 16:39:41.025291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.025205    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4add681-5cfd-4132-a984-1b0ce6715b94" containerName="maas-api"
Jul 24 16:39:41.025291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.025220    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4add681-5cfd-4132-a984-1b0ce6715b94" containerName="maas-api"
Jul 24 16:39:41.025291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.025244    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e49d1f1-e731-45ba-8c5d-4af73ba11384" containerName="payload-processing"
Jul 24 16:39:41.025291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.025253    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e49d1f1-e731-45ba-8c5d-4af73ba11384" containerName="payload-processing"
Jul 24 16:39:41.025420 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.025330    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4add681-5cfd-4132-a984-1b0ce6715b94" containerName="maas-api"
Jul 24 16:39:41.025420 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.025340    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e49d1f1-e731-45ba-8c5d-4af73ba11384" containerName="payload-processing"
Jul 24 16:39:41.028396 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.028376    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.031176 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.031078    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-14b05861-serving-cert\""
Jul 24 16:39:41.031307 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.031184    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:39:41.031307 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.031255    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:39:41.032347 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.032318    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w22br\""
Jul 24 16:39:41.040589 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.040569    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"]
Jul 24 16:39:41.121602 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.121576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/126a04c6-bfaa-484b-bcef-af8cb129137d-maas-api-tls\") pod \"maas-api-e2e-mt-14b05861-7f64db5587-6jp9x\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.121795 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.121612    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/126a04c6-bfaa-484b-bcef-af8cb129137d-openshift-service-ca\") pod \"maas-api-e2e-mt-14b05861-7f64db5587-6jp9x\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.121795 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.121667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x5th\" (UniqueName: \"kubernetes.io/projected/126a04c6-bfaa-484b-bcef-af8cb129137d-kube-api-access-2x5th\") pod \"maas-api-e2e-mt-14b05861-7f64db5587-6jp9x\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.222133 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.222102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/126a04c6-bfaa-484b-bcef-af8cb129137d-maas-api-tls\") pod \"maas-api-e2e-mt-14b05861-7f64db5587-6jp9x\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.222331 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.222153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/126a04c6-bfaa-484b-bcef-af8cb129137d-openshift-service-ca\") pod \"maas-api-e2e-mt-14b05861-7f64db5587-6jp9x\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.222331 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.222199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x5th\" (UniqueName: \"kubernetes.io/projected/126a04c6-bfaa-484b-bcef-af8cb129137d-kube-api-access-2x5th\") pod \"maas-api-e2e-mt-14b05861-7f64db5587-6jp9x\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.222873 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.222850    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/126a04c6-bfaa-484b-bcef-af8cb129137d-openshift-service-ca\") pod \"maas-api-e2e-mt-14b05861-7f64db5587-6jp9x\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.224621 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.224600    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/126a04c6-bfaa-484b-bcef-af8cb129137d-maas-api-tls\") pod \"maas-api-e2e-mt-14b05861-7f64db5587-6jp9x\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.231663 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.231615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x5th\" (UniqueName: \"kubernetes.io/projected/126a04c6-bfaa-484b-bcef-af8cb129137d-kube-api-access-2x5th\") pod \"maas-api-e2e-mt-14b05861-7f64db5587-6jp9x\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.339219 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.339144    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:41.492363 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.492218    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"]
Jul 24 16:39:41.494524 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:39:41.494497    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod126a04c6_bfaa_484b_bcef_af8cb129137d.slice/crio-fbcfa0086d95f5f89b11264c8dc54c71820f1747637d86274189674dfead1265 WatchSource:0}: Error finding container fbcfa0086d95f5f89b11264c8dc54c71820f1747637d86274189674dfead1265: Status 404 returned error can't find the container with id fbcfa0086d95f5f89b11264c8dc54c71820f1747637d86274189674dfead1265
Jul 24 16:39:41.775413 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.775379    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"]
Jul 24 16:39:41.779789 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.779770    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:39:41.781910 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.781891    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-14b05861\""
Jul 24 16:39:41.794907 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.794881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"]
Jul 24 16:39:41.803943 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.803903    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"]
Jul 24 16:39:41.811041 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.809910    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:41.812630 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.812609    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-14b05861-dockercfg-kgz2s\""
Jul 24 16:39:41.816366 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.816346    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"]
Jul 24 16:39:41.827277 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.827252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8634521e-d6a1-4557-a663-e72706c535af-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8\" (UID: \"8634521e-d6a1-4557-a663-e72706c535af\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:39:41.827408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.827295    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pvnq\" (UniqueName: \"kubernetes.io/projected/8634521e-d6a1-4557-a663-e72706c535af-kube-api-access-7pvnq\") pod \"payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8\" (UID: \"8634521e-d6a1-4557-a663-e72706c535af\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:39:41.928170 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.928129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2add74d2-ef46-4665-b69c-67719840c941-plugins-config-volume\") pod \"payload-processing-e2e-mt-14b05861-77d4b868d6-ms484\" (UID: \"2add74d2-ef46-4665-b69c-67719840c941\") " pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:41.928348 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.928191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwwhg\" (UniqueName: \"kubernetes.io/projected/2add74d2-ef46-4665-b69c-67719840c941-kube-api-access-cwwhg\") pod \"payload-processing-e2e-mt-14b05861-77d4b868d6-ms484\" (UID: \"2add74d2-ef46-4665-b69c-67719840c941\") " pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:41.928348 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.928229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8634521e-d6a1-4557-a663-e72706c535af-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8\" (UID: \"8634521e-d6a1-4557-a663-e72706c535af\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:39:41.928348 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.928252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pvnq\" (UniqueName: \"kubernetes.io/projected/8634521e-d6a1-4557-a663-e72706c535af-kube-api-access-7pvnq\") pod \"payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8\" (UID: \"8634521e-d6a1-4557-a663-e72706c535af\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:39:41.929083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.929064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8634521e-d6a1-4557-a663-e72706c535af-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8\" (UID: \"8634521e-d6a1-4557-a663-e72706c535af\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:39:41.937111 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:41.937088    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pvnq\" (UniqueName: \"kubernetes.io/projected/8634521e-d6a1-4557-a663-e72706c535af-kube-api-access-7pvnq\") pod \"payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8\" (UID: \"8634521e-d6a1-4557-a663-e72706c535af\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:39:42.029113 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.029089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2add74d2-ef46-4665-b69c-67719840c941-plugins-config-volume\") pod \"payload-processing-e2e-mt-14b05861-77d4b868d6-ms484\" (UID: \"2add74d2-ef46-4665-b69c-67719840c941\") " pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:42.029394 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.029133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwwhg\" (UniqueName: \"kubernetes.io/projected/2add74d2-ef46-4665-b69c-67719840c941-kube-api-access-cwwhg\") pod \"payload-processing-e2e-mt-14b05861-77d4b868d6-ms484\" (UID: \"2add74d2-ef46-4665-b69c-67719840c941\") " pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:42.029840 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.029821    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2add74d2-ef46-4665-b69c-67719840c941-plugins-config-volume\") pod \"payload-processing-e2e-mt-14b05861-77d4b868d6-ms484\" (UID: \"2add74d2-ef46-4665-b69c-67719840c941\") " pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:42.037832 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.037799    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwwhg\" (UniqueName: \"kubernetes.io/projected/2add74d2-ef46-4665-b69c-67719840c941-kube-api-access-cwwhg\") pod \"payload-processing-e2e-mt-14b05861-77d4b868d6-ms484\" (UID: \"2add74d2-ef46-4665-b69c-67719840c941\") " pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:42.087874 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.087841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x" event={"ID":"126a04c6-bfaa-484b-bcef-af8cb129137d","Type":"ContainerStarted","Data":"1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327"}
Jul 24 16:39:42.088028 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.087899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x" event={"ID":"126a04c6-bfaa-484b-bcef-af8cb129137d","Type":"ContainerStarted","Data":"fbcfa0086d95f5f89b11264c8dc54c71820f1747637d86274189674dfead1265"}
Jul 24 16:39:42.088028 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.087941    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:42.089150 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.089134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:39:42.106391 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.106342    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x" podStartSLOduration=0.609678209 podStartE2EDuration="1.10632825s" totalImagesPullingTime="496.650041ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:39:42.104850266 +0000 UTC m=+2016.089541067" watchObservedRunningTime="2026-07-24 16:39:42.10632825 +0000 UTC m=+2016.091019031"
Jul 24 16:39:42.122437 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.122409    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:42.232512 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.232479    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"]
Jul 24 16:39:42.233584 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:39:42.233540    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8634521e_d6a1_4557_a663_e72706c535af.slice/crio-6a0c731db8f1dabf303f08f8b0ea32748192823aac17df5736bf81c10c5bea26 WatchSource:0}: Error finding container 6a0c731db8f1dabf303f08f8b0ea32748192823aac17df5736bf81c10c5bea26: Status 404 returned error can't find the container with id 6a0c731db8f1dabf303f08f8b0ea32748192823aac17df5736bf81c10c5bea26
Jul 24 16:39:42.264581 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:42.264559    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"]
Jul 24 16:39:42.267818 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:39:42.267789    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2add74d2_ef46_4665_b69c_67719840c941.slice/crio-62cd58b607255e3969888c8f9ef68f73f3c554581c2ee943a44b4fdbfc1b7f59 WatchSource:0}: Error finding container 62cd58b607255e3969888c8f9ef68f73f3c554581c2ee943a44b4fdbfc1b7f59: Status 404 returned error can't find the container with id 62cd58b607255e3969888c8f9ef68f73f3c554581c2ee943a44b4fdbfc1b7f59
Jul 24 16:39:43.093475 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:43.093437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8" event={"ID":"8634521e-d6a1-4557-a663-e72706c535af","Type":"ContainerStarted","Data":"5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2"}
Jul 24 16:39:43.093940 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:43.093502    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:39:43.093940 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:43.093524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8" event={"ID":"8634521e-d6a1-4557-a663-e72706c535af","Type":"ContainerStarted","Data":"6a0c731db8f1dabf303f08f8b0ea32748192823aac17df5736bf81c10c5bea26"}
Jul 24 16:39:43.094934 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:43.094910    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484" event={"ID":"2add74d2-ef46-4665-b69c-67719840c941","Type":"ContainerStarted","Data":"b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8"}
Jul 24 16:39:43.095086 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:43.095068    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:43.095123 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:43.095107    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484" event={"ID":"2add74d2-ef46-4665-b69c-67719840c941","Type":"ContainerStarted","Data":"62cd58b607255e3969888c8f9ef68f73f3c554581c2ee943a44b4fdbfc1b7f59"}
Jul 24 16:39:43.108268 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:43.108230    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8" podStartSLOduration=2.108215397 podStartE2EDuration="2.108215397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:39:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:39:43.107541306 +0000 UTC m=+2017.092232088" watchObservedRunningTime="2026-07-24 16:39:43.108215397 +0000 UTC m=+2017.092906179"
Jul 24 16:39:43.123339 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:43.123302    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484" podStartSLOduration=2.123289437 podStartE2EDuration="2.123289437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:39:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:39:43.121858984 +0000 UTC m=+2017.106549770" watchObservedRunningTime="2026-07-24 16:39:43.123289437 +0000 UTC m=+2017.107980219"
Jul 24 16:39:47.948420 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:47.948386    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:39:48.100516 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:48.100487    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:39:54.101933 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:54.101903    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:39:54.102376 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:39:54.102077    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:40:03.743625 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:03.743586    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:40:15.047515 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:15.047479    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:40:19.804085 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:19.804051    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"]
Jul 24 16:40:19.807670 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:19.807648    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"
Jul 24 16:40:19.810406 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:19.810391    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wtjsm\""
Jul 24 16:40:19.819447 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:19.819421    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"]
Jul 24 16:40:19.943309 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:19.943273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baca856d-b428-4b62-abf2-3cf7a9389b4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-14b05861-t6j4x\" (UID: \"baca856d-b428-4b62-abf2-3cf7a9389b4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"
Jul 24 16:40:20.044225 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:20.044189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baca856d-b428-4b62-abf2-3cf7a9389b4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-14b05861-t6j4x\" (UID: \"baca856d-b428-4b62-abf2-3cf7a9389b4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"
Jul 24 16:40:20.044837 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:20.044817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baca856d-b428-4b62-abf2-3cf7a9389b4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-14b05861-t6j4x\" (UID: \"baca856d-b428-4b62-abf2-3cf7a9389b4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"
Jul 24 16:40:20.117480 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:20.117453    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"
Jul 24 16:40:20.242161 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:20.242137    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"]
Jul 24 16:40:20.244309 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:40:20.244284    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaca856d_b428_4b62_abf2_3cf7a9389b4b.slice/crio-6f00d5c9e928c9b19144d1127b26fd811f30e7f09665ae85287f262e711fc452 WatchSource:0}: Error finding container 6f00d5c9e928c9b19144d1127b26fd811f30e7f09665ae85287f262e711fc452: Status 404 returned error can't find the container with id 6f00d5c9e928c9b19144d1127b26fd811f30e7f09665ae85287f262e711fc452
Jul 24 16:40:20.269172 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:20.269139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x" event={"ID":"baca856d-b428-4b62-abf2-3cf7a9389b4b","Type":"ContainerStarted","Data":"6f00d5c9e928c9b19144d1127b26fd811f30e7f09665ae85287f262e711fc452"}
Jul 24 16:40:21.275398 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:21.275317    2561 generic.go:356] "Generic (PLEG): container finished" podID="baca856d-b428-4b62-abf2-3cf7a9389b4b" containerID="ccd29d1a674b55bd1d115e305699aa0861f9f49ad2f48428e38d31b047a06d05" exitCode=0
Jul 24 16:40:21.275770 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:21.275407    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x" event={"ID":"baca856d-b428-4b62-abf2-3cf7a9389b4b","Type":"ContainerDied","Data":"ccd29d1a674b55bd1d115e305699aa0861f9f49ad2f48428e38d31b047a06d05"}
Jul 24 16:40:22.405448 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:22.405426    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"
Jul 24 16:40:22.467001 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:22.466967    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baca856d-b428-4b62-abf2-3cf7a9389b4b-maas-api-service-ca\") pod \"baca856d-b428-4b62-abf2-3cf7a9389b4b\" (UID: \"baca856d-b428-4b62-abf2-3cf7a9389b4b\") "
Jul 24 16:40:22.467324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:22.467306    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baca856d-b428-4b62-abf2-3cf7a9389b4b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "baca856d-b428-4b62-abf2-3cf7a9389b4b" (UID: "baca856d-b428-4b62-abf2-3cf7a9389b4b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:40:22.568285 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:22.568216    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baca856d-b428-4b62-abf2-3cf7a9389b4b-maas-api-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:40:23.285538 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:23.285498    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x" event={"ID":"baca856d-b428-4b62-abf2-3cf7a9389b4b","Type":"ContainerDied","Data":"6f00d5c9e928c9b19144d1127b26fd811f30e7f09665ae85287f262e711fc452"}
Jul 24 16:40:23.285538 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:23.285536    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"
Jul 24 16:40:23.285766 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:23.285558    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f00d5c9e928c9b19144d1127b26fd811f30e7f09665ae85287f262e711fc452"
Jul 24 16:40:33.645793 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:33.645712    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:40:35.267140 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.267103    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"]
Jul 24 16:40:35.267506 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.267351    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x" podUID="126a04c6-bfaa-484b-bcef-af8cb129137d" containerName="maas-api" containerID="cri-o://1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327" gracePeriod=30
Jul 24 16:40:35.311559 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.311529    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"]
Jul 24 16:40:35.311809 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.311783    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484" podUID="2add74d2-ef46-4665-b69c-67719840c941" containerName="payload-processing" containerID="cri-o://b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8" gracePeriod=30
Jul 24 16:40:35.319932 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.319908    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"]
Jul 24 16:40:35.320150 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.320123    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8" podUID="8634521e-d6a1-4557-a663-e72706c535af" containerName="payload-pre-processing" containerID="cri-o://5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2" gracePeriod=30
Jul 24 16:40:35.585791 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.585767    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:40:35.595784 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.595763    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:40:35.613562 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.613529    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:40:35.656963 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.656930    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pvnq\" (UniqueName: \"kubernetes.io/projected/8634521e-d6a1-4557-a663-e72706c535af-kube-api-access-7pvnq\") pod \"8634521e-d6a1-4557-a663-e72706c535af\" (UID: \"8634521e-d6a1-4557-a663-e72706c535af\") "
Jul 24 16:40:35.657123 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.656975    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2add74d2-ef46-4665-b69c-67719840c941-plugins-config-volume\") pod \"2add74d2-ef46-4665-b69c-67719840c941\" (UID: \"2add74d2-ef46-4665-b69c-67719840c941\") "
Jul 24 16:40:35.657123 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.657004    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwwhg\" (UniqueName: \"kubernetes.io/projected/2add74d2-ef46-4665-b69c-67719840c941-kube-api-access-cwwhg\") pod \"2add74d2-ef46-4665-b69c-67719840c941\" (UID: \"2add74d2-ef46-4665-b69c-67719840c941\") "
Jul 24 16:40:35.657248 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.657186    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x5th\" (UniqueName: \"kubernetes.io/projected/126a04c6-bfaa-484b-bcef-af8cb129137d-kube-api-access-2x5th\") pod \"126a04c6-bfaa-484b-bcef-af8cb129137d\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") "
Jul 24 16:40:35.657305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.657259    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/126a04c6-bfaa-484b-bcef-af8cb129137d-maas-api-tls\") pod \"126a04c6-bfaa-484b-bcef-af8cb129137d\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") "
Jul 24 16:40:35.657305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.657296    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8634521e-d6a1-4557-a663-e72706c535af-plugins-config-volume\") pod \"8634521e-d6a1-4557-a663-e72706c535af\" (UID: \"8634521e-d6a1-4557-a663-e72706c535af\") "
Jul 24 16:40:35.657409 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.657323    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/126a04c6-bfaa-484b-bcef-af8cb129137d-openshift-service-ca\") pod \"126a04c6-bfaa-484b-bcef-af8cb129137d\" (UID: \"126a04c6-bfaa-484b-bcef-af8cb129137d\") "
Jul 24 16:40:35.657462 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.657415    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2add74d2-ef46-4665-b69c-67719840c941-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2add74d2-ef46-4665-b69c-67719840c941" (UID: "2add74d2-ef46-4665-b69c-67719840c941"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:40:35.657774 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.657740    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2add74d2-ef46-4665-b69c-67719840c941-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:40:35.657894 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.657831    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/126a04c6-bfaa-484b-bcef-af8cb129137d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "126a04c6-bfaa-484b-bcef-af8cb129137d" (UID: "126a04c6-bfaa-484b-bcef-af8cb129137d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:40:35.657973 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.657900    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8634521e-d6a1-4557-a663-e72706c535af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8634521e-d6a1-4557-a663-e72706c535af" (UID: "8634521e-d6a1-4557-a663-e72706c535af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:40:35.659235 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.659214    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8634521e-d6a1-4557-a663-e72706c535af-kube-api-access-7pvnq" (OuterVolumeSpecName: "kube-api-access-7pvnq") pod "8634521e-d6a1-4557-a663-e72706c535af" (UID: "8634521e-d6a1-4557-a663-e72706c535af"). InnerVolumeSpecName "kube-api-access-7pvnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:40:35.659675 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.659630    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/126a04c6-bfaa-484b-bcef-af8cb129137d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "126a04c6-bfaa-484b-bcef-af8cb129137d" (UID: "126a04c6-bfaa-484b-bcef-af8cb129137d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:40:35.659785 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.659767    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/126a04c6-bfaa-484b-bcef-af8cb129137d-kube-api-access-2x5th" (OuterVolumeSpecName: "kube-api-access-2x5th") pod "126a04c6-bfaa-484b-bcef-af8cb129137d" (UID: "126a04c6-bfaa-484b-bcef-af8cb129137d"). InnerVolumeSpecName "kube-api-access-2x5th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:40:35.659823 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.659778    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2add74d2-ef46-4665-b69c-67719840c941-kube-api-access-cwwhg" (OuterVolumeSpecName: "kube-api-access-cwwhg") pod "2add74d2-ef46-4665-b69c-67719840c941" (UID: "2add74d2-ef46-4665-b69c-67719840c941"). InnerVolumeSpecName "kube-api-access-cwwhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:40:35.758116 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.758085    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/126a04c6-bfaa-484b-bcef-af8cb129137d-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:40:35.758116 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.758112    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8634521e-d6a1-4557-a663-e72706c535af-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:40:35.758116 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.758123    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/126a04c6-bfaa-484b-bcef-af8cb129137d-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:40:35.758322 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.758131    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pvnq\" (UniqueName: \"kubernetes.io/projected/8634521e-d6a1-4557-a663-e72706c535af-kube-api-access-7pvnq\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:40:35.758322 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.758140    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwwhg\" (UniqueName: \"kubernetes.io/projected/2add74d2-ef46-4665-b69c-67719840c941-kube-api-access-cwwhg\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:40:35.758322 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:35.758148    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x5th\" (UniqueName: \"kubernetes.io/projected/126a04c6-bfaa-484b-bcef-af8cb129137d-kube-api-access-2x5th\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:40:36.349809 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.349777    2561 generic.go:356] "Generic (PLEG): container finished" podID="8634521e-d6a1-4557-a663-e72706c535af" containerID="5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2" exitCode=0
Jul 24 16:40:36.350160 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.349824    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"
Jul 24 16:40:36.350160 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.349865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8" event={"ID":"8634521e-d6a1-4557-a663-e72706c535af","Type":"ContainerDied","Data":"5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2"}
Jul 24 16:40:36.350160 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.349947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8" event={"ID":"8634521e-d6a1-4557-a663-e72706c535af","Type":"ContainerDied","Data":"6a0c731db8f1dabf303f08f8b0ea32748192823aac17df5736bf81c10c5bea26"}
Jul 24 16:40:36.350160 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.349977    2561 scope.go:117] "RemoveContainer" containerID="5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2"
Jul 24 16:40:36.351268 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.351127    2561 generic.go:356] "Generic (PLEG): container finished" podID="126a04c6-bfaa-484b-bcef-af8cb129137d" containerID="1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327" exitCode=0
Jul 24 16:40:36.351268 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.351159    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x" event={"ID":"126a04c6-bfaa-484b-bcef-af8cb129137d","Type":"ContainerDied","Data":"1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327"}
Jul 24 16:40:36.351268 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.351206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x" event={"ID":"126a04c6-bfaa-484b-bcef-af8cb129137d","Type":"ContainerDied","Data":"fbcfa0086d95f5f89b11264c8dc54c71820f1747637d86274189674dfead1265"}
Jul 24 16:40:36.351268 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.351219    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"
Jul 24 16:40:36.352626 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.352604    2561 generic.go:356] "Generic (PLEG): container finished" podID="2add74d2-ef46-4665-b69c-67719840c941" containerID="b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8" exitCode=0
Jul 24 16:40:36.352762 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.352633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484" event={"ID":"2add74d2-ef46-4665-b69c-67719840c941","Type":"ContainerDied","Data":"b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8"}
Jul 24 16:40:36.352762 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.352692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484" event={"ID":"2add74d2-ef46-4665-b69c-67719840c941","Type":"ContainerDied","Data":"62cd58b607255e3969888c8f9ef68f73f3c554581c2ee943a44b4fdbfc1b7f59"}
Jul 24 16:40:36.352762 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.352701    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"
Jul 24 16:40:36.358733 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.358715    2561 scope.go:117] "RemoveContainer" containerID="5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2"
Jul 24 16:40:36.359003 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:40:36.358983    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2\": container with ID starting with 5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2 not found: ID does not exist" containerID="5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2"
Jul 24 16:40:36.359110 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.359007    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2"} err="failed to get container status \"5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2\": rpc error: code = NotFound desc = could not find container \"5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2\": container with ID starting with 5ea1cc0cbdea53afa9d3465d06551f8ec6df2dfec3f8c4936e2cfbfbe342aad2 not found: ID does not exist"
Jul 24 16:40:36.359110 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.359025    2561 scope.go:117] "RemoveContainer" containerID="1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327"
Jul 24 16:40:36.367816 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.367801    2561 scope.go:117] "RemoveContainer" containerID="1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327"
Jul 24 16:40:36.368059 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:40:36.368041    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327\": container with ID starting with 1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327 not found: ID does not exist" containerID="1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327"
Jul 24 16:40:36.368107 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.368065    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327"} err="failed to get container status \"1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327\": rpc error: code = NotFound desc = could not find container \"1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327\": container with ID starting with 1982218dfb6533109ac5b0c8089d9eef65a46c3c406ea100b4dc97bbbe97e327 not found: ID does not exist"
Jul 24 16:40:36.368107 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.368082    2561 scope.go:117] "RemoveContainer" containerID="b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8"
Jul 24 16:40:36.375767 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.375744    2561 scope.go:117] "RemoveContainer" containerID="b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8"
Jul 24 16:40:36.376024 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:40:36.376006    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8\": container with ID starting with b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8 not found: ID does not exist" containerID="b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8"
Jul 24 16:40:36.376091 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.376031    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8"} err="failed to get container status \"b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8\": rpc error: code = NotFound desc = could not find container \"b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8\": container with ID starting with b2a131845983f8f00834ceafc0c6f67925dd055ccd6c022eed45c27ee7046ae8 not found: ID does not exist"
Jul 24 16:40:36.376165 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.376150    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"]
Jul 24 16:40:36.380010 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.379990    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14b05861-7f64db5587-6jp9x"]
Jul 24 16:40:36.390703 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.390686    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"]
Jul 24 16:40:36.394295 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.394277    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-14b05861-5f9d8cf4d-z6sx8"]
Jul 24 16:40:36.404760 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.404742    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"]
Jul 24 16:40:36.409031 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.409002    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-14b05861-77d4b868d6-ms484"]
Jul 24 16:40:36.508298 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.508266    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="126a04c6-bfaa-484b-bcef-af8cb129137d" path="/var/lib/kubelet/pods/126a04c6-bfaa-484b-bcef-af8cb129137d/volumes"
Jul 24 16:40:36.508600 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.508587    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2add74d2-ef46-4665-b69c-67719840c941" path="/var/lib/kubelet/pods/2add74d2-ef46-4665-b69c-67719840c941/volumes"
Jul 24 16:40:36.508910 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:36.508898    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8634521e-d6a1-4557-a663-e72706c535af" path="/var/lib/kubelet/pods/8634521e-d6a1-4557-a663-e72706c535af/volumes"
Jul 24 16:40:39.882112 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:39.882080    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"]
Jul 24 16:40:39.883679 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:39.883630    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-14b05861-t6j4x"]
Jul 24 16:40:40.506903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:40.506871    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baca856d-b428-4b62-abf2-3cf7a9389b4b" path="/var/lib/kubelet/pods/baca856d-b428-4b62-abf2-3cf7a9389b4b/volumes"
Jul 24 16:40:43.849754 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:40:43.849723    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:41:06.630871 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:41:06.630838    2561 scope.go:117] "RemoveContainer" containerID="72638d83f510a37b52e9654b75d0b902263c6137ce40e15594f407a18bdda9d1"
Jul 24 16:41:48.644536 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:41:48.644499    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:41:58.247784 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:41:58.247706    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:42:06.659076 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:06.659045    2561 scope.go:117] "RemoveContainer" containerID="8a9daece6c495c5f21800abc7b49b5b63baf2da21afc84c063767f481e5e8bbe"
Jul 24 16:42:43.909182 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909147    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"]
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909566    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2add74d2-ef46-4665-b69c-67719840c941" containerName="payload-processing"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909584    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2add74d2-ef46-4665-b69c-67719840c941" containerName="payload-processing"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909609    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baca856d-b428-4b62-abf2-3cf7a9389b4b" containerName="revoke-keys"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909617    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="baca856d-b428-4b62-abf2-3cf7a9389b4b" containerName="revoke-keys"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909626    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126a04c6-bfaa-484b-bcef-af8cb129137d" containerName="maas-api"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909657    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="126a04c6-bfaa-484b-bcef-af8cb129137d" containerName="maas-api"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909667    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8634521e-d6a1-4557-a663-e72706c535af" containerName="payload-pre-processing"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909674    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8634521e-d6a1-4557-a663-e72706c535af" containerName="payload-pre-processing"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909738    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8634521e-d6a1-4557-a663-e72706c535af" containerName="payload-pre-processing"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909747    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="126a04c6-bfaa-484b-bcef-af8cb129137d" containerName="maas-api"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909752    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2add74d2-ef46-4665-b69c-67719840c941" containerName="payload-processing"
Jul 24 16:42:43.911555 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.909759    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="baca856d-b428-4b62-abf2-3cf7a9389b4b" containerName="revoke-keys"
Jul 24 16:42:43.912485 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.912466    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:43.914948 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.914926    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:42:43.915070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.914974    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w22br\""
Jul 24 16:42:43.915070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.915024    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ef1797-serving-cert\""
Jul 24 16:42:43.915830 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.915809    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:42:43.923290 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:43.923264    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"]
Jul 24 16:42:44.031551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.031505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ac13a9-4da6-413c-9cd9-4a450b816378-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.031551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.031541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ac13a9-4da6-413c-9cd9-4a450b816378-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.031815 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.031569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2w7b\" (UniqueName: \"kubernetes.io/projected/d1ac13a9-4da6-413c-9cd9-4a450b816378-kube-api-access-b2w7b\") pod \"maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.132391 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.132358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ac13a9-4da6-413c-9cd9-4a450b816378-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.132391 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.132393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ac13a9-4da6-413c-9cd9-4a450b816378-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.132634 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.132413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2w7b\" (UniqueName: \"kubernetes.io/projected/d1ac13a9-4da6-413c-9cd9-4a450b816378-kube-api-access-b2w7b\") pod \"maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.133099 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.133075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ac13a9-4da6-413c-9cd9-4a450b816378-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.134876 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.134846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ac13a9-4da6-413c-9cd9-4a450b816378-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.140500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.140479    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2w7b\" (UniqueName: \"kubernetes.io/projected/d1ac13a9-4da6-413c-9cd9-4a450b816378-kube-api-access-b2w7b\") pod \"maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.225534 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.225427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:44.359182 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.359158    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"]
Jul 24 16:42:44.361354 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:42:44.361329    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ac13a9_4da6_413c_9cd9_4a450b816378.slice/crio-8b7c4129d2a8b5ff55140430f902d2777965ac1ec73fcfcb56ba5a762f1ecd16 WatchSource:0}: Error finding container 8b7c4129d2a8b5ff55140430f902d2777965ac1ec73fcfcb56ba5a762f1ecd16: Status 404 returned error can't find the container with id 8b7c4129d2a8b5ff55140430f902d2777965ac1ec73fcfcb56ba5a762f1ecd16
Jul 24 16:42:44.363035 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.363016    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:42:44.537838 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.537757    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"]
Jul 24 16:42:44.541951 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.541933    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:44.548216 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.548124    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-ef1797-dockercfg-5gvgp\""
Jul 24 16:42:44.548392 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.548215    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-ef1797\""
Jul 24 16:42:44.554320 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.554179    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"]
Jul 24 16:42:44.636316 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.636281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9chww\" (UniqueName: \"kubernetes.io/projected/2246a517-06cf-4828-aed3-7421f1a7df4e-kube-api-access-9chww\") pod \"payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb\" (UID: \"2246a517-06cf-4828-aed3-7421f1a7df4e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:44.636519 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.636347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2246a517-06cf-4828-aed3-7421f1a7df4e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb\" (UID: \"2246a517-06cf-4828-aed3-7421f1a7df4e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:44.737360 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.737323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9chww\" (UniqueName: \"kubernetes.io/projected/2246a517-06cf-4828-aed3-7421f1a7df4e-kube-api-access-9chww\") pod \"payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb\" (UID: \"2246a517-06cf-4828-aed3-7421f1a7df4e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:44.737527 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.737371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2246a517-06cf-4828-aed3-7421f1a7df4e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb\" (UID: \"2246a517-06cf-4828-aed3-7421f1a7df4e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:44.738114 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.738097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2246a517-06cf-4828-aed3-7421f1a7df4e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb\" (UID: \"2246a517-06cf-4828-aed3-7421f1a7df4e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:44.746024 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.746000    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9chww\" (UniqueName: \"kubernetes.io/projected/2246a517-06cf-4828-aed3-7421f1a7df4e-kube-api-access-9chww\") pod \"payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb\" (UID: \"2246a517-06cf-4828-aed3-7421f1a7df4e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:44.858563 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.858534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:44.933553 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.933523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86" event={"ID":"d1ac13a9-4da6-413c-9cd9-4a450b816378","Type":"ContainerStarted","Data":"8b7c4129d2a8b5ff55140430f902d2777965ac1ec73fcfcb56ba5a762f1ecd16"}
Jul 24 16:42:44.999921 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:44.999900    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"]
Jul 24 16:42:45.000541 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:42:45.000518    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2246a517_06cf_4828_aed3_7421f1a7df4e.slice/crio-ef378cea1f66a3d2b7636e3635388b7ad84ba5964e1b86fca21f229d37dbf4e6 WatchSource:0}: Error finding container ef378cea1f66a3d2b7636e3635388b7ad84ba5964e1b86fca21f229d37dbf4e6: Status 404 returned error can't find the container with id ef378cea1f66a3d2b7636e3635388b7ad84ba5964e1b86fca21f229d37dbf4e6
Jul 24 16:42:45.940268 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:45.940228    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86" event={"ID":"d1ac13a9-4da6-413c-9cd9-4a450b816378","Type":"ContainerStarted","Data":"5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78"}
Jul 24 16:42:45.940778 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:45.940335    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:45.941906 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:45.941878    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb" event={"ID":"2246a517-06cf-4828-aed3-7421f1a7df4e","Type":"ContainerStarted","Data":"e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be"}
Jul 24 16:42:45.942039 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:45.941925    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb" event={"ID":"2246a517-06cf-4828-aed3-7421f1a7df4e","Type":"ContainerStarted","Data":"ef378cea1f66a3d2b7636e3635388b7ad84ba5964e1b86fca21f229d37dbf4e6"}
Jul 24 16:42:45.942039 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:45.941969    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:45.959073 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:45.959032    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86" podStartSLOduration=2.393518335 podStartE2EDuration="2.959018489s" totalImagesPullingTime="565.500154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:42:45.957071242 +0000 UTC m=+2199.941762022" watchObservedRunningTime="2026-07-24 16:42:45.959018489 +0000 UTC m=+2199.943709272"
Jul 24 16:42:45.973023 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:45.972973    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb" podStartSLOduration=1.972960369 podStartE2EDuration="1.972960369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:42:45.970806554 +0000 UTC m=+2199.955497335" watchObservedRunningTime="2026-07-24 16:42:45.972960369 +0000 UTC m=+2199.957651150"
Jul 24 16:42:51.247373 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:51.247329    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:42:51.897333 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:51.897305    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"]
Jul 24 16:42:51.901025 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:51.901001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:51.903454 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:51.903432    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-3881c4-serving-cert\""
Jul 24 16:42:51.912548 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:51.912494    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"]
Jul 24 16:42:51.952139 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:51.952110    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:42:51.997848 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:51.997817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pdwz\" (UniqueName: \"kubernetes.io/projected/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-kube-api-access-8pdwz\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:51.998023 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:51.997858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-maas-api-tls\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:51.998023 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:51.997884    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:52.098394 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.098364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pdwz\" (UniqueName: \"kubernetes.io/projected/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-kube-api-access-8pdwz\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:52.098589 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.098408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-maas-api-tls\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:52.098589 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.098444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:52.098589 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:42:52.098539    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-serving-cert: secret "maas-api-e2e-inf-b-3881c4-serving-cert" not found
Jul 24 16:42:52.098776 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:42:52.098612    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-maas-api-tls podName:0e4f36cc-bf8a-4a5a-9313-d27184c478ab nodeName:}" failed. No retries permitted until 2026-07-24 16:42:52.598589769 +0000 UTC m=+2206.583280543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-maas-api-tls") pod "maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz" (UID: "0e4f36cc-bf8a-4a5a-9313-d27184c478ab") : secret "maas-api-e2e-inf-b-3881c4-serving-cert" not found
Jul 24 16:42:52.099120 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.099100    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:52.112874 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.112846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pdwz\" (UniqueName: \"kubernetes.io/projected/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-kube-api-access-8pdwz\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:52.597585 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.597548    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"]
Jul 24 16:42:52.600874 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.600856    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:42:52.603278 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.603257    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-3881c4\""
Jul 24 16:42:52.603278 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.603269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-maas-api-tls\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:52.603462 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.603259    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-3881c4-dockercfg-cpzgd\""
Jul 24 16:42:52.606112 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.606090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-maas-api-tls\") pod \"maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:52.611377 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.611353    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"]
Jul 24 16:42:52.624306 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.624282    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"]
Jul 24 16:42:52.627473 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.627452    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:42:52.636073 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.636049    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"]
Jul 24 16:42:52.704217 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.704179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flqb8\" (UniqueName: \"kubernetes.io/projected/97565889-8ca9-46c4-972f-31ff53f05bd1-kube-api-access-flqb8\") pod \"payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2\" (UID: \"97565889-8ca9-46c4-972f-31ff53f05bd1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:42:52.704407 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.704245    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2a064fc-0b36-4c52-960b-088bd6da9c6f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj\" (UID: \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:42:52.704407 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.704308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97565889-8ca9-46c4-972f-31ff53f05bd1-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2\" (UID: \"97565889-8ca9-46c4-972f-31ff53f05bd1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:42:52.704407 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.704364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvb8v\" (UniqueName: \"kubernetes.io/projected/d2a064fc-0b36-4c52-960b-088bd6da9c6f-kube-api-access-jvb8v\") pod \"payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj\" (UID: \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:42:52.804884 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.804847    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97565889-8ca9-46c4-972f-31ff53f05bd1-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2\" (UID: \"97565889-8ca9-46c4-972f-31ff53f05bd1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:42:52.805054 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.804906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvb8v\" (UniqueName: \"kubernetes.io/projected/d2a064fc-0b36-4c52-960b-088bd6da9c6f-kube-api-access-jvb8v\") pod \"payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj\" (UID: \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:42:52.805054 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.804947    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flqb8\" (UniqueName: \"kubernetes.io/projected/97565889-8ca9-46c4-972f-31ff53f05bd1-kube-api-access-flqb8\") pod \"payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2\" (UID: \"97565889-8ca9-46c4-972f-31ff53f05bd1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:42:52.805054 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.805010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2a064fc-0b36-4c52-960b-088bd6da9c6f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj\" (UID: \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:42:52.805829 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.805807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97565889-8ca9-46c4-972f-31ff53f05bd1-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2\" (UID: \"97565889-8ca9-46c4-972f-31ff53f05bd1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:42:52.805903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.805807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2a064fc-0b36-4c52-960b-088bd6da9c6f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj\" (UID: \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:42:52.812323 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.812291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvb8v\" (UniqueName: \"kubernetes.io/projected/d2a064fc-0b36-4c52-960b-088bd6da9c6f-kube-api-access-jvb8v\") pod \"payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj\" (UID: \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:42:52.812323 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.812300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flqb8\" (UniqueName: \"kubernetes.io/projected/97565889-8ca9-46c4-972f-31ff53f05bd1-kube-api-access-flqb8\") pod \"payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2\" (UID: \"97565889-8ca9-46c4-972f-31ff53f05bd1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:42:52.813077 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.813057    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:52.921123 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.921093    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:42:52.937342 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.937313    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:42:52.946950 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.946864    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"]
Jul 24 16:42:52.951050 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:42:52.951022    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4f36cc_bf8a_4a5a_9313_d27184c478ab.slice/crio-ea2fd7390f82b9ef54bbd2dd117ea5f339f2b113a2a9ff11f1a37fa15a135417 WatchSource:0}: Error finding container ea2fd7390f82b9ef54bbd2dd117ea5f339f2b113a2a9ff11f1a37fa15a135417: Status 404 returned error can't find the container with id ea2fd7390f82b9ef54bbd2dd117ea5f339f2b113a2a9ff11f1a37fa15a135417
Jul 24 16:42:52.975424 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:52.975358    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz" event={"ID":"0e4f36cc-bf8a-4a5a-9313-d27184c478ab","Type":"ContainerStarted","Data":"ea2fd7390f82b9ef54bbd2dd117ea5f339f2b113a2a9ff11f1a37fa15a135417"}
Jul 24 16:42:53.068054 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.068029    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"]
Jul 24 16:42:53.070205 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:42:53.070169    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a064fc_0b36_4c52_960b_088bd6da9c6f.slice/crio-87fed9eea9256777ead48acd787b71f3993a802bfd555fce95f1edfa643f92a3 WatchSource:0}: Error finding container 87fed9eea9256777ead48acd787b71f3993a802bfd555fce95f1edfa643f92a3: Status 404 returned error can't find the container with id 87fed9eea9256777ead48acd787b71f3993a802bfd555fce95f1edfa643f92a3
Jul 24 16:42:53.092206 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.092182    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"]
Jul 24 16:42:53.099783 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:42:53.099760    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97565889_8ca9_46c4_972f_31ff53f05bd1.slice/crio-fdff630e1fab336f2ea7bb89984cb1a6dba47599d578dbe61b1244f582fd3ff1 WatchSource:0}: Error finding container fdff630e1fab336f2ea7bb89984cb1a6dba47599d578dbe61b1244f582fd3ff1: Status 404 returned error can't find the container with id fdff630e1fab336f2ea7bb89984cb1a6dba47599d578dbe61b1244f582fd3ff1
Jul 24 16:42:53.981116 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.981082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj" event={"ID":"d2a064fc-0b36-4c52-960b-088bd6da9c6f","Type":"ContainerStarted","Data":"fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc"}
Jul 24 16:42:53.981575 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.981164    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj" event={"ID":"d2a064fc-0b36-4c52-960b-088bd6da9c6f","Type":"ContainerStarted","Data":"87fed9eea9256777ead48acd787b71f3993a802bfd555fce95f1edfa643f92a3"}
Jul 24 16:42:53.981575 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.981211    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:42:53.982618 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.982599    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz" event={"ID":"0e4f36cc-bf8a-4a5a-9313-d27184c478ab","Type":"ContainerStarted","Data":"fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878"}
Jul 24 16:42:53.982739 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.982666    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:42:53.984233 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.984211    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2" event={"ID":"97565889-8ca9-46c4-972f-31ff53f05bd1","Type":"ContainerStarted","Data":"510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836"}
Jul 24 16:42:53.984324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.984258    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:42:53.984324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.984283    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2" event={"ID":"97565889-8ca9-46c4-972f-31ff53f05bd1","Type":"ContainerStarted","Data":"fdff630e1fab336f2ea7bb89984cb1a6dba47599d578dbe61b1244f582fd3ff1"}
Jul 24 16:42:53.999675 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:53.999614    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj" podStartSLOduration=1.9996027669999998 podStartE2EDuration="1.999602767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:42:53.997265564 +0000 UTC m=+2207.981956345" watchObservedRunningTime="2026-07-24 16:42:53.999602767 +0000 UTC m=+2207.984293554"
Jul 24 16:42:54.012585 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:54.012549    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz" podStartSLOduration=2.692118672 podStartE2EDuration="3.012537529s" totalImagesPullingTime="320.418857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:42:54.011863885 +0000 UTC m=+2207.996554667" watchObservedRunningTime="2026-07-24 16:42:54.012537529 +0000 UTC m=+2207.997228310"
Jul 24 16:42:54.030404 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:54.030363    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2" podStartSLOduration=2.030350668 podStartE2EDuration="2.030350668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:42:54.027947219 +0000 UTC m=+2208.012638001" watchObservedRunningTime="2026-07-24 16:42:54.030350668 +0000 UTC m=+2208.015041456"
Jul 24 16:42:56.948804 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:56.948773    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:42:59.993508 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:42:59.993481    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:43:04.990507 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:43:04.990466    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj" podUID="d2a064fc-0b36-4c52-960b-088bd6da9c6f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.46:9004: connect: connection refused"
Jul 24 16:43:04.991153 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:43:04.991132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:43:06.143313 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:43:06.143278    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:43:14.989333 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:43:14.989305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:43:20.646704 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:43:20.646663    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:43:38.247003 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:43:38.246920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:43:51.949918 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:43:51.949885    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:44:19.752208 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:19.752176    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:44:27.623306 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:27.623270    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"]
Jul 24 16:44:27.623893 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:27.623550    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86" podUID="d1ac13a9-4da6-413c-9cd9-4a450b816378" containerName="maas-api" containerID="cri-o://5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78" gracePeriod=30
Jul 24 16:44:27.680783 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:27.680750    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"]
Jul 24 16:44:27.680989 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:27.680961    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb" podUID="2246a517-06cf-4828-aed3-7421f1a7df4e" containerName="payload-processing" containerID="cri-o://e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be" gracePeriod=30
Jul 24 16:44:27.965119 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:27.965093    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:44:28.061010 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.060988    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9chww\" (UniqueName: \"kubernetes.io/projected/2246a517-06cf-4828-aed3-7421f1a7df4e-kube-api-access-9chww\") pod \"2246a517-06cf-4828-aed3-7421f1a7df4e\" (UID: \"2246a517-06cf-4828-aed3-7421f1a7df4e\") "
Jul 24 16:44:28.061121 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.061034    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2246a517-06cf-4828-aed3-7421f1a7df4e-plugins-config-volume\") pod \"2246a517-06cf-4828-aed3-7421f1a7df4e\" (UID: \"2246a517-06cf-4828-aed3-7421f1a7df4e\") "
Jul 24 16:44:28.061415 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.061392    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2246a517-06cf-4828-aed3-7421f1a7df4e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2246a517-06cf-4828-aed3-7421f1a7df4e" (UID: "2246a517-06cf-4828-aed3-7421f1a7df4e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:44:28.063206 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.063179    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2246a517-06cf-4828-aed3-7421f1a7df4e-kube-api-access-9chww" (OuterVolumeSpecName: "kube-api-access-9chww") pod "2246a517-06cf-4828-aed3-7421f1a7df4e" (UID: "2246a517-06cf-4828-aed3-7421f1a7df4e"). InnerVolumeSpecName "kube-api-access-9chww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:44:28.077146 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.077127    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:44:28.161472 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.161404    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ac13a9-4da6-413c-9cd9-4a450b816378-maas-api-tls\") pod \"d1ac13a9-4da6-413c-9cd9-4a450b816378\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") "
Jul 24 16:44:28.161592 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.161496    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2w7b\" (UniqueName: \"kubernetes.io/projected/d1ac13a9-4da6-413c-9cd9-4a450b816378-kube-api-access-b2w7b\") pod \"d1ac13a9-4da6-413c-9cd9-4a450b816378\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") "
Jul 24 16:44:28.161592 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.161526    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ac13a9-4da6-413c-9cd9-4a450b816378-openshift-service-ca\") pod \"d1ac13a9-4da6-413c-9cd9-4a450b816378\" (UID: \"d1ac13a9-4da6-413c-9cd9-4a450b816378\") "
Jul 24 16:44:28.161711 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.161619    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9chww\" (UniqueName: \"kubernetes.io/projected/2246a517-06cf-4828-aed3-7421f1a7df4e-kube-api-access-9chww\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:28.161711 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.161630    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2246a517-06cf-4828-aed3-7421f1a7df4e-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:28.161934 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.161912    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ac13a9-4da6-413c-9cd9-4a450b816378-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1ac13a9-4da6-413c-9cd9-4a450b816378" (UID: "d1ac13a9-4da6-413c-9cd9-4a450b816378"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:44:28.163624 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.163605    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ac13a9-4da6-413c-9cd9-4a450b816378-kube-api-access-b2w7b" (OuterVolumeSpecName: "kube-api-access-b2w7b") pod "d1ac13a9-4da6-413c-9cd9-4a450b816378" (UID: "d1ac13a9-4da6-413c-9cd9-4a450b816378"). InnerVolumeSpecName "kube-api-access-b2w7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:44:28.163698 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.163664    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1ac13a9-4da6-413c-9cd9-4a450b816378-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1ac13a9-4da6-413c-9cd9-4a450b816378" (UID: "d1ac13a9-4da6-413c-9cd9-4a450b816378"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:44:28.262286 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.262258    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2w7b\" (UniqueName: \"kubernetes.io/projected/d1ac13a9-4da6-413c-9cd9-4a450b816378-kube-api-access-b2w7b\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:28.262286 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.262282    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ac13a9-4da6-413c-9cd9-4a450b816378-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:28.262286 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.262291    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ac13a9-4da6-413c-9cd9-4a450b816378-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:28.418920 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.418835    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1ac13a9-4da6-413c-9cd9-4a450b816378" containerID="5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78" exitCode=0
Jul 24 16:44:28.418920 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.418880    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"
Jul 24 16:44:28.419136 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.418915    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86" event={"ID":"d1ac13a9-4da6-413c-9cd9-4a450b816378","Type":"ContainerDied","Data":"5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78"}
Jul 24 16:44:28.419136 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.418966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86" event={"ID":"d1ac13a9-4da6-413c-9cd9-4a450b816378","Type":"ContainerDied","Data":"8b7c4129d2a8b5ff55140430f902d2777965ac1ec73fcfcb56ba5a762f1ecd16"}
Jul 24 16:44:28.419136 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.418987    2561 scope.go:117] "RemoveContainer" containerID="5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78"
Jul 24 16:44:28.420284 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.420261    2561 generic.go:356] "Generic (PLEG): container finished" podID="2246a517-06cf-4828-aed3-7421f1a7df4e" containerID="e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be" exitCode=0
Jul 24 16:44:28.420411 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.420312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb" event={"ID":"2246a517-06cf-4828-aed3-7421f1a7df4e","Type":"ContainerDied","Data":"e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be"}
Jul 24 16:44:28.420411 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.420353    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb" event={"ID":"2246a517-06cf-4828-aed3-7421f1a7df4e","Type":"ContainerDied","Data":"ef378cea1f66a3d2b7636e3635388b7ad84ba5964e1b86fca21f229d37dbf4e6"}
Jul 24 16:44:28.420411 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.420317    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"
Jul 24 16:44:28.427691 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.427674    2561 scope.go:117] "RemoveContainer" containerID="5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78"
Jul 24 16:44:28.427978 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:44:28.427950    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78\": container with ID starting with 5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78 not found: ID does not exist" containerID="5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78"
Jul 24 16:44:28.428100 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.427988    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78"} err="failed to get container status \"5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78\": rpc error: code = NotFound desc = could not find container \"5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78\": container with ID starting with 5fd0e5eeda99da40d7a63320ae2bf7505df6531f1d94a8d73bd10a8b88a72a78 not found: ID does not exist"
Jul 24 16:44:28.428100 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.428011    2561 scope.go:117] "RemoveContainer" containerID="e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be"
Jul 24 16:44:28.436077 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.436061    2561 scope.go:117] "RemoveContainer" containerID="e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be"
Jul 24 16:44:28.436309 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:44:28.436292    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be\": container with ID starting with e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be not found: ID does not exist" containerID="e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be"
Jul 24 16:44:28.436347 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.436316    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be"} err="failed to get container status \"e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be\": rpc error: code = NotFound desc = could not find container \"e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be\": container with ID starting with e6f7cb92d5ee009151d5c2c30a320a3a091e4278b06ab820d7ea28ca053792be not found: ID does not exist"
Jul 24 16:44:28.443439 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.443419    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"]
Jul 24 16:44:28.449485 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.449459    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ef1797-7db9ddf455-7bg86"]
Jul 24 16:44:28.462209 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.462187    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"]
Jul 24 16:44:28.467466 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.467447    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ef1797-7fccb89b8-v24qb"]
Jul 24 16:44:28.507513 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.507486    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2246a517-06cf-4828-aed3-7421f1a7df4e" path="/var/lib/kubelet/pods/2246a517-06cf-4828-aed3-7421f1a7df4e/volumes"
Jul 24 16:44:28.507891 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:28.507877    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1ac13a9-4da6-413c-9cd9-4a450b816378" path="/var/lib/kubelet/pods/d1ac13a9-4da6-413c-9cd9-4a450b816378/volumes"
Jul 24 16:44:33.042828 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:33.042789    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:44:38.916682 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.916648    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"]
Jul 24 16:44:38.917060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.916928    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ac13a9-4da6-413c-9cd9-4a450b816378" containerName="maas-api"
Jul 24 16:44:38.917060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.916939    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ac13a9-4da6-413c-9cd9-4a450b816378" containerName="maas-api"
Jul 24 16:44:38.917060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.916951    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2246a517-06cf-4828-aed3-7421f1a7df4e" containerName="payload-processing"
Jul 24 16:44:38.917060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.916956    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2246a517-06cf-4828-aed3-7421f1a7df4e" containerName="payload-processing"
Jul 24 16:44:38.917060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.917008    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2246a517-06cf-4828-aed3-7421f1a7df4e" containerName="payload-processing"
Jul 24 16:44:38.917060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.917016    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ac13a9-4da6-413c-9cd9-4a450b816378" containerName="maas-api"
Jul 24 16:44:38.921589 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.921571    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"
Jul 24 16:44:38.924192 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.924172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wtjsm\""
Jul 24 16:44:38.927601 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.927575    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"]
Jul 24 16:44:38.936807 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:38.936765    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67c9a1e-18cb-4134-a12e-9376647f9f78-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh\" (UID: \"a67c9a1e-18cb-4134-a12e-9376647f9f78\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"
Jul 24 16:44:39.037805 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:39.037769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67c9a1e-18cb-4134-a12e-9376647f9f78-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh\" (UID: \"a67c9a1e-18cb-4134-a12e-9376647f9f78\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"
Jul 24 16:44:39.038349 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:39.038324    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67c9a1e-18cb-4134-a12e-9376647f9f78-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh\" (UID: \"a67c9a1e-18cb-4134-a12e-9376647f9f78\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"
Jul 24 16:44:39.233171 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:39.233075    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"
Jul 24 16:44:39.364417 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:39.364395    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"]
Jul 24 16:44:39.366413 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:44:39.366390    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67c9a1e_18cb_4134_a12e_9376647f9f78.slice/crio-9bee2c269da94c10673c589b6a13915820029d4daac9140d1aac7389e705ac47 WatchSource:0}: Error finding container 9bee2c269da94c10673c589b6a13915820029d4daac9140d1aac7389e705ac47: Status 404 returned error can't find the container with id 9bee2c269da94c10673c589b6a13915820029d4daac9140d1aac7389e705ac47
Jul 24 16:44:39.475069 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:39.475034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh" event={"ID":"a67c9a1e-18cb-4134-a12e-9376647f9f78","Type":"ContainerStarted","Data":"9bee2c269da94c10673c589b6a13915820029d4daac9140d1aac7389e705ac47"}
Jul 24 16:44:40.480926 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:40.480893    2561 generic.go:356] "Generic (PLEG): container finished" podID="a67c9a1e-18cb-4134-a12e-9376647f9f78" containerID="c7c72486a85f8c3a919c7e919d52c3bf48d657c63282105a716fc1ca7c064a5f" exitCode=0
Jul 24 16:44:40.481316 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:40.480948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh" event={"ID":"a67c9a1e-18cb-4134-a12e-9376647f9f78","Type":"ContainerDied","Data":"c7c72486a85f8c3a919c7e919d52c3bf48d657c63282105a716fc1ca7c064a5f"}
Jul 24 16:44:41.614470 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:41.614442    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"
Jul 24 16:44:41.659745 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:41.659714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67c9a1e-18cb-4134-a12e-9376647f9f78-maas-api-service-ca\") pod \"a67c9a1e-18cb-4134-a12e-9376647f9f78\" (UID: \"a67c9a1e-18cb-4134-a12e-9376647f9f78\") "
Jul 24 16:44:41.660080 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:41.660054    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a67c9a1e-18cb-4134-a12e-9376647f9f78-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a67c9a1e-18cb-4134-a12e-9376647f9f78" (UID: "a67c9a1e-18cb-4134-a12e-9376647f9f78"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:44:41.761203 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:41.761127    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67c9a1e-18cb-4134-a12e-9376647f9f78-maas-api-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:42.490975 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:42.490941    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh" event={"ID":"a67c9a1e-18cb-4134-a12e-9376647f9f78","Type":"ContainerDied","Data":"9bee2c269da94c10673c589b6a13915820029d4daac9140d1aac7389e705ac47"}
Jul 24 16:44:42.490975 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:42.490972    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"
Jul 24 16:44:42.491188 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:42.490989    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bee2c269da94c10673c589b6a13915820029d4daac9140d1aac7389e705ac47"
Jul 24 16:44:49.442595 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.442561    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"]
Jul 24 16:44:49.443066 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.442869    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz" podUID="0e4f36cc-bf8a-4a5a-9313-d27184c478ab" containerName="maas-api" containerID="cri-o://fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878" gracePeriod=30
Jul 24 16:44:49.501386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.501349    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"]
Jul 24 16:44:49.501661 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.501598    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2" podUID="97565889-8ca9-46c4-972f-31ff53f05bd1" containerName="payload-processing" containerID="cri-o://510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836" gracePeriod=30
Jul 24 16:44:49.508521 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.508495    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"]
Jul 24 16:44:49.508751 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.508727    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj" podUID="d2a064fc-0b36-4c52-960b-088bd6da9c6f" containerName="payload-pre-processing" containerID="cri-o://fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc" gracePeriod=30
Jul 24 16:44:49.773274 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.773249    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:44:49.786599 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.786579    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:44:49.792804 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.792762    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:44:49.823467 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.823442    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-openshift-service-ca\") pod \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") "
Jul 24 16:44:49.823621 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.823483    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvb8v\" (UniqueName: \"kubernetes.io/projected/d2a064fc-0b36-4c52-960b-088bd6da9c6f-kube-api-access-jvb8v\") pod \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\" (UID: \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\") "
Jul 24 16:44:49.823621 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.823528    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pdwz\" (UniqueName: \"kubernetes.io/projected/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-kube-api-access-8pdwz\") pod \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") "
Jul 24 16:44:49.823621 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.823559    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flqb8\" (UniqueName: \"kubernetes.io/projected/97565889-8ca9-46c4-972f-31ff53f05bd1-kube-api-access-flqb8\") pod \"97565889-8ca9-46c4-972f-31ff53f05bd1\" (UID: \"97565889-8ca9-46c4-972f-31ff53f05bd1\") "
Jul 24 16:44:49.823989 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.823621    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-maas-api-tls\") pod \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\" (UID: \"0e4f36cc-bf8a-4a5a-9313-d27184c478ab\") "
Jul 24 16:44:49.823989 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.823692    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2a064fc-0b36-4c52-960b-088bd6da9c6f-plugins-config-volume\") pod \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\" (UID: \"d2a064fc-0b36-4c52-960b-088bd6da9c6f\") "
Jul 24 16:44:49.823989 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.823716    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97565889-8ca9-46c4-972f-31ff53f05bd1-plugins-config-volume\") pod \"97565889-8ca9-46c4-972f-31ff53f05bd1\" (UID: \"97565889-8ca9-46c4-972f-31ff53f05bd1\") "
Jul 24 16:44:49.823989 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.823875    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e4f36cc-bf8a-4a5a-9313-d27184c478ab" (UID: "0e4f36cc-bf8a-4a5a-9313-d27184c478ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:44:49.823989 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.823973    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:49.824316 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.824230    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97565889-8ca9-46c4-972f-31ff53f05bd1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97565889-8ca9-46c4-972f-31ff53f05bd1" (UID: "97565889-8ca9-46c4-972f-31ff53f05bd1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:44:49.824395 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.824364    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a064fc-0b36-4c52-960b-088bd6da9c6f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2a064fc-0b36-4c52-960b-088bd6da9c6f" (UID: "d2a064fc-0b36-4c52-960b-088bd6da9c6f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:44:49.826602 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.826578    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-kube-api-access-8pdwz" (OuterVolumeSpecName: "kube-api-access-8pdwz") pod "0e4f36cc-bf8a-4a5a-9313-d27184c478ab" (UID: "0e4f36cc-bf8a-4a5a-9313-d27184c478ab"). InnerVolumeSpecName "kube-api-access-8pdwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:44:49.826896 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.826867    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e4f36cc-bf8a-4a5a-9313-d27184c478ab" (UID: "0e4f36cc-bf8a-4a5a-9313-d27184c478ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:44:49.827007 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.826918    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a064fc-0b36-4c52-960b-088bd6da9c6f-kube-api-access-jvb8v" (OuterVolumeSpecName: "kube-api-access-jvb8v") pod "d2a064fc-0b36-4c52-960b-088bd6da9c6f" (UID: "d2a064fc-0b36-4c52-960b-088bd6da9c6f"). InnerVolumeSpecName "kube-api-access-jvb8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:44:49.827007 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.826940    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97565889-8ca9-46c4-972f-31ff53f05bd1-kube-api-access-flqb8" (OuterVolumeSpecName: "kube-api-access-flqb8") pod "97565889-8ca9-46c4-972f-31ff53f05bd1" (UID: "97565889-8ca9-46c4-972f-31ff53f05bd1"). InnerVolumeSpecName "kube-api-access-flqb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:44:49.924491 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.924460    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvb8v\" (UniqueName: \"kubernetes.io/projected/d2a064fc-0b36-4c52-960b-088bd6da9c6f-kube-api-access-jvb8v\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:49.924491 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.924486    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pdwz\" (UniqueName: \"kubernetes.io/projected/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-kube-api-access-8pdwz\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:49.924491 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.924495    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flqb8\" (UniqueName: \"kubernetes.io/projected/97565889-8ca9-46c4-972f-31ff53f05bd1-kube-api-access-flqb8\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:49.924734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.924504    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4f36cc-bf8a-4a5a-9313-d27184c478ab-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:49.924734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.924513    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2a064fc-0b36-4c52-960b-088bd6da9c6f-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:49.924734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:49.924521    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97565889-8ca9-46c4-972f-31ff53f05bd1-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:44:50.534070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.534039    2561 generic.go:356] "Generic (PLEG): container finished" podID="d2a064fc-0b36-4c52-960b-088bd6da9c6f" containerID="fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc" exitCode=0
Jul 24 16:44:50.534456 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.534088    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"
Jul 24 16:44:50.534456 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.534116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj" event={"ID":"d2a064fc-0b36-4c52-960b-088bd6da9c6f","Type":"ContainerDied","Data":"fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc"}
Jul 24 16:44:50.534456 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.534160    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj" event={"ID":"d2a064fc-0b36-4c52-960b-088bd6da9c6f","Type":"ContainerDied","Data":"87fed9eea9256777ead48acd787b71f3993a802bfd555fce95f1edfa643f92a3"}
Jul 24 16:44:50.534456 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.534191    2561 scope.go:117] "RemoveContainer" containerID="fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc"
Jul 24 16:44:50.535540 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.535376    2561 generic.go:356] "Generic (PLEG): container finished" podID="0e4f36cc-bf8a-4a5a-9313-d27184c478ab" containerID="fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878" exitCode=0
Jul 24 16:44:50.535540 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.535442    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"
Jul 24 16:44:50.535540 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.535456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz" event={"ID":"0e4f36cc-bf8a-4a5a-9313-d27184c478ab","Type":"ContainerDied","Data":"fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878"}
Jul 24 16:44:50.535540 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.535510    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz" event={"ID":"0e4f36cc-bf8a-4a5a-9313-d27184c478ab","Type":"ContainerDied","Data":"ea2fd7390f82b9ef54bbd2dd117ea5f339f2b113a2a9ff11f1a37fa15a135417"}
Jul 24 16:44:50.536981 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.536961    2561 generic.go:356] "Generic (PLEG): container finished" podID="97565889-8ca9-46c4-972f-31ff53f05bd1" containerID="510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836" exitCode=0
Jul 24 16:44:50.537088 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.537009    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"
Jul 24 16:44:50.537154 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.537010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2" event={"ID":"97565889-8ca9-46c4-972f-31ff53f05bd1","Type":"ContainerDied","Data":"510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836"}
Jul 24 16:44:50.537154 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.537119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2" event={"ID":"97565889-8ca9-46c4-972f-31ff53f05bd1","Type":"ContainerDied","Data":"fdff630e1fab336f2ea7bb89984cb1a6dba47599d578dbe61b1244f582fd3ff1"}
Jul 24 16:44:50.543370 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.543354    2561 scope.go:117] "RemoveContainer" containerID="fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc"
Jul 24 16:44:50.543608 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:44:50.543590    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc\": container with ID starting with fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc not found: ID does not exist" containerID="fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc"
Jul 24 16:44:50.543707 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.543619    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc"} err="failed to get container status \"fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc\": rpc error: code = NotFound desc = could not find container \"fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc\": container with ID starting with fb1b739b8ee68d5d9fbbb2069626485e24ce495f57b8b38b6d45cff0e5e3eddc not found: ID does not exist"
Jul 24 16:44:50.543707 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.543657    2561 scope.go:117] "RemoveContainer" containerID="fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878"
Jul 24 16:44:50.550906 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.550891    2561 scope.go:117] "RemoveContainer" containerID="fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878"
Jul 24 16:44:50.551139 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:44:50.551120    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878\": container with ID starting with fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878 not found: ID does not exist" containerID="fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878"
Jul 24 16:44:50.551204 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.551148    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878"} err="failed to get container status \"fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878\": rpc error: code = NotFound desc = could not find container \"fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878\": container with ID starting with fe896bbd1685fef655f2bc4bc665fc45889b80ee3410d7d076cc4dedc1e35878 not found: ID does not exist"
Jul 24 16:44:50.551204 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.551169    2561 scope.go:117] "RemoveContainer" containerID="510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836"
Jul 24 16:44:50.558079 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.558058    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"]
Jul 24 16:44:50.559737 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.559723    2561 scope.go:117] "RemoveContainer" containerID="510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836"
Jul 24 16:44:50.559978 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:44:50.559961    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836\": container with ID starting with 510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836 not found: ID does not exist" containerID="510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836"
Jul 24 16:44:50.560040 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.559987    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836"} err="failed to get container status \"510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836\": rpc error: code = NotFound desc = could not find container \"510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836\": container with ID starting with 510ae9e94d3e89762e567a682a1151fd75a3252ecbc3a1ffbbca09e280831836 not found: ID does not exist"
Jul 24 16:44:50.562420 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.562402    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3881c4-68689cb6c6-7sfbz"]
Jul 24 16:44:50.571718 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.571699    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"]
Jul 24 16:44:50.575634 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.575616    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3881c4-fdb776fd-6whx2"]
Jul 24 16:44:50.585451 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.585423    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"]
Jul 24 16:44:50.590866 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:50.590846    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3881c4-85b8f7994d-dckwj"]
Jul 24 16:44:52.345007 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:52.344966    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:44:52.507935 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:52.507899    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e4f36cc-bf8a-4a5a-9313-d27184c478ab" path="/var/lib/kubelet/pods/0e4f36cc-bf8a-4a5a-9313-d27184c478ab/volumes"
Jul 24 16:44:52.508243 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:52.508230    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97565889-8ca9-46c4-972f-31ff53f05bd1" path="/var/lib/kubelet/pods/97565889-8ca9-46c4-972f-31ff53f05bd1/volumes"
Jul 24 16:44:52.508538 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:52.508527    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a064fc-0b36-4c52-960b-088bd6da9c6f" path="/var/lib/kubelet/pods/d2a064fc-0b36-4c52-960b-088bd6da9c6f/volumes"
Jul 24 16:44:54.002500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:54.002424    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"]
Jul 24 16:44:54.004979 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:54.004953    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3881c4-m9bbh"]
Jul 24 16:44:54.507029 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:44:54.506995    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a67c9a1e-18cb-4134-a12e-9376647f9f78" path="/var/lib/kubelet/pods/a67c9a1e-18cb-4134-a12e-9376647f9f78/volumes"
Jul 24 16:45:00.141487 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141401    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8"]
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141676    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a064fc-0b36-4c52-960b-088bd6da9c6f" containerName="payload-pre-processing"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141688    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a064fc-0b36-4c52-960b-088bd6da9c6f" containerName="payload-pre-processing"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141698    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a67c9a1e-18cb-4134-a12e-9376647f9f78" containerName="revoke-keys"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141703    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a67c9a1e-18cb-4134-a12e-9376647f9f78" containerName="revoke-keys"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141723    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97565889-8ca9-46c4-972f-31ff53f05bd1" containerName="payload-processing"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141729    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="97565889-8ca9-46c4-972f-31ff53f05bd1" containerName="payload-processing"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141735    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4f36cc-bf8a-4a5a-9313-d27184c478ab" containerName="maas-api"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141740    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4f36cc-bf8a-4a5a-9313-d27184c478ab" containerName="maas-api"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141783    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a064fc-0b36-4c52-960b-088bd6da9c6f" containerName="payload-pre-processing"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141790    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="97565889-8ca9-46c4-972f-31ff53f05bd1" containerName="payload-processing"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141796    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4f36cc-bf8a-4a5a-9313-d27184c478ab" containerName="maas-api"
Jul 24 16:45:00.141905 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.141802    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a67c9a1e-18cb-4134-a12e-9376647f9f78" containerName="revoke-keys"
Jul 24 16:45:00.144734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.144718    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8"
Jul 24 16:45:00.147000 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.146978    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wtjsm\""
Jul 24 16:45:00.150952 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.150929    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8"]
Jul 24 16:45:00.155617 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.155597    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8"
Jul 24 16:45:00.286815 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.286790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8"]
Jul 24 16:45:00.288759 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:45:00.288733    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43bf8665_7d44_41ff_b502_5c8a297efbf6.slice/crio-0039a39e57abb601cc7e919188bb82dead14b1bd73d764abd9ce792997404e2c WatchSource:0}: Error finding container 0039a39e57abb601cc7e919188bb82dead14b1bd73d764abd9ce792997404e2c: Status 404 returned error can't find the container with id 0039a39e57abb601cc7e919188bb82dead14b1bd73d764abd9ce792997404e2c
Jul 24 16:45:00.586494 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.586454    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8" event={"ID":"43bf8665-7d44-41ff-b502-5c8a297efbf6","Type":"ContainerStarted","Data":"dcdda1b4b553dccf2b637757a18304526fb2fbdac017c05fad0c8b273d18f655"}
Jul 24 16:45:00.586692 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.586514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8" event={"ID":"43bf8665-7d44-41ff-b502-5c8a297efbf6","Type":"ContainerStarted","Data":"0039a39e57abb601cc7e919188bb82dead14b1bd73d764abd9ce792997404e2c"}
Jul 24 16:45:00.600956 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:00.600913    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8" podStartSLOduration=0.600898743 podStartE2EDuration="600.898743ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:00.600151231 +0000 UTC m=+2334.584842014" watchObservedRunningTime="2026-07-24 16:45:00.600898743 +0000 UTC m=+2334.585589523"
Jul 24 16:45:01.591858 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:01.591824    2561 generic.go:356] "Generic (PLEG): container finished" podID="43bf8665-7d44-41ff-b502-5c8a297efbf6" containerID="dcdda1b4b553dccf2b637757a18304526fb2fbdac017c05fad0c8b273d18f655" exitCode=0
Jul 24 16:45:01.592243 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:01.591899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8" event={"ID":"43bf8665-7d44-41ff-b502-5c8a297efbf6","Type":"ContainerDied","Data":"dcdda1b4b553dccf2b637757a18304526fb2fbdac017c05fad0c8b273d18f655"}
Jul 24 16:45:02.725514 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:02.725486    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8"
Jul 24 16:45:03.608086 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:03.608060    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8"
Jul 24 16:45:03.608283 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:03.608102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748525-mhcc8" event={"ID":"43bf8665-7d44-41ff-b502-5c8a297efbf6","Type":"ContainerDied","Data":"0039a39e57abb601cc7e919188bb82dead14b1bd73d764abd9ce792997404e2c"}
Jul 24 16:45:03.608283 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:03.608165    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0039a39e57abb601cc7e919188bb82dead14b1bd73d764abd9ce792997404e2c"
Jul 24 16:45:04.636534 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.636502    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"]
Jul 24 16:45:04.637100 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.636806    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43bf8665-7d44-41ff-b502-5c8a297efbf6" containerName="cleanup"
Jul 24 16:45:04.637100 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.636822    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="43bf8665-7d44-41ff-b502-5c8a297efbf6" containerName="cleanup"
Jul 24 16:45:04.637100 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.636908    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="43bf8665-7d44-41ff-b502-5c8a297efbf6" containerName="cleanup"
Jul 24 16:45:04.639455 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.639437    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.643002 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.642978    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-aac1d1-serving-cert\""
Jul 24 16:45:04.643002 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.642997    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:45:04.643201 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.643004    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:45:04.643201 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.642984    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w22br\""
Jul 24 16:45:04.655171 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.655147    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"]
Jul 24 16:45:04.748828 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.748795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l799h\" (UniqueName: \"kubernetes.io/projected/c1448250-a6f1-4010-9b88-3d51cac90d8e-kube-api-access-l799h\") pod \"maas-api-e2e-api-a-aac1d1-844f864468-zq8jk\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.749025 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.748848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1448250-a6f1-4010-9b88-3d51cac90d8e-openshift-service-ca\") pod \"maas-api-e2e-api-a-aac1d1-844f864468-zq8jk\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.749025 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.748936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1448250-a6f1-4010-9b88-3d51cac90d8e-maas-api-tls\") pod \"maas-api-e2e-api-a-aac1d1-844f864468-zq8jk\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.849527 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.849493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1448250-a6f1-4010-9b88-3d51cac90d8e-openshift-service-ca\") pod \"maas-api-e2e-api-a-aac1d1-844f864468-zq8jk\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.849710 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.849546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1448250-a6f1-4010-9b88-3d51cac90d8e-maas-api-tls\") pod \"maas-api-e2e-api-a-aac1d1-844f864468-zq8jk\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.849710 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.849610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l799h\" (UniqueName: \"kubernetes.io/projected/c1448250-a6f1-4010-9b88-3d51cac90d8e-kube-api-access-l799h\") pod \"maas-api-e2e-api-a-aac1d1-844f864468-zq8jk\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.850244 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.850219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1448250-a6f1-4010-9b88-3d51cac90d8e-openshift-service-ca\") pod \"maas-api-e2e-api-a-aac1d1-844f864468-zq8jk\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.852124 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.852106    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1448250-a6f1-4010-9b88-3d51cac90d8e-maas-api-tls\") pod \"maas-api-e2e-api-a-aac1d1-844f864468-zq8jk\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.859588 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.859566    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l799h\" (UniqueName: \"kubernetes.io/projected/c1448250-a6f1-4010-9b88-3d51cac90d8e-kube-api-access-l799h\") pod \"maas-api-e2e-api-a-aac1d1-844f864468-zq8jk\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:04.950263 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:04.950176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:05.082670 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.082624    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"]
Jul 24 16:45:05.084490 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:45:05.084465    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1448250_a6f1_4010_9b88_3d51cac90d8e.slice/crio-3d48202769bdfb50caa14668ee5285ae6f286abdf5bd74920965253e6d2db491 WatchSource:0}: Error finding container 3d48202769bdfb50caa14668ee5285ae6f286abdf5bd74920965253e6d2db491: Status 404 returned error can't find the container with id 3d48202769bdfb50caa14668ee5285ae6f286abdf5bd74920965253e6d2db491
Jul 24 16:45:05.453607 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.453575    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"]
Jul 24 16:45:05.456994 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.456974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:05.459339 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.459321    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-aac1d1\""
Jul 24 16:45:05.466974 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.466952    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"]
Jul 24 16:45:05.469933 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.469914    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:05.470769 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.470723    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"]
Jul 24 16:45:05.472210 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.472190    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-aac1d1-dockercfg-t88fm\""
Jul 24 16:45:05.482766 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.482747    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"]
Jul 24 16:45:05.554374 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.554339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwt29\" (UniqueName: \"kubernetes.io/projected/7b051a26-8044-4ec8-aec0-0bdd973214fa-kube-api-access-wwt29\") pod \"payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh\" (UID: \"7b051a26-8044-4ec8-aec0-0bdd973214fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:05.554518 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.554392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm6kn\" (UniqueName: \"kubernetes.io/projected/874c7c11-41f0-409f-b56a-f66c987ede84-kube-api-access-cm6kn\") pod \"payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb\" (UID: \"874c7c11-41f0-409f-b56a-f66c987ede84\") " pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:05.554518 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.554423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b051a26-8044-4ec8-aec0-0bdd973214fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh\" (UID: \"7b051a26-8044-4ec8-aec0-0bdd973214fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:05.554596 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.554539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/874c7c11-41f0-409f-b56a-f66c987ede84-plugins-config-volume\") pod \"payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb\" (UID: \"874c7c11-41f0-409f-b56a-f66c987ede84\") " pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:05.619698 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.619662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk" event={"ID":"c1448250-a6f1-4010-9b88-3d51cac90d8e","Type":"ContainerStarted","Data":"c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f"}
Jul 24 16:45:05.619876 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.619714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk" event={"ID":"c1448250-a6f1-4010-9b88-3d51cac90d8e","Type":"ContainerStarted","Data":"3d48202769bdfb50caa14668ee5285ae6f286abdf5bd74920965253e6d2db491"}
Jul 24 16:45:05.619876 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.619794    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:05.637030 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.636954    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk" podStartSLOduration=1.253004871 podStartE2EDuration="1.636936123s" totalImagesPullingTime="383.931252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:05.636609569 +0000 UTC m=+2339.621300349" watchObservedRunningTime="2026-07-24 16:45:05.636936123 +0000 UTC m=+2339.621626902"
Jul 24 16:45:05.656061 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.656026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/874c7c11-41f0-409f-b56a-f66c987ede84-plugins-config-volume\") pod \"payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb\" (UID: \"874c7c11-41f0-409f-b56a-f66c987ede84\") " pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:05.656231 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.656089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwt29\" (UniqueName: \"kubernetes.io/projected/7b051a26-8044-4ec8-aec0-0bdd973214fa-kube-api-access-wwt29\") pod \"payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh\" (UID: \"7b051a26-8044-4ec8-aec0-0bdd973214fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:05.656477 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.656454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm6kn\" (UniqueName: \"kubernetes.io/projected/874c7c11-41f0-409f-b56a-f66c987ede84-kube-api-access-cm6kn\") pod \"payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb\" (UID: \"874c7c11-41f0-409f-b56a-f66c987ede84\") " pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:05.656577 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.656498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b051a26-8044-4ec8-aec0-0bdd973214fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh\" (UID: \"7b051a26-8044-4ec8-aec0-0bdd973214fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:05.656956 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.656929    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/874c7c11-41f0-409f-b56a-f66c987ede84-plugins-config-volume\") pod \"payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb\" (UID: \"874c7c11-41f0-409f-b56a-f66c987ede84\") " pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:05.657199 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.657177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b051a26-8044-4ec8-aec0-0bdd973214fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh\" (UID: \"7b051a26-8044-4ec8-aec0-0bdd973214fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:05.664361 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.664339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwt29\" (UniqueName: \"kubernetes.io/projected/7b051a26-8044-4ec8-aec0-0bdd973214fa-kube-api-access-wwt29\") pod \"payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh\" (UID: \"7b051a26-8044-4ec8-aec0-0bdd973214fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:05.664550 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.664530    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm6kn\" (UniqueName: \"kubernetes.io/projected/874c7c11-41f0-409f-b56a-f66c987ede84-kube-api-access-cm6kn\") pod \"payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb\" (UID: \"874c7c11-41f0-409f-b56a-f66c987ede84\") " pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:05.768048 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.767977    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:05.783006 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.782981    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:05.930585 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.930559    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"]
Jul 24 16:45:05.933762 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:45:05.933731    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b051a26_8044_4ec8_aec0_0bdd973214fa.slice/crio-eb54d39a336b585c6c50a93a0eee770955ccfcb91eb1bc371be3c94e179a0a54 WatchSource:0}: Error finding container eb54d39a336b585c6c50a93a0eee770955ccfcb91eb1bc371be3c94e179a0a54: Status 404 returned error can't find the container with id eb54d39a336b585c6c50a93a0eee770955ccfcb91eb1bc371be3c94e179a0a54
Jul 24 16:45:05.949859 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:05.949836    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"]
Jul 24 16:45:05.951410 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:45:05.951387    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod874c7c11_41f0_409f_b56a_f66c987ede84.slice/crio-0f3955e40ecab9a45eda20a79656b8a04c51598b926bbfc0e2d0479f95529445 WatchSource:0}: Error finding container 0f3955e40ecab9a45eda20a79656b8a04c51598b926bbfc0e2d0479f95529445: Status 404 returned error can't find the container with id 0f3955e40ecab9a45eda20a79656b8a04c51598b926bbfc0e2d0479f95529445
Jul 24 16:45:06.626567 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:06.626526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb" event={"ID":"874c7c11-41f0-409f-b56a-f66c987ede84","Type":"ContainerStarted","Data":"63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801"}
Jul 24 16:45:06.626765 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:06.626589    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb" event={"ID":"874c7c11-41f0-409f-b56a-f66c987ede84","Type":"ContainerStarted","Data":"0f3955e40ecab9a45eda20a79656b8a04c51598b926bbfc0e2d0479f95529445"}
Jul 24 16:45:06.626765 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:06.626702    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:06.628206 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:06.628180    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh" event={"ID":"7b051a26-8044-4ec8-aec0-0bdd973214fa","Type":"ContainerStarted","Data":"c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036"}
Jul 24 16:45:06.628333 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:06.628226    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh" event={"ID":"7b051a26-8044-4ec8-aec0-0bdd973214fa","Type":"ContainerStarted","Data":"eb54d39a336b585c6c50a93a0eee770955ccfcb91eb1bc371be3c94e179a0a54"}
Jul 24 16:45:06.628333 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:06.628327    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:06.643596 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:06.643553    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb" podStartSLOduration=1.643541209 podStartE2EDuration="1.643541209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:06.642749025 +0000 UTC m=+2340.627439820" watchObservedRunningTime="2026-07-24 16:45:06.643541209 +0000 UTC m=+2340.628232041"
Jul 24 16:45:06.658398 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:06.658344    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh" podStartSLOduration=1.65832745 podStartE2EDuration="1.65832745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:06.657093933 +0000 UTC m=+2340.641784729" watchObservedRunningTime="2026-07-24 16:45:06.65832745 +0000 UTC m=+2340.643018233"
Jul 24 16:45:11.633302 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:11.633277    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:12.660069 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.660030    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:45:12.671791 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.671761    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"]
Jul 24 16:45:12.674985 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.674967    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:12.677096 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.677074    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4ef934-serving-cert\""
Jul 24 16:45:12.691274 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.691250    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"]
Jul 24 16:45:12.820550 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.820509    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd76101-8b6e-45c3-a369-e888b1e7677d-maas-api-tls\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:12.820550 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.820548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd76101-8b6e-45c3-a369-e888b1e7677d-openshift-service-ca\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:12.820801 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.820595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxqx6\" (UniqueName: \"kubernetes.io/projected/ffd76101-8b6e-45c3-a369-e888b1e7677d-kube-api-access-hxqx6\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:12.921835 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.921748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd76101-8b6e-45c3-a369-e888b1e7677d-maas-api-tls\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:12.921835 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.921788    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd76101-8b6e-45c3-a369-e888b1e7677d-openshift-service-ca\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:12.922055 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.921841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxqx6\" (UniqueName: \"kubernetes.io/projected/ffd76101-8b6e-45c3-a369-e888b1e7677d-kube-api-access-hxqx6\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:12.922055 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:45:12.921889    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-serving-cert: secret "maas-api-e2e-api-b-4ef934-serving-cert" not found
Jul 24 16:45:12.922055 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:45:12.921970    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd76101-8b6e-45c3-a369-e888b1e7677d-maas-api-tls podName:ffd76101-8b6e-45c3-a369-e888b1e7677d nodeName:}" failed. No retries permitted until 2026-07-24 16:45:13.42195148 +0000 UTC m=+2347.406642240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ffd76101-8b6e-45c3-a369-e888b1e7677d-maas-api-tls") pod "maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb" (UID: "ffd76101-8b6e-45c3-a369-e888b1e7677d") : secret "maas-api-e2e-api-b-4ef934-serving-cert" not found
Jul 24 16:45:12.922494 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.922473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd76101-8b6e-45c3-a369-e888b1e7677d-openshift-service-ca\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:12.932222 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:12.932196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxqx6\" (UniqueName: \"kubernetes.io/projected/ffd76101-8b6e-45c3-a369-e888b1e7677d-kube-api-access-hxqx6\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:13.426700 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.426664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd76101-8b6e-45c3-a369-e888b1e7677d-maas-api-tls\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:13.429282 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.429255    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd76101-8b6e-45c3-a369-e888b1e7677d-maas-api-tls\") pod \"maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:13.453236 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.453200    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"]
Jul 24 16:45:13.456586 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.456568    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:13.458948 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.458914    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4ef934\""
Jul 24 16:45:13.459052 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.458988    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4ef934-dockercfg-ccwmt\""
Jul 24 16:45:13.464664 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.464613    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"]
Jul 24 16:45:13.493047 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.493016    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"]
Jul 24 16:45:13.496044 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.496028    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:13.516577 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.516546    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"]
Jul 24 16:45:13.584802 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.584768    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:13.628583 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.628552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbc57\" (UniqueName: \"kubernetes.io/projected/d288f528-c1bd-4623-9aac-ce1e0988ec55-kube-api-access-zbc57\") pod \"payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c\" (UID: \"d288f528-c1bd-4623-9aac-ce1e0988ec55\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:13.628788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.628601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs2dp\" (UniqueName: \"kubernetes.io/projected/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-kube-api-access-vs2dp\") pod \"payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9\" (UID: \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:13.628788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.628633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9\" (UID: \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:13.628788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.628674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d288f528-c1bd-4623-9aac-ce1e0988ec55-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c\" (UID: \"d288f528-c1bd-4623-9aac-ce1e0988ec55\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:13.729878 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.729787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbc57\" (UniqueName: \"kubernetes.io/projected/d288f528-c1bd-4623-9aac-ce1e0988ec55-kube-api-access-zbc57\") pod \"payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c\" (UID: \"d288f528-c1bd-4623-9aac-ce1e0988ec55\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:13.729878 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.729840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs2dp\" (UniqueName: \"kubernetes.io/projected/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-kube-api-access-vs2dp\") pod \"payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9\" (UID: \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:13.730314 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.730017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9\" (UID: \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:13.730314 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.730045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d288f528-c1bd-4623-9aac-ce1e0988ec55-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c\" (UID: \"d288f528-c1bd-4623-9aac-ce1e0988ec55\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:13.730987 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.730968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9\" (UID: \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:13.731031 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.730968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d288f528-c1bd-4623-9aac-ce1e0988ec55-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c\" (UID: \"d288f528-c1bd-4623-9aac-ce1e0988ec55\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:13.737589 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.737564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbc57\" (UniqueName: \"kubernetes.io/projected/d288f528-c1bd-4623-9aac-ce1e0988ec55-kube-api-access-zbc57\") pod \"payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c\" (UID: \"d288f528-c1bd-4623-9aac-ce1e0988ec55\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:13.737740 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.737693    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs2dp\" (UniqueName: \"kubernetes.io/projected/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-kube-api-access-vs2dp\") pod \"payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9\" (UID: \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:13.768425 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.768396    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:13.805447 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.805411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:13.907808 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.907776    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"]
Jul 24 16:45:13.910306 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:45:13.910267    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd288f528_c1bd_4623_9aac_ce1e0988ec55.slice/crio-f3d5680363704c87c82453f6a2143ecb3d520fc5a9483e6755c81855cdb78b42 WatchSource:0}: Error finding container f3d5680363704c87c82453f6a2143ecb3d520fc5a9483e6755c81855cdb78b42: Status 404 returned error can't find the container with id f3d5680363704c87c82453f6a2143ecb3d520fc5a9483e6755c81855cdb78b42
Jul 24 16:45:13.925970 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.925940    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"]
Jul 24 16:45:13.926249 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:45:13.926226    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd76101_8b6e_45c3_a369_e888b1e7677d.slice/crio-3c328c54b7cbb8a3f104de33569799971fb6e52cc4d40565da8651d2960a094f WatchSource:0}: Error finding container 3c328c54b7cbb8a3f104de33569799971fb6e52cc4d40565da8651d2960a094f: Status 404 returned error can't find the container with id 3c328c54b7cbb8a3f104de33569799971fb6e52cc4d40565da8651d2960a094f
Jul 24 16:45:13.961825 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:13.961803    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"]
Jul 24 16:45:13.963351 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:45:13.963326    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0292517d_8e0b_4f31_834b_b0f5eb3ebbe6.slice/crio-93f63855842892f43db53f958c055a79438517f2bc7d853757030e80c7bbecd4 WatchSource:0}: Error finding container 93f63855842892f43db53f958c055a79438517f2bc7d853757030e80c7bbecd4: Status 404 returned error can't find the container with id 93f63855842892f43db53f958c055a79438517f2bc7d853757030e80c7bbecd4
Jul 24 16:45:14.669318 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.669285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c" event={"ID":"d288f528-c1bd-4623-9aac-ce1e0988ec55","Type":"ContainerStarted","Data":"11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba"}
Jul 24 16:45:14.669499 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.669345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c" event={"ID":"d288f528-c1bd-4623-9aac-ce1e0988ec55","Type":"ContainerStarted","Data":"f3d5680363704c87c82453f6a2143ecb3d520fc5a9483e6755c81855cdb78b42"}
Jul 24 16:45:14.669499 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.669391    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:14.670974 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.670944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb" event={"ID":"ffd76101-8b6e-45c3-a369-e888b1e7677d","Type":"ContainerStarted","Data":"a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91"}
Jul 24 16:45:14.671103 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.670993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb" event={"ID":"ffd76101-8b6e-45c3-a369-e888b1e7677d","Type":"ContainerStarted","Data":"3c328c54b7cbb8a3f104de33569799971fb6e52cc4d40565da8651d2960a094f"}
Jul 24 16:45:14.671103 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.671071    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:14.672528 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.672497    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9" event={"ID":"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6","Type":"ContainerStarted","Data":"284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b"}
Jul 24 16:45:14.672627 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.672543    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9" event={"ID":"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6","Type":"ContainerStarted","Data":"93f63855842892f43db53f958c055a79438517f2bc7d853757030e80c7bbecd4"}
Jul 24 16:45:14.672914 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.672896    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:14.686779 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.686740    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c" podStartSLOduration=1.686729083 podStartE2EDuration="1.686729083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:14.685398832 +0000 UTC m=+2348.670089613" watchObservedRunningTime="2026-07-24 16:45:14.686729083 +0000 UTC m=+2348.671419917"
Jul 24 16:45:14.699703 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.699633    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9" podStartSLOduration=1.699617755 podStartE2EDuration="1.699617755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:14.699065708 +0000 UTC m=+2348.683756511" watchObservedRunningTime="2026-07-24 16:45:14.699617755 +0000 UTC m=+2348.684308536"
Jul 24 16:45:14.715306 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:14.715268    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb" podStartSLOduration=2.333459416 podStartE2EDuration="2.715255974s" totalImagesPullingTime="381.796558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:14.714363808 +0000 UTC m=+2348.699054590" watchObservedRunningTime="2026-07-24 16:45:14.715255974 +0000 UTC m=+2348.699946733"
Jul 24 16:45:17.634712 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:17.634684    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:17.635081 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:17.634752    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:20.682765 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:20.682738    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:45:25.679193 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:25.679164    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:45:25.679598 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:25.679239    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:45:29.158403 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:29.158365    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:45:40.784986 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:40.784956    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"]
Jul 24 16:45:40.785503 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:40.785143    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk" podUID="c1448250-a6f1-4010-9b88-3d51cac90d8e" containerName="maas-api" containerID="cri-o://c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f" gracePeriod=30
Jul 24 16:45:40.820385 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:40.820358    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"]
Jul 24 16:45:40.820605 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:40.820576    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb" podUID="874c7c11-41f0-409f-b56a-f66c987ede84" containerName="payload-processing" containerID="cri-o://63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801" gracePeriod=30
Jul 24 16:45:40.829016 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:40.828988    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"]
Jul 24 16:45:40.829269 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:40.829217    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh" podUID="7b051a26-8044-4ec8-aec0-0bdd973214fa" containerName="payload-pre-processing" containerID="cri-o://c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036" gracePeriod=30
Jul 24 16:45:41.074897 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.074873    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:41.078918 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.078896    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:41.105988 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.105963    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:41.154879 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.154849    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1448250-a6f1-4010-9b88-3d51cac90d8e-openshift-service-ca\") pod \"c1448250-a6f1-4010-9b88-3d51cac90d8e\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") "
Jul 24 16:45:41.155066 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.154888    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1448250-a6f1-4010-9b88-3d51cac90d8e-maas-api-tls\") pod \"c1448250-a6f1-4010-9b88-3d51cac90d8e\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") "
Jul 24 16:45:41.155066 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.154906    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm6kn\" (UniqueName: \"kubernetes.io/projected/874c7c11-41f0-409f-b56a-f66c987ede84-kube-api-access-cm6kn\") pod \"874c7c11-41f0-409f-b56a-f66c987ede84\" (UID: \"874c7c11-41f0-409f-b56a-f66c987ede84\") "
Jul 24 16:45:41.155066 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.154924    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l799h\" (UniqueName: \"kubernetes.io/projected/c1448250-a6f1-4010-9b88-3d51cac90d8e-kube-api-access-l799h\") pod \"c1448250-a6f1-4010-9b88-3d51cac90d8e\" (UID: \"c1448250-a6f1-4010-9b88-3d51cac90d8e\") "
Jul 24 16:45:41.155066 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.154939    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwt29\" (UniqueName: \"kubernetes.io/projected/7b051a26-8044-4ec8-aec0-0bdd973214fa-kube-api-access-wwt29\") pod \"7b051a26-8044-4ec8-aec0-0bdd973214fa\" (UID: \"7b051a26-8044-4ec8-aec0-0bdd973214fa\") "
Jul 24 16:45:41.155066 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.155044    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/874c7c11-41f0-409f-b56a-f66c987ede84-plugins-config-volume\") pod \"874c7c11-41f0-409f-b56a-f66c987ede84\" (UID: \"874c7c11-41f0-409f-b56a-f66c987ede84\") "
Jul 24 16:45:41.155418 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.155099    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b051a26-8044-4ec8-aec0-0bdd973214fa-plugins-config-volume\") pod \"7b051a26-8044-4ec8-aec0-0bdd973214fa\" (UID: \"7b051a26-8044-4ec8-aec0-0bdd973214fa\") "
Jul 24 16:45:41.155418 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.155291    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1448250-a6f1-4010-9b88-3d51cac90d8e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1448250-a6f1-4010-9b88-3d51cac90d8e" (UID: "c1448250-a6f1-4010-9b88-3d51cac90d8e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:45:41.155418 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.155400    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1448250-a6f1-4010-9b88-3d51cac90d8e-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:45:41.155418 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.155393    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/874c7c11-41f0-409f-b56a-f66c987ede84-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "874c7c11-41f0-409f-b56a-f66c987ede84" (UID: "874c7c11-41f0-409f-b56a-f66c987ede84"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:45:41.155884 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.155859    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b051a26-8044-4ec8-aec0-0bdd973214fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b051a26-8044-4ec8-aec0-0bdd973214fa" (UID: "7b051a26-8044-4ec8-aec0-0bdd973214fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:45:41.157192 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.157169    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1448250-a6f1-4010-9b88-3d51cac90d8e-kube-api-access-l799h" (OuterVolumeSpecName: "kube-api-access-l799h") pod "c1448250-a6f1-4010-9b88-3d51cac90d8e" (UID: "c1448250-a6f1-4010-9b88-3d51cac90d8e"). InnerVolumeSpecName "kube-api-access-l799h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:45:41.157314 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.157292    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b051a26-8044-4ec8-aec0-0bdd973214fa-kube-api-access-wwt29" (OuterVolumeSpecName: "kube-api-access-wwt29") pod "7b051a26-8044-4ec8-aec0-0bdd973214fa" (UID: "7b051a26-8044-4ec8-aec0-0bdd973214fa"). InnerVolumeSpecName "kube-api-access-wwt29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:45:41.157381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.157292    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/874c7c11-41f0-409f-b56a-f66c987ede84-kube-api-access-cm6kn" (OuterVolumeSpecName: "kube-api-access-cm6kn") pod "874c7c11-41f0-409f-b56a-f66c987ede84" (UID: "874c7c11-41f0-409f-b56a-f66c987ede84"). InnerVolumeSpecName "kube-api-access-cm6kn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:45:41.157381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.157324    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1448250-a6f1-4010-9b88-3d51cac90d8e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1448250-a6f1-4010-9b88-3d51cac90d8e" (UID: "c1448250-a6f1-4010-9b88-3d51cac90d8e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:45:41.256075 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.256043    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/874c7c11-41f0-409f-b56a-f66c987ede84-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:45:41.256075 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.256073    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b051a26-8044-4ec8-aec0-0bdd973214fa-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:45:41.256300 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.256124    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1448250-a6f1-4010-9b88-3d51cac90d8e-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:45:41.256300 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.256153    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm6kn\" (UniqueName: \"kubernetes.io/projected/874c7c11-41f0-409f-b56a-f66c987ede84-kube-api-access-cm6kn\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:45:41.256300 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.256168    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l799h\" (UniqueName: \"kubernetes.io/projected/c1448250-a6f1-4010-9b88-3d51cac90d8e-kube-api-access-l799h\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:45:41.256300 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.256180    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwt29\" (UniqueName: \"kubernetes.io/projected/7b051a26-8044-4ec8-aec0-0bdd973214fa-kube-api-access-wwt29\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:45:41.805197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.805165    2561 generic.go:356] "Generic (PLEG): container finished" podID="874c7c11-41f0-409f-b56a-f66c987ede84" containerID="63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801" exitCode=0
Jul 24 16:45:41.805624 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.805210    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"
Jul 24 16:45:41.805624 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.805249    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb" event={"ID":"874c7c11-41f0-409f-b56a-f66c987ede84","Type":"ContainerDied","Data":"63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801"}
Jul 24 16:45:41.805624 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.805324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb" event={"ID":"874c7c11-41f0-409f-b56a-f66c987ede84","Type":"ContainerDied","Data":"0f3955e40ecab9a45eda20a79656b8a04c51598b926bbfc0e2d0479f95529445"}
Jul 24 16:45:41.805624 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.805356    2561 scope.go:117] "RemoveContainer" containerID="63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801"
Jul 24 16:45:41.806747 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.806404    2561 generic.go:356] "Generic (PLEG): container finished" podID="7b051a26-8044-4ec8-aec0-0bdd973214fa" containerID="c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036" exitCode=0
Jul 24 16:45:41.806747 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.806491    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"
Jul 24 16:45:41.806747 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.806524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh" event={"ID":"7b051a26-8044-4ec8-aec0-0bdd973214fa","Type":"ContainerDied","Data":"c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036"}
Jul 24 16:45:41.806747 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.806561    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh" event={"ID":"7b051a26-8044-4ec8-aec0-0bdd973214fa","Type":"ContainerDied","Data":"eb54d39a336b585c6c50a93a0eee770955ccfcb91eb1bc371be3c94e179a0a54"}
Jul 24 16:45:41.807870 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.807845    2561 generic.go:356] "Generic (PLEG): container finished" podID="c1448250-a6f1-4010-9b88-3d51cac90d8e" containerID="c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f" exitCode=0
Jul 24 16:45:41.807988 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.807897    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"
Jul 24 16:45:41.807988 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.807910    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk" event={"ID":"c1448250-a6f1-4010-9b88-3d51cac90d8e","Type":"ContainerDied","Data":"c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f"}
Jul 24 16:45:41.807988 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.807956    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk" event={"ID":"c1448250-a6f1-4010-9b88-3d51cac90d8e","Type":"ContainerDied","Data":"3d48202769bdfb50caa14668ee5285ae6f286abdf5bd74920965253e6d2db491"}
Jul 24 16:45:41.815311 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.815288    2561 scope.go:117] "RemoveContainer" containerID="63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801"
Jul 24 16:45:41.815610 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:45:41.815579    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801\": container with ID starting with 63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801 not found: ID does not exist" containerID="63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801"
Jul 24 16:45:41.815760 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.815624    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801"} err="failed to get container status \"63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801\": rpc error: code = NotFound desc = could not find container \"63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801\": container with ID starting with 63eb2bbf75a2a9284c70bc99012616d33c82b27fd7a576a1beb6afa65dc24801 not found: ID does not exist"
Jul 24 16:45:41.815760 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.815667    2561 scope.go:117] "RemoveContainer" containerID="c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036"
Jul 24 16:45:41.824392 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.824377    2561 scope.go:117] "RemoveContainer" containerID="c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036"
Jul 24 16:45:41.824673 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:45:41.824629    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036\": container with ID starting with c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036 not found: ID does not exist" containerID="c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036"
Jul 24 16:45:41.824733 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.824681    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036"} err="failed to get container status \"c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036\": rpc error: code = NotFound desc = could not find container \"c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036\": container with ID starting with c142b357bd6ff8b315edadd08aa70eabac15ac3909dfb31f3e6bef3c1ee3d036 not found: ID does not exist"
Jul 24 16:45:41.824733 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.824698    2561 scope.go:117] "RemoveContainer" containerID="c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f"
Jul 24 16:45:41.831816 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.831795    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"]
Jul 24 16:45:41.832709 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.832692    2561 scope.go:117] "RemoveContainer" containerID="c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f"
Jul 24 16:45:41.832961 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:45:41.832939    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f\": container with ID starting with c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f not found: ID does not exist" containerID="c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f"
Jul 24 16:45:41.833034 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.832965    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f"} err="failed to get container status \"c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f\": rpc error: code = NotFound desc = could not find container \"c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f\": container with ID starting with c074b0fb044a583fca2eba79dabf29fc52e9ed57608569fea9ae98e96fbcf16f not found: ID does not exist"
Jul 24 16:45:41.835615 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.835595    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aac1d1-6c89d98f66-xtlrb"]
Jul 24 16:45:41.844624 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.844604    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"]
Jul 24 16:45:41.848730 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.848710    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aac1d1-844f864468-zq8jk"]
Jul 24 16:45:41.857627 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.857605    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"]
Jul 24 16:45:41.861561 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:41.861538    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aac1d1-667b7b647b-gdrlh"]
Jul 24 16:45:42.507685 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:42.507656    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b051a26-8044-4ec8-aec0-0bdd973214fa" path="/var/lib/kubelet/pods/7b051a26-8044-4ec8-aec0-0bdd973214fa/volumes"
Jul 24 16:45:42.508003 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:42.507991    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="874c7c11-41f0-409f-b56a-f66c987ede84" path="/var/lib/kubelet/pods/874c7c11-41f0-409f-b56a-f66c987ede84/volumes"
Jul 24 16:45:42.508324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:42.508312    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1448250-a6f1-4010-9b88-3d51cac90d8e" path="/var/lib/kubelet/pods/c1448250-a6f1-4010-9b88-3d51cac90d8e/volumes"
Jul 24 16:45:45.948787 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:45.948748    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:45:51.842906 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.842869    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"]
Jul 24 16:45:51.843279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.843172    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b051a26-8044-4ec8-aec0-0bdd973214fa" containerName="payload-pre-processing"
Jul 24 16:45:51.843279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.843182    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b051a26-8044-4ec8-aec0-0bdd973214fa" containerName="payload-pre-processing"
Jul 24 16:45:51.843279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.843201    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1448250-a6f1-4010-9b88-3d51cac90d8e" containerName="maas-api"
Jul 24 16:45:51.843279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.843206    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1448250-a6f1-4010-9b88-3d51cac90d8e" containerName="maas-api"
Jul 24 16:45:51.843279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.843212    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="874c7c11-41f0-409f-b56a-f66c987ede84" containerName="payload-processing"
Jul 24 16:45:51.843279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.843218    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="874c7c11-41f0-409f-b56a-f66c987ede84" containerName="payload-processing"
Jul 24 16:45:51.843279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.843270    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="874c7c11-41f0-409f-b56a-f66c987ede84" containerName="payload-processing"
Jul 24 16:45:51.843279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.843278    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1448250-a6f1-4010-9b88-3d51cac90d8e" containerName="maas-api"
Jul 24 16:45:51.843279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.843284    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b051a26-8044-4ec8-aec0-0bdd973214fa" containerName="payload-pre-processing"
Jul 24 16:45:51.848092 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.848064    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"
Jul 24 16:45:51.850133 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.850109    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wtjsm\""
Jul 24 16:45:51.856771 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.856749    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"]
Jul 24 16:45:51.949237 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:51.949203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a3accad-974a-49d7-9633-8de4984830de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r\" (UID: \"0a3accad-974a-49d7-9633-8de4984830de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"
Jul 24 16:45:52.050012 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:52.049978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a3accad-974a-49d7-9633-8de4984830de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r\" (UID: \"0a3accad-974a-49d7-9633-8de4984830de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"
Jul 24 16:45:52.050587 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:52.050568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a3accad-974a-49d7-9633-8de4984830de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r\" (UID: \"0a3accad-974a-49d7-9633-8de4984830de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"
Jul 24 16:45:52.160242 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:52.160193    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"
Jul 24 16:45:52.287523 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:52.287498    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"]
Jul 24 16:45:52.289407 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:45:52.289383    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3accad_974a_49d7_9633_8de4984830de.slice/crio-01da357e7fc9fc033dd52c10b073c1358353066807849cf2910e361350c3e1ce WatchSource:0}: Error finding container 01da357e7fc9fc033dd52c10b073c1358353066807849cf2910e361350c3e1ce: Status 404 returned error can't find the container with id 01da357e7fc9fc033dd52c10b073c1358353066807849cf2910e361350c3e1ce
Jul 24 16:45:52.864179 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:52.864143    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r" event={"ID":"0a3accad-974a-49d7-9633-8de4984830de","Type":"ContainerStarted","Data":"f5f80c324971fbd81eed65e028f593d27c3f74c91078dd21a95493e442c2079c"}
Jul 24 16:45:52.864560 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:52.864203    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r" event={"ID":"0a3accad-974a-49d7-9633-8de4984830de","Type":"ContainerStarted","Data":"01da357e7fc9fc033dd52c10b073c1358353066807849cf2910e361350c3e1ce"}
Jul 24 16:45:52.879446 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:52.879392    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r" podStartSLOduration=1.879377763 podStartE2EDuration="1.879377763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:52.877447757 +0000 UTC m=+2386.862138579" watchObservedRunningTime="2026-07-24 16:45:52.879377763 +0000 UTC m=+2386.864068543"
Jul 24 16:45:53.870690 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:53.870660    2561 generic.go:356] "Generic (PLEG): container finished" podID="0a3accad-974a-49d7-9633-8de4984830de" containerID="f5f80c324971fbd81eed65e028f593d27c3f74c91078dd21a95493e442c2079c" exitCode=0
Jul 24 16:45:53.871081 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:53.870731    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r" event={"ID":"0a3accad-974a-49d7-9633-8de4984830de","Type":"ContainerDied","Data":"f5f80c324971fbd81eed65e028f593d27c3f74c91078dd21a95493e442c2079c"}
Jul 24 16:45:55.007172 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:55.007148    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"
Jul 24 16:45:55.180681 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:55.180584    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a3accad-974a-49d7-9633-8de4984830de-maas-api-service-ca\") pod \"0a3accad-974a-49d7-9633-8de4984830de\" (UID: \"0a3accad-974a-49d7-9633-8de4984830de\") "
Jul 24 16:45:55.180949 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:55.180927    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a3accad-974a-49d7-9633-8de4984830de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0a3accad-974a-49d7-9633-8de4984830de" (UID: "0a3accad-974a-49d7-9633-8de4984830de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:45:55.281689 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:55.281626    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a3accad-974a-49d7-9633-8de4984830de-maas-api-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:45:55.882454 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:55.882424    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"
Jul 24 16:45:55.882605 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:55.882468    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r" event={"ID":"0a3accad-974a-49d7-9633-8de4984830de","Type":"ContainerDied","Data":"01da357e7fc9fc033dd52c10b073c1358353066807849cf2910e361350c3e1ce"}
Jul 24 16:45:55.882605 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:45:55.882511    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01da357e7fc9fc033dd52c10b073c1358353066807849cf2910e361350c3e1ce"
Jul 24 16:46:07.312125 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.312086    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"]
Jul 24 16:46:07.312585 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.312292    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb" podUID="ffd76101-8b6e-45c3-a369-e888b1e7677d" containerName="maas-api" containerID="cri-o://a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91" gracePeriod=30
Jul 24 16:46:07.354394 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.354363    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"]
Jul 24 16:46:07.354613 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.354588    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9" podUID="0292517d-8e0b-4f31-834b-b0f5eb3ebbe6" containerName="payload-processing" containerID="cri-o://284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b" gracePeriod=30
Jul 24 16:46:07.361932 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.361900    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"]
Jul 24 16:46:07.362163 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.362113    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c" podUID="d288f528-c1bd-4623-9aac-ce1e0988ec55" containerName="payload-pre-processing" containerID="cri-o://11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba" gracePeriod=30
Jul 24 16:46:07.610847 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.610809    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:46:07.646115 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.646094    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:46:07.648667 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.648628    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:46:07.683965 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.683939    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbc57\" (UniqueName: \"kubernetes.io/projected/d288f528-c1bd-4623-9aac-ce1e0988ec55-kube-api-access-zbc57\") pod \"d288f528-c1bd-4623-9aac-ce1e0988ec55\" (UID: \"d288f528-c1bd-4623-9aac-ce1e0988ec55\") "
Jul 24 16:46:07.684070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.683977    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs2dp\" (UniqueName: \"kubernetes.io/projected/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-kube-api-access-vs2dp\") pod \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\" (UID: \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\") "
Jul 24 16:46:07.684070 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.684012    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d288f528-c1bd-4623-9aac-ce1e0988ec55-plugins-config-volume\") pod \"d288f528-c1bd-4623-9aac-ce1e0988ec55\" (UID: \"d288f528-c1bd-4623-9aac-ce1e0988ec55\") "
Jul 24 16:46:07.684169 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.684075    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-plugins-config-volume\") pod \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\" (UID: \"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6\") "
Jul 24 16:46:07.684169 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.684111    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd76101-8b6e-45c3-a369-e888b1e7677d-openshift-service-ca\") pod \"ffd76101-8b6e-45c3-a369-e888b1e7677d\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") "
Jul 24 16:46:07.684169 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.684146    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd76101-8b6e-45c3-a369-e888b1e7677d-maas-api-tls\") pod \"ffd76101-8b6e-45c3-a369-e888b1e7677d\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") "
Jul 24 16:46:07.684324 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.684182    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxqx6\" (UniqueName: \"kubernetes.io/projected/ffd76101-8b6e-45c3-a369-e888b1e7677d-kube-api-access-hxqx6\") pod \"ffd76101-8b6e-45c3-a369-e888b1e7677d\" (UID: \"ffd76101-8b6e-45c3-a369-e888b1e7677d\") "
Jul 24 16:46:07.684549 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.684494    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffd76101-8b6e-45c3-a369-e888b1e7677d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffd76101-8b6e-45c3-a369-e888b1e7677d" (UID: "ffd76101-8b6e-45c3-a369-e888b1e7677d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:46:07.684549 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.684503    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d288f528-c1bd-4623-9aac-ce1e0988ec55-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d288f528-c1bd-4623-9aac-ce1e0988ec55" (UID: "d288f528-c1bd-4623-9aac-ce1e0988ec55"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:46:07.684549 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.684530    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0292517d-8e0b-4f31-834b-b0f5eb3ebbe6" (UID: "0292517d-8e0b-4f31-834b-b0f5eb3ebbe6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:46:07.686279 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.686254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d288f528-c1bd-4623-9aac-ce1e0988ec55-kube-api-access-zbc57" (OuterVolumeSpecName: "kube-api-access-zbc57") pod "d288f528-c1bd-4623-9aac-ce1e0988ec55" (UID: "d288f528-c1bd-4623-9aac-ce1e0988ec55"). InnerVolumeSpecName "kube-api-access-zbc57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:46:07.686366 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.686318    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffd76101-8b6e-45c3-a369-e888b1e7677d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffd76101-8b6e-45c3-a369-e888b1e7677d" (UID: "ffd76101-8b6e-45c3-a369-e888b1e7677d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:46:07.686406 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.686368    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-kube-api-access-vs2dp" (OuterVolumeSpecName: "kube-api-access-vs2dp") pod "0292517d-8e0b-4f31-834b-b0f5eb3ebbe6" (UID: "0292517d-8e0b-4f31-834b-b0f5eb3ebbe6"). InnerVolumeSpecName "kube-api-access-vs2dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:46:07.686878 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.686850    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffd76101-8b6e-45c3-a369-e888b1e7677d-kube-api-access-hxqx6" (OuterVolumeSpecName: "kube-api-access-hxqx6") pod "ffd76101-8b6e-45c3-a369-e888b1e7677d" (UID: "ffd76101-8b6e-45c3-a369-e888b1e7677d"). InnerVolumeSpecName "kube-api-access-hxqx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:46:07.784953 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.784924    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxqx6\" (UniqueName: \"kubernetes.io/projected/ffd76101-8b6e-45c3-a369-e888b1e7677d-kube-api-access-hxqx6\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:46:07.784953 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.784950    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbc57\" (UniqueName: \"kubernetes.io/projected/d288f528-c1bd-4623-9aac-ce1e0988ec55-kube-api-access-zbc57\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:46:07.785108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.784964    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs2dp\" (UniqueName: \"kubernetes.io/projected/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-kube-api-access-vs2dp\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:46:07.785108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.784977    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d288f528-c1bd-4623-9aac-ce1e0988ec55-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:46:07.785108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.784988    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:46:07.785108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.785000    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd76101-8b6e-45c3-a369-e888b1e7677d-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:46:07.785108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.785014    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd76101-8b6e-45c3-a369-e888b1e7677d-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:46:07.943846 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.943812    2561 generic.go:356] "Generic (PLEG): container finished" podID="d288f528-c1bd-4623-9aac-ce1e0988ec55" containerID="11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba" exitCode=0
Jul 24 16:46:07.944036 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.943860    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"
Jul 24 16:46:07.944036 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.943892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c" event={"ID":"d288f528-c1bd-4623-9aac-ce1e0988ec55","Type":"ContainerDied","Data":"11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba"}
Jul 24 16:46:07.944036 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.943945    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c" event={"ID":"d288f528-c1bd-4623-9aac-ce1e0988ec55","Type":"ContainerDied","Data":"f3d5680363704c87c82453f6a2143ecb3d520fc5a9483e6755c81855cdb78b42"}
Jul 24 16:46:07.944036 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.943975    2561 scope.go:117] "RemoveContainer" containerID="11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba"
Jul 24 16:46:07.945305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.945236    2561 generic.go:356] "Generic (PLEG): container finished" podID="ffd76101-8b6e-45c3-a369-e888b1e7677d" containerID="a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91" exitCode=0
Jul 24 16:46:07.945305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.945286    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"
Jul 24 16:46:07.945427 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.945322    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb" event={"ID":"ffd76101-8b6e-45c3-a369-e888b1e7677d","Type":"ContainerDied","Data":"a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91"}
Jul 24 16:46:07.945427 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.945382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb" event={"ID":"ffd76101-8b6e-45c3-a369-e888b1e7677d","Type":"ContainerDied","Data":"3c328c54b7cbb8a3f104de33569799971fb6e52cc4d40565da8651d2960a094f"}
Jul 24 16:46:07.946883 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.946859    2561 generic.go:356] "Generic (PLEG): container finished" podID="0292517d-8e0b-4f31-834b-b0f5eb3ebbe6" containerID="284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b" exitCode=0
Jul 24 16:46:07.946976 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.946900    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"
Jul 24 16:46:07.947031 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.946902    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9" event={"ID":"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6","Type":"ContainerDied","Data":"284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b"}
Jul 24 16:46:07.947086 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.947040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9" event={"ID":"0292517d-8e0b-4f31-834b-b0f5eb3ebbe6","Type":"ContainerDied","Data":"93f63855842892f43db53f958c055a79438517f2bc7d853757030e80c7bbecd4"}
Jul 24 16:46:07.952838 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.952821    2561 scope.go:117] "RemoveContainer" containerID="11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba"
Jul 24 16:46:07.953912 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:46:07.953738    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba\": container with ID starting with 11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba not found: ID does not exist" containerID="11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba"
Jul 24 16:46:07.953912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.953773    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba"} err="failed to get container status \"11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba\": rpc error: code = NotFound desc = could not find container \"11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba\": container with ID starting with 11717d5b9c334515e1eb5365ad5331357d19d3e03010b18e391cf46c2b2675ba not found: ID does not exist"
Jul 24 16:46:07.953912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.953798    2561 scope.go:117] "RemoveContainer" containerID="a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91"
Jul 24 16:46:07.967452 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.967432    2561 scope.go:117] "RemoveContainer" containerID="a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91"
Jul 24 16:46:07.967707 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.967684    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"]
Jul 24 16:46:07.967782 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:46:07.967736    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91\": container with ID starting with a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91 not found: ID does not exist" containerID="a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91"
Jul 24 16:46:07.967782 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.967767    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91"} err="failed to get container status \"a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91\": rpc error: code = NotFound desc = could not find container \"a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91\": container with ID starting with a34cca953407052a25de5ebdc7d22412171119334826ff56a13ab7fb10152b91 not found: ID does not exist"
Jul 24 16:46:07.967897 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.967788    2561 scope.go:117] "RemoveContainer" containerID="284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b"
Jul 24 16:46:07.973445 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.973427    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4ef934-6c9ff49c6d-rh49c"]
Jul 24 16:46:07.975697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.975679    2561 scope.go:117] "RemoveContainer" containerID="284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b"
Jul 24 16:46:07.975948 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:46:07.975930    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b\": container with ID starting with 284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b not found: ID does not exist" containerID="284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b"
Jul 24 16:46:07.975998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.975954    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b"} err="failed to get container status \"284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b\": rpc error: code = NotFound desc = could not find container \"284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b\": container with ID starting with 284ce71a002c7c162767fdc018ea34cf33e699af919e2bb74a62f020ebc4d45b not found: ID does not exist"
Jul 24 16:46:07.983031 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.983009    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"]
Jul 24 16:46:07.984788 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.984767    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4ef934-78d4d89bc5-kvgbb"]
Jul 24 16:46:07.993884 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.993864    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"]
Jul 24 16:46:07.996005 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:07.995986    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ef934-864ffd98b4-tszh9"]
Jul 24 16:46:08.506712 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:08.506681    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0292517d-8e0b-4f31-834b-b0f5eb3ebbe6" path="/var/lib/kubelet/pods/0292517d-8e0b-4f31-834b-b0f5eb3ebbe6/volumes"
Jul 24 16:46:08.507071 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:08.507027    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d288f528-c1bd-4623-9aac-ce1e0988ec55" path="/var/lib/kubelet/pods/d288f528-c1bd-4623-9aac-ce1e0988ec55/volumes"
Jul 24 16:46:08.507362 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:08.507348    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffd76101-8b6e-45c3-a369-e888b1e7677d" path="/var/lib/kubelet/pods/ffd76101-8b6e-45c3-a369-e888b1e7677d/volumes"
Jul 24 16:46:11.927903 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:11.927864    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"]
Jul 24 16:46:11.930059 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:11.930040    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4ef934-nmz6r"]
Jul 24 16:46:12.248409 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:12.248328    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:46:12.507516 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:12.507439    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a3accad-974a-49d7-9633-8de4984830de" path="/var/lib/kubelet/pods/0a3accad-974a-49d7-9633-8de4984830de/volumes"
Jul 24 16:46:22.075309 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075278    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"]
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075532    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0292517d-8e0b-4f31-834b-b0f5eb3ebbe6" containerName="payload-processing"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075544    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0292517d-8e0b-4f31-834b-b0f5eb3ebbe6" containerName="payload-processing"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075556    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd76101-8b6e-45c3-a369-e888b1e7677d" containerName="maas-api"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075562    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd76101-8b6e-45c3-a369-e888b1e7677d" containerName="maas-api"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075568    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3accad-974a-49d7-9633-8de4984830de" containerName="revoke-keys"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075573    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3accad-974a-49d7-9633-8de4984830de" containerName="revoke-keys"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075582    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d288f528-c1bd-4623-9aac-ce1e0988ec55" containerName="payload-pre-processing"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075587    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d288f528-c1bd-4623-9aac-ce1e0988ec55" containerName="payload-pre-processing"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075659    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffd76101-8b6e-45c3-a369-e888b1e7677d" containerName="maas-api"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075671    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0292517d-8e0b-4f31-834b-b0f5eb3ebbe6" containerName="payload-processing"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075681    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d288f528-c1bd-4623-9aac-ce1e0988ec55" containerName="payload-pre-processing"
Jul 24 16:46:22.075702 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.075689    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3accad-974a-49d7-9633-8de4984830de" containerName="revoke-keys"
Jul 24 16:46:22.084120 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.079665    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.084120 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.082389    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w22br\""
Jul 24 16:46:22.084120 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.082907    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:46:22.084120 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.083160    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a65dee-serving-cert\""
Jul 24 16:46:22.084120 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.083381    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:46:22.091513 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.091488    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"]
Jul 24 16:46:22.191868 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.191823    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4adc04ad-f2b5-4fad-886f-95cc57fda817-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.192043 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.191910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4adc04ad-f2b5-4fad-886f-95cc57fda817-maas-api-tls\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.192043 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.191946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqhmz\" (UniqueName: \"kubernetes.io/projected/4adc04ad-f2b5-4fad-886f-95cc57fda817-kube-api-access-dqhmz\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.293094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.293054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4adc04ad-f2b5-4fad-886f-95cc57fda817-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.293266 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.293106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4adc04ad-f2b5-4fad-886f-95cc57fda817-maas-api-tls\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.293266 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.293136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqhmz\" (UniqueName: \"kubernetes.io/projected/4adc04ad-f2b5-4fad-886f-95cc57fda817-kube-api-access-dqhmz\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.293266 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:46:22.293223    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-serving-cert: secret "maas-api-e2e-shared-a-a65dee-serving-cert" not found
Jul 24 16:46:22.293382 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:46:22.293304    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4adc04ad-f2b5-4fad-886f-95cc57fda817-maas-api-tls podName:4adc04ad-f2b5-4fad-886f-95cc57fda817 nodeName:}" failed. No retries permitted until 2026-07-24 16:46:22.793283167 +0000 UTC m=+2416.777973926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4adc04ad-f2b5-4fad-886f-95cc57fda817-maas-api-tls") pod "maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r" (UID: "4adc04ad-f2b5-4fad-886f-95cc57fda817") : secret "maas-api-e2e-shared-a-a65dee-serving-cert" not found
Jul 24 16:46:22.293815 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.293795    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4adc04ad-f2b5-4fad-886f-95cc57fda817-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.303445 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.303423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqhmz\" (UniqueName: \"kubernetes.io/projected/4adc04ad-f2b5-4fad-886f-95cc57fda817-kube-api-access-dqhmz\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.798159 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.798130    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4adc04ad-f2b5-4fad-886f-95cc57fda817-maas-api-tls\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.800784 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.800757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4adc04ad-f2b5-4fad-886f-95cc57fda817-maas-api-tls\") pod \"maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.878708 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.878674    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"]
Jul 24 16:46:22.882027 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.882008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:22.884781 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.884761    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-a65dee\""
Jul 24 16:46:22.893107 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.893086    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"]
Jul 24 16:46:22.898618 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.898599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/413bae06-a73b-4b6c-b0eb-3b0e648b661d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq\" (UID: \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:22.898719 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.898628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlrd8\" (UniqueName: \"kubernetes.io/projected/413bae06-a73b-4b6c-b0eb-3b0e648b661d-kube-api-access-mlrd8\") pod \"payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq\" (UID: \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:22.910783 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.910763    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"]
Jul 24 16:46:22.913623 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.913608    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:22.915838 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.915820    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-a65dee-dockercfg-8v56z\""
Jul 24 16:46:22.924013 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.923994    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"]
Jul 24 16:46:22.994624 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.994595    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:22.999979 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:22.999948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb\" (UID: \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:23.000106 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.000009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/413bae06-a73b-4b6c-b0eb-3b0e648b661d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq\" (UID: \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:23.000106 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.000046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlrd8\" (UniqueName: \"kubernetes.io/projected/413bae06-a73b-4b6c-b0eb-3b0e648b661d-kube-api-access-mlrd8\") pod \"payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq\" (UID: \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:23.000106 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.000071    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nd8q\" (UniqueName: \"kubernetes.io/projected/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-kube-api-access-6nd8q\") pod \"payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb\" (UID: \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:23.000883 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.000853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/413bae06-a73b-4b6c-b0eb-3b0e648b661d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq\" (UID: \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:23.008427 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.008400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlrd8\" (UniqueName: \"kubernetes.io/projected/413bae06-a73b-4b6c-b0eb-3b0e648b661d-kube-api-access-mlrd8\") pod \"payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq\" (UID: \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:23.101475 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.101441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb\" (UID: \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:23.101839 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.101525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nd8q\" (UniqueName: \"kubernetes.io/projected/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-kube-api-access-6nd8q\") pod \"payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb\" (UID: \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:23.102244 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.102222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb\" (UID: \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:23.109786 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.109764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nd8q\" (UniqueName: \"kubernetes.io/projected/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-kube-api-access-6nd8q\") pod \"payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb\" (UID: \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:23.126473 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.126439    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"]
Jul 24 16:46:23.128625 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:46:23.128601    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4adc04ad_f2b5_4fad_886f_95cc57fda817.slice/crio-de51990e0050922b2289452d1e531f5d1fc3172ce3130ea177576ffac382ea39 WatchSource:0}: Error finding container de51990e0050922b2289452d1e531f5d1fc3172ce3130ea177576ffac382ea39: Status 404 returned error can't find the container with id de51990e0050922b2289452d1e531f5d1fc3172ce3130ea177576ffac382ea39
Jul 24 16:46:23.192864 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.192838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:23.223705 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.223683    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:23.343019 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.342923    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"]
Jul 24 16:46:23.347433 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:46:23.347397    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413bae06_a73b_4b6c_b0eb_3b0e648b661d.slice/crio-8053625ca19a5d747a2c4f5f2d2317888b7d0bdf9125ee2ea8ef574b045253f4 WatchSource:0}: Error finding container 8053625ca19a5d747a2c4f5f2d2317888b7d0bdf9125ee2ea8ef574b045253f4: Status 404 returned error can't find the container with id 8053625ca19a5d747a2c4f5f2d2317888b7d0bdf9125ee2ea8ef574b045253f4
Jul 24 16:46:23.361219 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:23.361197    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"]
Jul 24 16:46:23.364696 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:46:23.364669    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee64e6e6_1504_4ebc_8b5f_062b2d851f2f.slice/crio-474447c80079e5edde4d86d116c7e22720faa8bc547e487870d1769fb42f64c0 WatchSource:0}: Error finding container 474447c80079e5edde4d86d116c7e22720faa8bc547e487870d1769fb42f64c0: Status 404 returned error can't find the container with id 474447c80079e5edde4d86d116c7e22720faa8bc547e487870d1769fb42f64c0
Jul 24 16:46:24.030243 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.030204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq" event={"ID":"413bae06-a73b-4b6c-b0eb-3b0e648b661d","Type":"ContainerStarted","Data":"27f74ed9f71fd5fe22059ea598422595423c900638d669feed6e079255ec7271"}
Jul 24 16:46:24.030422 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.030267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq" event={"ID":"413bae06-a73b-4b6c-b0eb-3b0e648b661d","Type":"ContainerStarted","Data":"8053625ca19a5d747a2c4f5f2d2317888b7d0bdf9125ee2ea8ef574b045253f4"}
Jul 24 16:46:24.030422 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.030312    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:24.032449 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.032273    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb" event={"ID":"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f","Type":"ContainerStarted","Data":"9e47aadf0e5b53019cacad4a749d921dd3320710f1972e154ca458c0799ce9b4"}
Jul 24 16:46:24.032449 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.032322    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:24.032449 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.032347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb" event={"ID":"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f","Type":"ContainerStarted","Data":"474447c80079e5edde4d86d116c7e22720faa8bc547e487870d1769fb42f64c0"}
Jul 24 16:46:24.034159 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.034134    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r" event={"ID":"4adc04ad-f2b5-4fad-886f-95cc57fda817","Type":"ContainerStarted","Data":"1d7cbe43d36bffef3fae1ba1fe174a7892810ba76cb088f73ddbb14a58f3fafe"}
Jul 24 16:46:24.034292 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.034181    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r" event={"ID":"4adc04ad-f2b5-4fad-886f-95cc57fda817","Type":"ContainerStarted","Data":"de51990e0050922b2289452d1e531f5d1fc3172ce3130ea177576ffac382ea39"}
Jul 24 16:46:24.034292 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.034211    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:24.045019 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.044980    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq" podStartSLOduration=2.044968611 podStartE2EDuration="2.044968611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:46:24.044068279 +0000 UTC m=+2418.028759064" watchObservedRunningTime="2026-07-24 16:46:24.044968611 +0000 UTC m=+2418.029659392"
Jul 24 16:46:24.060466 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.060389    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r" podStartSLOduration=1.382617424 podStartE2EDuration="2.060372244s" totalImagesPullingTime="677.75482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:46:24.058423602 +0000 UTC m=+2418.043114413" watchObservedRunningTime="2026-07-24 16:46:24.060372244 +0000 UTC m=+2418.045063007"
Jul 24 16:46:24.074207 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:24.074163    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb" podStartSLOduration=2.074151299 podStartE2EDuration="2.074151299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:46:24.072394824 +0000 UTC m=+2418.057085612" watchObservedRunningTime="2026-07-24 16:46:24.074151299 +0000 UTC m=+2418.058842080"
Jul 24 16:46:30.045454 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.045380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:46:30.243566 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.243515    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:46:30.255008 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.254981    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"]
Jul 24 16:46:30.258493 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.258473    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.261556 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.261535    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-a29da6-serving-cert\""
Jul 24 16:46:30.275305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.275281    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"]
Jul 24 16:46:30.362244 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.362212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-maas-api-tls\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.362413 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.362324    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l8lw\" (UniqueName: \"kubernetes.io/projected/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-kube-api-access-4l8lw\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.362486 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.362465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.463482 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.463447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-maas-api-tls\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.463703 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.463495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l8lw\" (UniqueName: \"kubernetes.io/projected/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-kube-api-access-4l8lw\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.463703 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.463527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.463703 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:46:30.463630    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-serving-cert: secret "maas-api-e2e-shared-b-a29da6-serving-cert" not found
Jul 24 16:46:30.463900 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:46:30.463733    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-maas-api-tls podName:f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2 nodeName:}" failed. No retries permitted until 2026-07-24 16:46:30.963712444 +0000 UTC m=+2424.948403203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-maas-api-tls") pod "maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d" (UID: "f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2") : secret "maas-api-e2e-shared-b-a29da6-serving-cert" not found
Jul 24 16:46:30.464104 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.464087    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.472289 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.472266    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l8lw\" (UniqueName: \"kubernetes.io/projected/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-kube-api-access-4l8lw\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.923807 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.923772    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"]
Jul 24 16:46:30.927694 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.927675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:30.930055 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.930034    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-a29da6\""
Jul 24 16:46:30.940098 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.940075    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"]
Jul 24 16:46:30.966748 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.966716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfqqq\" (UniqueName: \"kubernetes.io/projected/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-kube-api-access-mfqqq\") pod \"payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b\" (UID: \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:30.966873 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.966777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-maas-api-tls\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.966873 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.966835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b\" (UID: \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:30.969358 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.969333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-maas-api-tls\") pod \"maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:30.980055 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.980033    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"]
Jul 24 16:46:30.983437 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.983422    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:30.986316 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.986295    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-a29da6-dockercfg-87fks\""
Jul 24 16:46:30.994395 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:30.994373    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"]
Jul 24 16:46:31.067386 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.067356    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfqqq\" (UniqueName: \"kubernetes.io/projected/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-kube-api-access-mfqqq\") pod \"payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b\" (UID: \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:31.067790 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.067454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b\" (UID: \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:31.067790 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.067494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db0cf7b-f588-4a26-81ca-62f64ae6e893-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g\" (UID: \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:31.067790 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.067525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwtth\" (UniqueName: \"kubernetes.io/projected/0db0cf7b-f588-4a26-81ca-62f64ae6e893-kube-api-access-bwtth\") pod \"payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g\" (UID: \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:31.068162 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.068143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b\" (UID: \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:31.078051 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.078023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfqqq\" (UniqueName: \"kubernetes.io/projected/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-kube-api-access-mfqqq\") pod \"payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b\" (UID: \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:31.168286 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.168245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db0cf7b-f588-4a26-81ca-62f64ae6e893-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g\" (UID: \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:31.168458 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.168292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwtth\" (UniqueName: \"kubernetes.io/projected/0db0cf7b-f588-4a26-81ca-62f64ae6e893-kube-api-access-bwtth\") pod \"payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g\" (UID: \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:31.168458 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.168315    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:31.169010 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.168992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db0cf7b-f588-4a26-81ca-62f64ae6e893-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g\" (UID: \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:31.177137 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.177080    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwtth\" (UniqueName: \"kubernetes.io/projected/0db0cf7b-f588-4a26-81ca-62f64ae6e893-kube-api-access-bwtth\") pod \"payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g\" (UID: \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:31.238249 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.238209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:31.294626 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.294361    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:31.302357 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.302332    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"]
Jul 24 16:46:31.306791 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:46:31.306761    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69b103a_4c4b_4c8d_86cd_f30ebe32a2b2.slice/crio-1a6adf613a0ebca203a7435801143efb31c498a3d25b53b21885224026d503d3 WatchSource:0}: Error finding container 1a6adf613a0ebca203a7435801143efb31c498a3d25b53b21885224026d503d3: Status 404 returned error can't find the container with id 1a6adf613a0ebca203a7435801143efb31c498a3d25b53b21885224026d503d3
Jul 24 16:46:31.384914 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.384882    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"]
Jul 24 16:46:31.386746 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:46:31.386719    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea9e6a3_5d2f_4b4d_9418_66d61fbfc062.slice/crio-74537a973e6be223311c70d1b4f5a313f5609ed44b7eade2c082a0519e1176d2 WatchSource:0}: Error finding container 74537a973e6be223311c70d1b4f5a313f5609ed44b7eade2c082a0519e1176d2: Status 404 returned error can't find the container with id 74537a973e6be223311c70d1b4f5a313f5609ed44b7eade2c082a0519e1176d2
Jul 24 16:46:31.444950 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:31.444926    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"]
Jul 24 16:46:31.446447 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:46:31.446422    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db0cf7b_f588_4a26_81ca_62f64ae6e893.slice/crio-abd89c9c6a0411cc7fb8f2d30dae342fc50bca166d4199ac56d7acc32b101dc5 WatchSource:0}: Error finding container abd89c9c6a0411cc7fb8f2d30dae342fc50bca166d4199ac56d7acc32b101dc5: Status 404 returned error can't find the container with id abd89c9c6a0411cc7fb8f2d30dae342fc50bca166d4199ac56d7acc32b101dc5
Jul 24 16:46:32.074779 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.074676    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g" event={"ID":"0db0cf7b-f588-4a26-81ca-62f64ae6e893","Type":"ContainerStarted","Data":"70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1"}
Jul 24 16:46:32.074779 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.074737    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g" event={"ID":"0db0cf7b-f588-4a26-81ca-62f64ae6e893","Type":"ContainerStarted","Data":"abd89c9c6a0411cc7fb8f2d30dae342fc50bca166d4199ac56d7acc32b101dc5"}
Jul 24 16:46:32.075264 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.074784    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:32.076508 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.076475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d" event={"ID":"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2","Type":"ContainerStarted","Data":"bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a"}
Jul 24 16:46:32.076678 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.076519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d" event={"ID":"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2","Type":"ContainerStarted","Data":"1a6adf613a0ebca203a7435801143efb31c498a3d25b53b21885224026d503d3"}
Jul 24 16:46:32.076678 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.076541    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:32.078069 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.078046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b" event={"ID":"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062","Type":"ContainerStarted","Data":"31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c"}
Jul 24 16:46:32.078177 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.078091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b" event={"ID":"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062","Type":"ContainerStarted","Data":"74537a973e6be223311c70d1b4f5a313f5609ed44b7eade2c082a0519e1176d2"}
Jul 24 16:46:32.078177 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.078124    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:32.091725 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.091681    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g" podStartSLOduration=2.091665822 podStartE2EDuration="2.091665822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:46:32.09010384 +0000 UTC m=+2426.074794625" watchObservedRunningTime="2026-07-24 16:46:32.091665822 +0000 UTC m=+2426.076356605"
Jul 24 16:46:32.105212 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.105171    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b" podStartSLOduration=2.105155198 podStartE2EDuration="2.105155198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:46:32.104380102 +0000 UTC m=+2426.089070876" watchObservedRunningTime="2026-07-24 16:46:32.105155198 +0000 UTC m=+2426.089845980"
Jul 24 16:46:32.119799 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:32.119757    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d" podStartSLOduration=1.708698322 podStartE2EDuration="2.119744236s" totalImagesPullingTime="411.045914ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:46:32.118622663 +0000 UTC m=+2426.103313462" watchObservedRunningTime="2026-07-24 16:46:32.119744236 +0000 UTC m=+2426.104435017"
Jul 24 16:46:35.042049 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:35.042014    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:46:35.042506 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:35.042099    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:46:38.088744 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:38.088711    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:46:43.085024 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:43.084989    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:46:43.085562 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:43.085152    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:46:44.546048 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:44.546006    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:46:53.945425 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:46:53.945394    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:47:06.740335 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:47:06.740301    2561 scope.go:117] "RemoveContainer" containerID="ccd29d1a674b55bd1d115e305699aa0861f9f49ad2f48428e38d31b047a06d05"
Jul 24 16:47:24.340385 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:47:24.340344    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:47:47.066514 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:47:47.066471    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:48:05.555925 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:48:05.555850    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:48:20.053293 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:48:20.053256    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:48:39.253255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:48:39.253218    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:48:58.643439 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:48:58.643408    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:49:17.246601 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:49:17.246567    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:49:36.647202 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:49:36.647125    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:49:54.054379 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:49:54.054345    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:50:14.247619 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:50:14.247580    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:50:33.541989 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:50:33.541955    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:50:50.848928 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:50:50.848890    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:51:01.638138 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.638046    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"]
Jul 24 16:51:01.641955 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.641930    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.644502 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.644477    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a65dee\"/\"kube-root-ca.crt\""
Jul 24 16:51:01.644615 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.644505    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a65dee\"/\"openshift-service-ca.crt\""
Jul 24 16:51:01.645922 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.645757    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a65dee\"/\"default-dockercfg-g2wt4\""
Jul 24 16:51:01.645922 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.645905    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a65dee\"/\"rate-test-model-a65dee-kserve-self-signed-certs\""
Jul 24 16:51:01.652986 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.652963    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"]
Jul 24 16:51:01.764376 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.764341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd065aae-bb06-41dd-a723-051e9324d1f7-tls-certs\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.764554 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.764383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-model-cache\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.764554 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.764403    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-tmp-dir\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.764554 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.764468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-dshm\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.764554 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.764536    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-home\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.764737 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.764558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vxmf\" (UniqueName: \"kubernetes.io/projected/bd065aae-bb06-41dd-a723-051e9324d1f7-kube-api-access-6vxmf\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.865740 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.865697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-model-cache\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.865740 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.865744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-tmp-dir\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.865977 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.865764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-dshm\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.865977 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.865821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-home\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.865977 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.865851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vxmf\" (UniqueName: \"kubernetes.io/projected/bd065aae-bb06-41dd-a723-051e9324d1f7-kube-api-access-6vxmf\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.865977 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.865950    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd065aae-bb06-41dd-a723-051e9324d1f7-tls-certs\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.866169 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.866140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-model-cache\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.866230 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.866188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-tmp-dir\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.866230 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.866212    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-home\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.868223 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.868203    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-dshm\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.868490 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.868470    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd065aae-bb06-41dd-a723-051e9324d1f7-tls-certs\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.874012 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.873991    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vxmf\" (UniqueName: \"kubernetes.io/projected/bd065aae-bb06-41dd-a723-051e9324d1f7-kube-api-access-6vxmf\") pod \"rate-test-model-a65dee-kserve-77b9d4988c-7l8cx\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") " pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:01.952545 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:01.952474    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:02.082739 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:02.082712    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"]
Jul 24 16:51:02.084138 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:51:02.084103    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd065aae_bb06_41dd_a723_051e9324d1f7.slice/crio-d1a5f91509ee89e3dcfe7237c696b96c729efddea2a38d4e3a6c359f71d8d25c WatchSource:0}: Error finding container d1a5f91509ee89e3dcfe7237c696b96c729efddea2a38d4e3a6c359f71d8d25c: Status 404 returned error can't find the container with id d1a5f91509ee89e3dcfe7237c696b96c729efddea2a38d4e3a6c359f71d8d25c
Jul 24 16:51:02.386819 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:02.386788    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx" event={"ID":"bd065aae-bb06-41dd-a723-051e9324d1f7","Type":"ContainerStarted","Data":"dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e"}
Jul 24 16:51:02.386996 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:02.386826    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx" event={"ID":"bd065aae-bb06-41dd-a723-051e9324d1f7","Type":"ContainerStarted","Data":"d1a5f91509ee89e3dcfe7237c696b96c729efddea2a38d4e3a6c359f71d8d25c"}
Jul 24 16:51:02.403478 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:02.403432    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx" podStartSLOduration=1.4034174799999999 podStartE2EDuration="1.40341748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:51:02.402817744 +0000 UTC m=+2696.387508527" watchObservedRunningTime="2026-07-24 16:51:02.40341748 +0000 UTC m=+2696.388108261"
Jul 24 16:51:06.790368 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:06.790336    2561 scope.go:117] "RemoveContainer" containerID="c7c72486a85f8c3a919c7e919d52c3bf48d657c63282105a716fc1ca7c064a5f"
Jul 24 16:51:10.449825 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:10.449794    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:51:11.953105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:11.953059    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:11.953105 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:11.953115    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:11.965449 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:11.965425    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:12.448697 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:12.448667    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:51:30.542770 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:30.542737    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:51:45.253277 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:51:45.253240    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:52:06.809047 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:06.809013    2561 scope.go:117] "RemoveContainer" containerID="f5f80c324971fbd81eed65e028f593d27c3f74c91078dd21a95493e442c2079c"
Jul 24 16:52:07.654295 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:07.654260    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:52:11.694794 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:11.694746    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"]
Jul 24 16:52:23.265935 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:23.265895    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:52:26.713701 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:26.713634    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx" podUID="bd065aae-bb06-41dd-a723-051e9324d1f7" containerName="main" containerID="cri-o://dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e" gracePeriod=45
Jul 24 16:52:26.959736 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:26.959714    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:52:27.078698 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.078583    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-dshm\") pod \"bd065aae-bb06-41dd-a723-051e9324d1f7\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") "
Jul 24 16:52:27.078698 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.078625    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd065aae-bb06-41dd-a723-051e9324d1f7-tls-certs\") pod \"bd065aae-bb06-41dd-a723-051e9324d1f7\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") "
Jul 24 16:52:27.078698 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.078683    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vxmf\" (UniqueName: \"kubernetes.io/projected/bd065aae-bb06-41dd-a723-051e9324d1f7-kube-api-access-6vxmf\") pod \"bd065aae-bb06-41dd-a723-051e9324d1f7\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") "
Jul 24 16:52:27.078978 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.078740    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-tmp-dir\") pod \"bd065aae-bb06-41dd-a723-051e9324d1f7\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") "
Jul 24 16:52:27.078978 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.078771    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-model-cache\") pod \"bd065aae-bb06-41dd-a723-051e9324d1f7\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") "
Jul 24 16:52:27.078978 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.078794    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-home\") pod \"bd065aae-bb06-41dd-a723-051e9324d1f7\" (UID: \"bd065aae-bb06-41dd-a723-051e9324d1f7\") "
Jul 24 16:52:27.079114 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.079015    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd065aae-bb06-41dd-a723-051e9324d1f7" (UID: "bd065aae-bb06-41dd-a723-051e9324d1f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:52:27.079114 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.079044    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd065aae-bb06-41dd-a723-051e9324d1f7" (UID: "bd065aae-bb06-41dd-a723-051e9324d1f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:52:27.079190 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.079108    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-home" (OuterVolumeSpecName: "home") pod "bd065aae-bb06-41dd-a723-051e9324d1f7" (UID: "bd065aae-bb06-41dd-a723-051e9324d1f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:52:27.081036 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.081016    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd065aae-bb06-41dd-a723-051e9324d1f7-kube-api-access-6vxmf" (OuterVolumeSpecName: "kube-api-access-6vxmf") pod "bd065aae-bb06-41dd-a723-051e9324d1f7" (UID: "bd065aae-bb06-41dd-a723-051e9324d1f7"). InnerVolumeSpecName "kube-api-access-6vxmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:52:27.081271 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.081255    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-dshm" (OuterVolumeSpecName: "dshm") pod "bd065aae-bb06-41dd-a723-051e9324d1f7" (UID: "bd065aae-bb06-41dd-a723-051e9324d1f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:52:27.081271 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.081259    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd065aae-bb06-41dd-a723-051e9324d1f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd065aae-bb06-41dd-a723-051e9324d1f7" (UID: "bd065aae-bb06-41dd-a723-051e9324d1f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:52:27.179734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.179699    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-tmp-dir\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:52:27.179734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.179727    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-model-cache\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:52:27.179734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.179736    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-home\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:52:27.179734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.179743    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd065aae-bb06-41dd-a723-051e9324d1f7-dshm\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:52:27.180002 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.179750    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd065aae-bb06-41dd-a723-051e9324d1f7-tls-certs\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:52:27.180002 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.179758    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vxmf\" (UniqueName: \"kubernetes.io/projected/bd065aae-bb06-41dd-a723-051e9324d1f7-kube-api-access-6vxmf\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:52:27.801145 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.801112    2561 generic.go:356] "Generic (PLEG): container finished" podID="bd065aae-bb06-41dd-a723-051e9324d1f7" containerID="dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e" exitCode=0
Jul 24 16:52:27.801538 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.801154    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"
Jul 24 16:52:27.801538 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.801196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx" event={"ID":"bd065aae-bb06-41dd-a723-051e9324d1f7","Type":"ContainerDied","Data":"dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e"}
Jul 24 16:52:27.801538 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.801242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx" event={"ID":"bd065aae-bb06-41dd-a723-051e9324d1f7","Type":"ContainerDied","Data":"d1a5f91509ee89e3dcfe7237c696b96c729efddea2a38d4e3a6c359f71d8d25c"}
Jul 24 16:52:27.801538 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.801258    2561 scope.go:117] "RemoveContainer" containerID="dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e"
Jul 24 16:52:27.810018 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.810004    2561 scope.go:117] "RemoveContainer" containerID="dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e"
Jul 24 16:52:27.810246 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:52:27.810227    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e\": container with ID starting with dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e not found: ID does not exist" containerID="dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e"
Jul 24 16:52:27.810295 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.810254    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e"} err="failed to get container status \"dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e\": rpc error: code = NotFound desc = could not find container \"dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e\": container with ID starting with dade8edced46d5eb80d0a46a5f4d2eff65000fa06f5f15f7c86dc155850ecf9e not found: ID does not exist"
Jul 24 16:52:27.821389 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.821368    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"]
Jul 24 16:52:27.825529 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:27.825508    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/rate-test-model-a65dee-kserve-77b9d4988c-7l8cx"]
Jul 24 16:52:28.507129 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:28.507094    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd065aae-bb06-41dd-a723-051e9324d1f7" path="/var/lib/kubelet/pods/bd065aae-bb06-41dd-a723-051e9324d1f7/volumes"
Jul 24 16:52:35.234199 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.234156    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"]
Jul 24 16:52:35.234550 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.234479    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd065aae-bb06-41dd-a723-051e9324d1f7" containerName="main"
Jul 24 16:52:35.234550 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.234492    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd065aae-bb06-41dd-a723-051e9324d1f7" containerName="main"
Jul 24 16:52:35.234628 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.234557    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd065aae-bb06-41dd-a723-051e9324d1f7" containerName="main"
Jul 24 16:52:35.238898 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.238878    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.241195 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.241177    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-b04709-serving-cert\""
Jul 24 16:52:35.251335 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.251308    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"]
Jul 24 16:52:35.348985 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.348947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjs62\" (UniqueName: \"kubernetes.io/projected/00d506dc-ce26-4ea6-bdf8-195d0752e190-kube-api-access-jjs62\") pod \"maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.349178 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.348997    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d506dc-ce26-4ea6-bdf8-195d0752e190-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.349178 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.349081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d506dc-ce26-4ea6-bdf8-195d0752e190-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.450210 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.450173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d506dc-ce26-4ea6-bdf8-195d0752e190-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.450383 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.450236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d506dc-ce26-4ea6-bdf8-195d0752e190-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.450383 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.450294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjs62\" (UniqueName: \"kubernetes.io/projected/00d506dc-ce26-4ea6-bdf8-195d0752e190-kube-api-access-jjs62\") pod \"maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.450927 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.450907    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d506dc-ce26-4ea6-bdf8-195d0752e190-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.452833 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.452803    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d506dc-ce26-4ea6-bdf8-195d0752e190-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.459614 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.459585    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjs62\" (UniqueName: \"kubernetes.io/projected/00d506dc-ce26-4ea6-bdf8-195d0752e190-kube-api-access-jjs62\") pod \"maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.552403 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.552340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:35.684032 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.683879    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"]
Jul 24 16:52:35.686392 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:52:35.686353    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d506dc_ce26_4ea6_bdf8_195d0752e190.slice/crio-e62b37477d5c04e0552fcc454b146a1e998d59148fefe5cc886af4345f858af6 WatchSource:0}: Error finding container e62b37477d5c04e0552fcc454b146a1e998d59148fefe5cc886af4345f858af6: Status 404 returned error can't find the container with id e62b37477d5c04e0552fcc454b146a1e998d59148fefe5cc886af4345f858af6
Jul 24 16:52:35.687779 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.687763    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:52:35.840662 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.840571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj" event={"ID":"00d506dc-ce26-4ea6-bdf8-195d0752e190","Type":"ContainerStarted","Data":"e62b37477d5c04e0552fcc454b146a1e998d59148fefe5cc886af4345f858af6"}
Jul 24 16:52:35.923778 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.923742    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"]
Jul 24 16:52:35.928040 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.928023    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:35.931176 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.931154    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b04709-dockercfg-j5wf7\""
Jul 24 16:52:35.931298 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.931158    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b04709\""
Jul 24 16:52:35.942083 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:35.942057    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"]
Jul 24 16:52:36.055017 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.054987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt\" (UID: \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:36.055197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.055023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwxsn\" (UniqueName: \"kubernetes.io/projected/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-kube-api-access-vwxsn\") pod \"payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt\" (UID: \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:36.155628 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.155596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt\" (UID: \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:36.155766 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.155671    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwxsn\" (UniqueName: \"kubernetes.io/projected/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-kube-api-access-vwxsn\") pod \"payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt\" (UID: \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:36.156328 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.156310    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt\" (UID: \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:36.167076 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.167050    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwxsn\" (UniqueName: \"kubernetes.io/projected/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-kube-api-access-vwxsn\") pod \"payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt\" (UID: \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:36.239423 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.239397    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:36.368694 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.368664    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"]
Jul 24 16:52:36.370154 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:52:36.370128    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb787668c_3c12_4f6d_ac8f_5d5dbeb6bfc3.slice/crio-f6274202b3af736980d1165a091b5370c8522b58781745e528b3f2ed6f8ec4c8 WatchSource:0}: Error finding container f6274202b3af736980d1165a091b5370c8522b58781745e528b3f2ed6f8ec4c8: Status 404 returned error can't find the container with id f6274202b3af736980d1165a091b5370c8522b58781745e528b3f2ed6f8ec4c8
Jul 24 16:52:36.847216 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.847183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj" event={"ID":"00d506dc-ce26-4ea6-bdf8-195d0752e190","Type":"ContainerStarted","Data":"9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be"}
Jul 24 16:52:36.847416 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.847349    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:36.848661 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.848625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt" event={"ID":"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3","Type":"ContainerStarted","Data":"1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7"}
Jul 24 16:52:36.848766 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.848687    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:36.848766 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.848705    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt" event={"ID":"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3","Type":"ContainerStarted","Data":"f6274202b3af736980d1165a091b5370c8522b58781745e528b3f2ed6f8ec4c8"}
Jul 24 16:52:36.864137 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.864093    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj" podStartSLOduration=1.4118209099999999 podStartE2EDuration="1.864080716s" totalImagesPullingTime="452.259806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:36.862573979 +0000 UTC m=+2790.847264761" watchObservedRunningTime="2026-07-24 16:52:36.864080716 +0000 UTC m=+2790.848771497"
Jul 24 16:52:36.877360 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:36.877314    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt" podStartSLOduration=1.877301459 podStartE2EDuration="1.877301459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:36.875873669 +0000 UTC m=+2790.860564450" watchObservedRunningTime="2026-07-24 16:52:36.877301459 +0000 UTC m=+2790.861992241"
Jul 24 16:52:42.860156 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:42.860124    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:52:44.243192 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:44.243154    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:52:47.857074 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:47.857048    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:52:54.420046 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.420007    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"]
Jul 24 16:52:54.423963 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.423942    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.430779 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.430759    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-633b54-serving-cert\""
Jul 24 16:52:54.432301 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.432281    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"]
Jul 24 16:52:54.517632 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.517599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db8cab2-241a-4875-a5ea-03bfb56b6224-maas-api-tls\") pod \"maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.517632 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.517633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db8cab2-241a-4875-a5ea-03bfb56b6224-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.517854 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.517673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzvcb\" (UniqueName: \"kubernetes.io/projected/2db8cab2-241a-4875-a5ea-03bfb56b6224-kube-api-access-jzvcb\") pod \"maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.618358 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.618316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db8cab2-241a-4875-a5ea-03bfb56b6224-maas-api-tls\") pod \"maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.618358 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.618356    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db8cab2-241a-4875-a5ea-03bfb56b6224-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.618561 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.618374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzvcb\" (UniqueName: \"kubernetes.io/projected/2db8cab2-241a-4875-a5ea-03bfb56b6224-kube-api-access-jzvcb\") pod \"maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.619019 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.618987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db8cab2-241a-4875-a5ea-03bfb56b6224-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.620880 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.620856    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db8cab2-241a-4875-a5ea-03bfb56b6224-maas-api-tls\") pod \"maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.627651 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.627620    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzvcb\" (UniqueName: \"kubernetes.io/projected/2db8cab2-241a-4875-a5ea-03bfb56b6224-kube-api-access-jzvcb\") pod \"maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.737381 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.737304    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:54.878612 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.878578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"]
Jul 24 16:52:54.936082 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:54.936050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv" event={"ID":"2db8cab2-241a-4875-a5ea-03bfb56b6224","Type":"ContainerStarted","Data":"259af4420afe5aff8126617e3bf336a1c7b60aa2098f815077c435e74a841f7d"}
Jul 24 16:52:55.144375 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.144346    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"]
Jul 24 16:52:55.148862 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.148844    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:52:55.151149 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.151131    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-633b54\""
Jul 24 16:52:55.151309 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.151294    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-633b54-dockercfg-zc2r8\""
Jul 24 16:52:55.158517 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.158495    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"]
Jul 24 16:52:55.162222 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.162202    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"]
Jul 24 16:52:55.162316 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.162300    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:52:55.177718 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.177692    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"]
Jul 24 16:52:55.324615 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.324588    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2x2\" (UniqueName: \"kubernetes.io/projected/8f92356b-3ead-4695-a992-21afee47169b-kube-api-access-jt2x2\") pod \"payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj\" (UID: \"8f92356b-3ead-4695-a992-21afee47169b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:52:55.324746 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.324628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81b4e1c1-586b-43db-acfa-03502e9ef8dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm\" (UID: \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:52:55.324746 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.324665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqsmz\" (UniqueName: \"kubernetes.io/projected/81b4e1c1-586b-43db-acfa-03502e9ef8dd-kube-api-access-fqsmz\") pod \"payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm\" (UID: \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:52:55.324746 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.324727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f92356b-3ead-4695-a992-21afee47169b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj\" (UID: \"8f92356b-3ead-4695-a992-21afee47169b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:52:55.425851 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.425770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqsmz\" (UniqueName: \"kubernetes.io/projected/81b4e1c1-586b-43db-acfa-03502e9ef8dd-kube-api-access-fqsmz\") pod \"payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm\" (UID: \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:52:55.425851 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.425812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f92356b-3ead-4695-a992-21afee47169b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj\" (UID: \"8f92356b-3ead-4695-a992-21afee47169b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:52:55.426274 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.425911    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2x2\" (UniqueName: \"kubernetes.io/projected/8f92356b-3ead-4695-a992-21afee47169b-kube-api-access-jt2x2\") pod \"payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj\" (UID: \"8f92356b-3ead-4695-a992-21afee47169b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:52:55.426274 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.425942    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81b4e1c1-586b-43db-acfa-03502e9ef8dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm\" (UID: \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:52:55.426577 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.426555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f92356b-3ead-4695-a992-21afee47169b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj\" (UID: \"8f92356b-3ead-4695-a992-21afee47169b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:52:55.426632 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.426614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81b4e1c1-586b-43db-acfa-03502e9ef8dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm\" (UID: \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:52:55.441215 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.441192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2x2\" (UniqueName: \"kubernetes.io/projected/8f92356b-3ead-4695-a992-21afee47169b-kube-api-access-jt2x2\") pod \"payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj\" (UID: \"8f92356b-3ead-4695-a992-21afee47169b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:52:55.442590 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.442572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqsmz\" (UniqueName: \"kubernetes.io/projected/81b4e1c1-586b-43db-acfa-03502e9ef8dd-kube-api-access-fqsmz\") pod \"payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm\" (UID: \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:52:55.460451 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.460429    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:52:55.472423 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.472401    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:52:55.612950 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.612867    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"]
Jul 24 16:52:55.615473 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:52:55.615442    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b4e1c1_586b_43db_acfa_03502e9ef8dd.slice/crio-c965b5ae73cc390c44618f13028fcd5facd3e3ed4c62b119d136c08a30f6d694 WatchSource:0}: Error finding container c965b5ae73cc390c44618f13028fcd5facd3e3ed4c62b119d136c08a30f6d694: Status 404 returned error can't find the container with id c965b5ae73cc390c44618f13028fcd5facd3e3ed4c62b119d136c08a30f6d694
Jul 24 16:52:55.834467 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.834446    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"]
Jul 24 16:52:55.836832 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:52:55.836798    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f92356b_3ead_4695_a992_21afee47169b.slice/crio-cf8b00f021389aa39c8f11db022086f8d5ac108c76977fafa304693afa386d28 WatchSource:0}: Error finding container cf8b00f021389aa39c8f11db022086f8d5ac108c76977fafa304693afa386d28: Status 404 returned error can't find the container with id cf8b00f021389aa39c8f11db022086f8d5ac108c76977fafa304693afa386d28
Jul 24 16:52:55.942733 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.942620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm" event={"ID":"81b4e1c1-586b-43db-acfa-03502e9ef8dd","Type":"ContainerStarted","Data":"81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26"}
Jul 24 16:52:55.942733 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.942689    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm" event={"ID":"81b4e1c1-586b-43db-acfa-03502e9ef8dd","Type":"ContainerStarted","Data":"c965b5ae73cc390c44618f13028fcd5facd3e3ed4c62b119d136c08a30f6d694"}
Jul 24 16:52:55.942733 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.942711    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:52:55.944359 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.944323    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv" event={"ID":"2db8cab2-241a-4875-a5ea-03bfb56b6224","Type":"ContainerStarted","Data":"2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06"}
Jul 24 16:52:55.944502 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.944400    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:52:55.945951 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.945931    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj" event={"ID":"8f92356b-3ead-4695-a992-21afee47169b","Type":"ContainerStarted","Data":"c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d"}
Jul 24 16:52:55.946032 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.945964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj" event={"ID":"8f92356b-3ead-4695-a992-21afee47169b","Type":"ContainerStarted","Data":"cf8b00f021389aa39c8f11db022086f8d5ac108c76977fafa304693afa386d28"}
Jul 24 16:52:55.946102 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.946086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:52:55.961209 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.961160    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm" podStartSLOduration=0.961147367 podStartE2EDuration="961.147367ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:55.959168603 +0000 UTC m=+2809.943859406" watchObservedRunningTime="2026-07-24 16:52:55.961147367 +0000 UTC m=+2809.945838148"
Jul 24 16:52:55.978431 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.978388    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv" podStartSLOduration=1.60249344 podStartE2EDuration="1.978375166s" totalImagesPullingTime="375.881726ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:55.976254853 +0000 UTC m=+2809.960945666" watchObservedRunningTime="2026-07-24 16:52:55.978375166 +0000 UTC m=+2809.963065987"
Jul 24 16:52:55.992177 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:52:55.992129    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj" podStartSLOduration=0.992115457 podStartE2EDuration="992.115457ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:55.991467225 +0000 UTC m=+2809.976158032" watchObservedRunningTime="2026-07-24 16:52:55.992115457 +0000 UTC m=+2809.976806241"
Jul 24 16:53:01.958230 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:53:01.958196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:53:05.344418 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:53:05.344382    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:53:06.953306 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:53:06.953264    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm" podUID="81b4e1c1-586b-43db-acfa-03502e9ef8dd" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.67:9004: connect: connection refused"
Jul 24 16:53:06.953879 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:53:06.953823    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:53:16.952994 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:53:16.952962    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:53:26.175630 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:53:26.175601    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj_8f92356b-3ead-4695-a992-21afee47169b/payload-processing/0.log"
Jul 24 16:53:35.449166 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:53:35.449131    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:53:51.345291 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:53:51.345213    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:54:02.896134 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:02.896067    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj_8f92356b-3ead-4695-a992-21afee47169b/payload-processing/0.log"
Jul 24 16:54:08.907734 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:08.907696    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"]
Jul 24 16:54:08.911398 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:08.911382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:08.913581 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:08.913551    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-8c969d\""
Jul 24 16:54:08.913736 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:08.913721    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-8c969d-dockercfg-kqmlg\""
Jul 24 16:54:08.921823 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:08.921796    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"]
Jul 24 16:54:08.953881 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:08.953855    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzwz8\" (UniqueName: \"kubernetes.io/projected/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-kube-api-access-wzwz8\") pod \"payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv\" (UID: \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:08.954007 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:08.953900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv\" (UID: \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:09.035509 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.035477    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"]
Jul 24 16:54:09.038851 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.038832    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:09.049398 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.049374    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"]
Jul 24 16:54:09.055016 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.054990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv\" (UID: \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:09.055138 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.055105    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzwz8\" (UniqueName: \"kubernetes.io/projected/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-kube-api-access-wzwz8\") pod \"payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv\" (UID: \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:09.056136 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.056113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv\" (UID: \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:09.065350 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.065326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzwz8\" (UniqueName: \"kubernetes.io/projected/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-kube-api-access-wzwz8\") pod \"payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv\" (UID: \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:09.156435 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.156409    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11ae53a-a662-416b-821c-82876a05e362-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf\" (UID: \"b11ae53a-a662-416b-821c-82876a05e362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:09.156565 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.156453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdn6f\" (UniqueName: \"kubernetes.io/projected/b11ae53a-a662-416b-821c-82876a05e362-kube-api-access-sdn6f\") pod \"payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf\" (UID: \"b11ae53a-a662-416b-821c-82876a05e362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:09.223231 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.223148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:09.257676 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.257649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11ae53a-a662-416b-821c-82876a05e362-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf\" (UID: \"b11ae53a-a662-416b-821c-82876a05e362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:09.257799 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.257699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdn6f\" (UniqueName: \"kubernetes.io/projected/b11ae53a-a662-416b-821c-82876a05e362-kube-api-access-sdn6f\") pod \"payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf\" (UID: \"b11ae53a-a662-416b-821c-82876a05e362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:09.258283 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.258264    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11ae53a-a662-416b-821c-82876a05e362-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf\" (UID: \"b11ae53a-a662-416b-821c-82876a05e362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:09.265557 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.265530    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdn6f\" (UniqueName: \"kubernetes.io/projected/b11ae53a-a662-416b-821c-82876a05e362-kube-api-access-sdn6f\") pod \"payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf\" (UID: \"b11ae53a-a662-416b-821c-82876a05e362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:09.350041 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.350013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:09.357060 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.357036    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"]
Jul 24 16:54:09.702029 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:09.702006    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"]
Jul 24 16:54:09.704031 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:54:09.704004    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11ae53a_a662_416b_821c_82876a05e362.slice/crio-c1bab8940333418412840378747177b860201091ca5ce962ef5fdc83f24d2a31 WatchSource:0}: Error finding container c1bab8940333418412840378747177b860201091ca5ce962ef5fdc83f24d2a31: Status 404 returned error can't find the container with id c1bab8940333418412840378747177b860201091ca5ce962ef5fdc83f24d2a31
Jul 24 16:54:10.329714 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:10.329675    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv" event={"ID":"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2","Type":"ContainerStarted","Data":"36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195"}
Jul 24 16:54:10.330142 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:10.329739    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv" event={"ID":"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2","Type":"ContainerStarted","Data":"c3624169dd90b844bb55346b30a4a21c6fc9f362459c4b87f9bbbe51cb455691"}
Jul 24 16:54:10.330142 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:10.329769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:10.331698 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:10.331671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf" event={"ID":"b11ae53a-a662-416b-821c-82876a05e362","Type":"ContainerStarted","Data":"d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf"}
Jul 24 16:54:10.331808 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:10.331713    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf" event={"ID":"b11ae53a-a662-416b-821c-82876a05e362","Type":"ContainerStarted","Data":"c1bab8940333418412840378747177b860201091ca5ce962ef5fdc83f24d2a31"}
Jul 24 16:54:10.331808 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:10.331756    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:10.346271 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:10.346230    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv" podStartSLOduration=2.346214823 podStartE2EDuration="2.346214823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:54:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:54:10.344734836 +0000 UTC m=+2884.329425629" watchObservedRunningTime="2026-07-24 16:54:10.346214823 +0000 UTC m=+2884.330905657"
Jul 24 16:54:10.363014 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:10.362967    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf" podStartSLOduration=1.3629514679999999 podStartE2EDuration="1.362951468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:54:10.361508095 +0000 UTC m=+2884.346198875" watchObservedRunningTime="2026-07-24 16:54:10.362951468 +0000 UTC m=+2884.347642248"
Jul 24 16:54:12.441855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:12.441819    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:54:21.340347 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:21.340316    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:21.340807 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:21.340396    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:33.003505 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.003468    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"]
Jul 24 16:54:33.003976 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.003763    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf" podUID="b11ae53a-a662-416b-821c-82876a05e362" containerName="payload-processing" containerID="cri-o://d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf" gracePeriod=30
Jul 24 16:54:33.009402 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.009374    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"]
Jul 24 16:54:33.009675 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.009604    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv" podUID="eb5e8a2b-2573-48f5-8d5c-d1664c5472d2" containerName="payload-pre-processing" containerID="cri-o://36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195" gracePeriod=30
Jul 24 16:54:33.263447 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.263390    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:33.295036 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.295015    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:33.371516 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.371485    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdn6f\" (UniqueName: \"kubernetes.io/projected/b11ae53a-a662-416b-821c-82876a05e362-kube-api-access-sdn6f\") pod \"b11ae53a-a662-416b-821c-82876a05e362\" (UID: \"b11ae53a-a662-416b-821c-82876a05e362\") "
Jul 24 16:54:33.371721 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.371571    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11ae53a-a662-416b-821c-82876a05e362-plugins-config-volume\") pod \"b11ae53a-a662-416b-821c-82876a05e362\" (UID: \"b11ae53a-a662-416b-821c-82876a05e362\") "
Jul 24 16:54:33.371962 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.371931    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b11ae53a-a662-416b-821c-82876a05e362-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b11ae53a-a662-416b-821c-82876a05e362" (UID: "b11ae53a-a662-416b-821c-82876a05e362"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:54:33.373686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.373667    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b11ae53a-a662-416b-821c-82876a05e362-kube-api-access-sdn6f" (OuterVolumeSpecName: "kube-api-access-sdn6f") pod "b11ae53a-a662-416b-821c-82876a05e362" (UID: "b11ae53a-a662-416b-821c-82876a05e362"). InnerVolumeSpecName "kube-api-access-sdn6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:54:33.457125 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.457092    2561 generic.go:356] "Generic (PLEG): container finished" podID="b11ae53a-a662-416b-821c-82876a05e362" containerID="d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf" exitCode=0
Jul 24 16:54:33.457319 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.457135    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"
Jul 24 16:54:33.457319 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.457179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf" event={"ID":"b11ae53a-a662-416b-821c-82876a05e362","Type":"ContainerDied","Data":"d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf"}
Jul 24 16:54:33.457319 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.457237    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf" event={"ID":"b11ae53a-a662-416b-821c-82876a05e362","Type":"ContainerDied","Data":"c1bab8940333418412840378747177b860201091ca5ce962ef5fdc83f24d2a31"}
Jul 24 16:54:33.457319 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.457265    2561 scope.go:117] "RemoveContainer" containerID="d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf"
Jul 24 16:54:33.458437 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.458414    2561 generic.go:356] "Generic (PLEG): container finished" podID="eb5e8a2b-2573-48f5-8d5c-d1664c5472d2" containerID="36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195" exitCode=0
Jul 24 16:54:33.458537 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.458460    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"
Jul 24 16:54:33.458537 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.458475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv" event={"ID":"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2","Type":"ContainerDied","Data":"36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195"}
Jul 24 16:54:33.458537 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.458515    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv" event={"ID":"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2","Type":"ContainerDied","Data":"c3624169dd90b844bb55346b30a4a21c6fc9f362459c4b87f9bbbe51cb455691"}
Jul 24 16:54:33.466431 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.466413    2561 scope.go:117] "RemoveContainer" containerID="d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf"
Jul 24 16:54:33.466721 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:54:33.466702    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf\": container with ID starting with d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf not found: ID does not exist" containerID="d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf"
Jul 24 16:54:33.466786 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.466731    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf"} err="failed to get container status \"d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf\": rpc error: code = NotFound desc = could not find container \"d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf\": container with ID starting with d3ae5ac14e67f32e9a5f8235fae2b357f1a5d40f402e315df51120e877cb20cf not found: ID does not exist"
Jul 24 16:54:33.466786 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.466748    2561 scope.go:117] "RemoveContainer" containerID="36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195"
Jul 24 16:54:33.472098 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.472081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-plugins-config-volume\") pod \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\" (UID: \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\") "
Jul 24 16:54:33.472197 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.472119    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzwz8\" (UniqueName: \"kubernetes.io/projected/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-kube-api-access-wzwz8\") pod \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\" (UID: \"eb5e8a2b-2573-48f5-8d5c-d1664c5472d2\") "
Jul 24 16:54:33.472408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.472366    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdn6f\" (UniqueName: \"kubernetes.io/projected/b11ae53a-a662-416b-821c-82876a05e362-kube-api-access-sdn6f\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:54:33.472408 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.472387    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11ae53a-a662-416b-821c-82876a05e362-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:54:33.472553 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.472534    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb5e8a2b-2573-48f5-8d5c-d1664c5472d2" (UID: "eb5e8a2b-2573-48f5-8d5c-d1664c5472d2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:54:33.474516 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.474495    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-kube-api-access-wzwz8" (OuterVolumeSpecName: "kube-api-access-wzwz8") pod "eb5e8a2b-2573-48f5-8d5c-d1664c5472d2" (UID: "eb5e8a2b-2573-48f5-8d5c-d1664c5472d2"). InnerVolumeSpecName "kube-api-access-wzwz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:54:33.475411 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.475391    2561 scope.go:117] "RemoveContainer" containerID="36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195"
Jul 24 16:54:33.475679 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:54:33.475661    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195\": container with ID starting with 36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195 not found: ID does not exist" containerID="36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195"
Jul 24 16:54:33.475736 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.475687    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195"} err="failed to get container status \"36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195\": rpc error: code = NotFound desc = could not find container \"36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195\": container with ID starting with 36c348de75e406251c35998faf69e8c68b5fb5e01c1e5f484a57d204c2eb9195 not found: ID does not exist"
Jul 24 16:54:33.481089 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.481069    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"]
Jul 24 16:54:33.485243 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.485223    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8c969d-59c55f994-xlkzf"]
Jul 24 16:54:33.573683 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.573576    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzwz8\" (UniqueName: \"kubernetes.io/projected/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-kube-api-access-wzwz8\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:54:33.573683 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.573608    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:54:33.778474 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.778444    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"]
Jul 24 16:54:33.783138 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:33.783113    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8c969d-6f95b7c5b4-ggrcv"]
Jul 24 16:54:34.507457 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:34.507413    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b11ae53a-a662-416b-821c-82876a05e362" path="/var/lib/kubelet/pods/b11ae53a-a662-416b-821c-82876a05e362/volumes"
Jul 24 16:54:34.507964 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:34.507930    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb5e8a2b-2573-48f5-8d5c-d1664c5472d2" path="/var/lib/kubelet/pods/eb5e8a2b-2573-48f5-8d5c-d1664c5472d2/volumes"
Jul 24 16:54:42.337008 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:54:42.336965    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:55:04.439260 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:04.439213    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:55:05.671116 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:05.671082    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"]
Jul 24 16:55:05.671542 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:05.671277    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj" podUID="00d506dc-ce26-4ea6-bdf8-195d0752e190" containerName="maas-api" containerID="cri-o://9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be" gracePeriod=30
Jul 24 16:55:05.714532 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:05.714504    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"]
Jul 24 16:55:05.714764 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:05.714719    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt" podUID="b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3" containerName="payload-pre-processing" containerID="cri-o://1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7" gracePeriod=30
Jul 24 16:55:05.976067 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:05.976045    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:55:05.985327 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:05.985306    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:55:06.045671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.045619    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d506dc-ce26-4ea6-bdf8-195d0752e190-maas-api-tls\") pod \"00d506dc-ce26-4ea6-bdf8-195d0752e190\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") "
Jul 24 16:55:06.045671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.045681    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwxsn\" (UniqueName: \"kubernetes.io/projected/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-kube-api-access-vwxsn\") pod \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\" (UID: \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\") "
Jul 24 16:55:06.045945 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.045720    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-plugins-config-volume\") pod \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\" (UID: \"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3\") "
Jul 24 16:55:06.045945 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.045761    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjs62\" (UniqueName: \"kubernetes.io/projected/00d506dc-ce26-4ea6-bdf8-195d0752e190-kube-api-access-jjs62\") pod \"00d506dc-ce26-4ea6-bdf8-195d0752e190\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") "
Jul 24 16:55:06.045945 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.045828    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d506dc-ce26-4ea6-bdf8-195d0752e190-openshift-service-ca\") pod \"00d506dc-ce26-4ea6-bdf8-195d0752e190\" (UID: \"00d506dc-ce26-4ea6-bdf8-195d0752e190\") "
Jul 24 16:55:06.046294 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.046125    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3" (UID: "b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:55:06.046414 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.046293    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d506dc-ce26-4ea6-bdf8-195d0752e190-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00d506dc-ce26-4ea6-bdf8-195d0752e190" (UID: "00d506dc-ce26-4ea6-bdf8-195d0752e190"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:55:06.048124 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.048099    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-kube-api-access-vwxsn" (OuterVolumeSpecName: "kube-api-access-vwxsn") pod "b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3" (UID: "b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3"). InnerVolumeSpecName "kube-api-access-vwxsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:55:06.048203 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.048130    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d506dc-ce26-4ea6-bdf8-195d0752e190-kube-api-access-jjs62" (OuterVolumeSpecName: "kube-api-access-jjs62") pod "00d506dc-ce26-4ea6-bdf8-195d0752e190" (UID: "00d506dc-ce26-4ea6-bdf8-195d0752e190"). InnerVolumeSpecName "kube-api-access-jjs62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:55:06.048203 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.048127    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d506dc-ce26-4ea6-bdf8-195d0752e190-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00d506dc-ce26-4ea6-bdf8-195d0752e190" (UID: "00d506dc-ce26-4ea6-bdf8-195d0752e190"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:55:06.147406 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.147365    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d506dc-ce26-4ea6-bdf8-195d0752e190-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:55:06.147406 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.147399    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwxsn\" (UniqueName: \"kubernetes.io/projected/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-kube-api-access-vwxsn\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:55:06.147406 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.147409    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:55:06.147406 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.147418    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjs62\" (UniqueName: \"kubernetes.io/projected/00d506dc-ce26-4ea6-bdf8-195d0752e190-kube-api-access-jjs62\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:55:06.147721 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.147427    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d506dc-ce26-4ea6-bdf8-195d0752e190-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:55:06.630654 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.630602    2561 generic.go:356] "Generic (PLEG): container finished" podID="00d506dc-ce26-4ea6-bdf8-195d0752e190" containerID="9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be" exitCode=0
Jul 24 16:55:06.630835 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.630676    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"
Jul 24 16:55:06.630835 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.630674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj" event={"ID":"00d506dc-ce26-4ea6-bdf8-195d0752e190","Type":"ContainerDied","Data":"9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be"}
Jul 24 16:55:06.630835 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.630813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj" event={"ID":"00d506dc-ce26-4ea6-bdf8-195d0752e190","Type":"ContainerDied","Data":"e62b37477d5c04e0552fcc454b146a1e998d59148fefe5cc886af4345f858af6"}
Jul 24 16:55:06.630993 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.630846    2561 scope.go:117] "RemoveContainer" containerID="9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be"
Jul 24 16:55:06.632166 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.632142    2561 generic.go:356] "Generic (PLEG): container finished" podID="b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3" containerID="1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7" exitCode=0
Jul 24 16:55:06.632269 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.632196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt" event={"ID":"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3","Type":"ContainerDied","Data":"1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7"}
Jul 24 16:55:06.632269 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.632202    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"
Jul 24 16:55:06.632269 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.632238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt" event={"ID":"b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3","Type":"ContainerDied","Data":"f6274202b3af736980d1165a091b5370c8522b58781745e528b3f2ed6f8ec4c8"}
Jul 24 16:55:06.640214 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.640196    2561 scope.go:117] "RemoveContainer" containerID="9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be"
Jul 24 16:55:06.640496 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:55:06.640477    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be\": container with ID starting with 9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be not found: ID does not exist" containerID="9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be"
Jul 24 16:55:06.640547 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.640505    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be"} err="failed to get container status \"9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be\": rpc error: code = NotFound desc = could not find container \"9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be\": container with ID starting with 9eb64721b649621496dd8b402d70c426692e4648dee092493f5c364c66c6a7be not found: ID does not exist"
Jul 24 16:55:06.640547 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.640524    2561 scope.go:117] "RemoveContainer" containerID="1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7"
Jul 24 16:55:06.648154 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.648131    2561 scope.go:117] "RemoveContainer" containerID="1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7"
Jul 24 16:55:06.648403 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:55:06.648384    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7\": container with ID starting with 1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7 not found: ID does not exist" containerID="1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7"
Jul 24 16:55:06.648466 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.648414    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7"} err="failed to get container status \"1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7\": rpc error: code = NotFound desc = could not find container \"1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7\": container with ID starting with 1dcfca1363b54c06349bee584d9d01aa6e9fc40ec17bc65f66f75feee388e4d7 not found: ID does not exist"
Jul 24 16:55:06.652110 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.652088    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"]
Jul 24 16:55:06.655833 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.655812    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b04709-79fb76cfdd-v5wbj"]
Jul 24 16:55:06.664701 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.664676    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"]
Jul 24 16:55:06.668373 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:06.668345    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b04709-7559c98d8-qssvt"]
Jul 24 16:55:08.508090 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:08.508058    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00d506dc-ce26-4ea6-bdf8-195d0752e190" path="/var/lib/kubelet/pods/00d506dc-ce26-4ea6-bdf8-195d0752e190/volumes"
Jul 24 16:55:08.508470 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:08.508400    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3" path="/var/lib/kubelet/pods/b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3/volumes"
Jul 24 16:55:17.639187 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:55:17.639157    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:56:09.561774 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.561744    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"]
Jul 24 16:56:09.562295 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.561984    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv" podUID="2db8cab2-241a-4875-a5ea-03bfb56b6224" containerName="maas-api" containerID="cri-o://2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06" gracePeriod=30
Jul 24 16:56:09.610660 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.610612    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"]
Jul 24 16:56:09.610868 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.610841    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj" podUID="8f92356b-3ead-4695-a992-21afee47169b" containerName="payload-processing" containerID="cri-o://c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d" gracePeriod=30
Jul 24 16:56:09.617336 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.617305    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"]
Jul 24 16:56:09.617513 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.617485    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm" podUID="81b4e1c1-586b-43db-acfa-03502e9ef8dd" containerName="payload-pre-processing" containerID="cri-o://81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26" gracePeriod=30
Jul 24 16:56:09.892619 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.892598    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:56:09.906059 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.906039    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:56:09.919333 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.919311    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:56:09.933982 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.933960    2561 generic.go:356] "Generic (PLEG): container finished" podID="2db8cab2-241a-4875-a5ea-03bfb56b6224" containerID="2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06" exitCode=0
Jul 24 16:56:09.934108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.933997    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"
Jul 24 16:56:09.934108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.934028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv" event={"ID":"2db8cab2-241a-4875-a5ea-03bfb56b6224","Type":"ContainerDied","Data":"2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06"}
Jul 24 16:56:09.934108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.934072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv" event={"ID":"2db8cab2-241a-4875-a5ea-03bfb56b6224","Type":"ContainerDied","Data":"259af4420afe5aff8126617e3bf336a1c7b60aa2098f815077c435e74a841f7d"}
Jul 24 16:56:09.934108 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.934099    2561 scope.go:117] "RemoveContainer" containerID="2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06"
Jul 24 16:56:09.935554 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.935529    2561 generic.go:356] "Generic (PLEG): container finished" podID="8f92356b-3ead-4695-a992-21afee47169b" containerID="c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d" exitCode=0
Jul 24 16:56:09.935683 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.935574    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"
Jul 24 16:56:09.935683 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.935622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj" event={"ID":"8f92356b-3ead-4695-a992-21afee47169b","Type":"ContainerDied","Data":"c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d"}
Jul 24 16:56:09.935818 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.935684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj" event={"ID":"8f92356b-3ead-4695-a992-21afee47169b","Type":"ContainerDied","Data":"cf8b00f021389aa39c8f11db022086f8d5ac108c76977fafa304693afa386d28"}
Jul 24 16:56:09.937078 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.936964    2561 generic.go:356] "Generic (PLEG): container finished" podID="81b4e1c1-586b-43db-acfa-03502e9ef8dd" containerID="81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26" exitCode=0
Jul 24 16:56:09.937078 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.936996    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"
Jul 24 16:56:09.937212 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.936993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm" event={"ID":"81b4e1c1-586b-43db-acfa-03502e9ef8dd","Type":"ContainerDied","Data":"81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26"}
Jul 24 16:56:09.937212 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.937127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm" event={"ID":"81b4e1c1-586b-43db-acfa-03502e9ef8dd","Type":"ContainerDied","Data":"c965b5ae73cc390c44618f13028fcd5facd3e3ed4c62b119d136c08a30f6d694"}
Jul 24 16:56:09.942714 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.942698    2561 scope.go:117] "RemoveContainer" containerID="2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06"
Jul 24 16:56:09.942952 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:56:09.942933    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06\": container with ID starting with 2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06 not found: ID does not exist" containerID="2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06"
Jul 24 16:56:09.943045 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.942958    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06"} err="failed to get container status \"2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06\": rpc error: code = NotFound desc = could not find container \"2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06\": container with ID starting with 2b1b42f69715de6021f288d139fb08c6edf4664877345414617ad98e6ba37d06 not found: ID does not exist"
Jul 24 16:56:09.943045 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.942980    2561 scope.go:117] "RemoveContainer" containerID="c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d"
Jul 24 16:56:09.951906 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.951885    2561 scope.go:117] "RemoveContainer" containerID="c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d"
Jul 24 16:56:09.952219 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:56:09.952198    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d\": container with ID starting with c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d not found: ID does not exist" containerID="c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d"
Jul 24 16:56:09.952299 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.952223    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d"} err="failed to get container status \"c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d\": rpc error: code = NotFound desc = could not find container \"c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d\": container with ID starting with c882523a83ec79a04314fe13b2a774fb9aa8feee0f4dfe2bd96dba3a88f52f5d not found: ID does not exist"
Jul 24 16:56:09.952299 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.952240    2561 scope.go:117] "RemoveContainer" containerID="81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26"
Jul 24 16:56:09.962248 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.962229    2561 scope.go:117] "RemoveContainer" containerID="81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26"
Jul 24 16:56:09.962574 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:56:09.962542    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26\": container with ID starting with 81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26 not found: ID does not exist" containerID="81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26"
Jul 24 16:56:09.962721 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.962580    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26"} err="failed to get container status \"81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26\": rpc error: code = NotFound desc = could not find container \"81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26\": container with ID starting with 81f55e605bf4b7a58b81123f89fba91d17d50e143f1df335ac00a45484a45b26 not found: ID does not exist"
Jul 24 16:56:09.962721 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.962561    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt2x2\" (UniqueName: \"kubernetes.io/projected/8f92356b-3ead-4695-a992-21afee47169b-kube-api-access-jt2x2\") pod \"8f92356b-3ead-4695-a992-21afee47169b\" (UID: \"8f92356b-3ead-4695-a992-21afee47169b\") "
Jul 24 16:56:09.962721 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.962658    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f92356b-3ead-4695-a992-21afee47169b-plugins-config-volume\") pod \"8f92356b-3ead-4695-a992-21afee47169b\" (UID: \"8f92356b-3ead-4695-a992-21afee47169b\") "
Jul 24 16:56:09.962721 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.962694    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db8cab2-241a-4875-a5ea-03bfb56b6224-maas-api-tls\") pod \"2db8cab2-241a-4875-a5ea-03bfb56b6224\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") "
Jul 24 16:56:09.963471 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.962765    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db8cab2-241a-4875-a5ea-03bfb56b6224-openshift-service-ca\") pod \"2db8cab2-241a-4875-a5ea-03bfb56b6224\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") "
Jul 24 16:56:09.963471 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.962792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzvcb\" (UniqueName: \"kubernetes.io/projected/2db8cab2-241a-4875-a5ea-03bfb56b6224-kube-api-access-jzvcb\") pod \"2db8cab2-241a-4875-a5ea-03bfb56b6224\" (UID: \"2db8cab2-241a-4875-a5ea-03bfb56b6224\") "
Jul 24 16:56:09.963471 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.963115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f92356b-3ead-4695-a992-21afee47169b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f92356b-3ead-4695-a992-21afee47169b" (UID: "8f92356b-3ead-4695-a992-21afee47169b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:09.963471 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.963166    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2db8cab2-241a-4875-a5ea-03bfb56b6224-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2db8cab2-241a-4875-a5ea-03bfb56b6224" (UID: "2db8cab2-241a-4875-a5ea-03bfb56b6224"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:09.965115 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.965085    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f92356b-3ead-4695-a992-21afee47169b-kube-api-access-jt2x2" (OuterVolumeSpecName: "kube-api-access-jt2x2") pod "8f92356b-3ead-4695-a992-21afee47169b" (UID: "8f92356b-3ead-4695-a992-21afee47169b"). InnerVolumeSpecName "kube-api-access-jt2x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:09.965518 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.965487    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2db8cab2-241a-4875-a5ea-03bfb56b6224-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2db8cab2-241a-4875-a5ea-03bfb56b6224" (UID: "2db8cab2-241a-4875-a5ea-03bfb56b6224"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:56:09.965599 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:09.965519    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db8cab2-241a-4875-a5ea-03bfb56b6224-kube-api-access-jzvcb" (OuterVolumeSpecName: "kube-api-access-jzvcb") pod "2db8cab2-241a-4875-a5ea-03bfb56b6224" (UID: "2db8cab2-241a-4875-a5ea-03bfb56b6224"). InnerVolumeSpecName "kube-api-access-jzvcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:10.063376 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.063346    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqsmz\" (UniqueName: \"kubernetes.io/projected/81b4e1c1-586b-43db-acfa-03502e9ef8dd-kube-api-access-fqsmz\") pod \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\" (UID: \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\") "
Jul 24 16:56:10.063542 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.063429    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81b4e1c1-586b-43db-acfa-03502e9ef8dd-plugins-config-volume\") pod \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\" (UID: \"81b4e1c1-586b-43db-acfa-03502e9ef8dd\") "
Jul 24 16:56:10.063607 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.063590    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt2x2\" (UniqueName: \"kubernetes.io/projected/8f92356b-3ead-4695-a992-21afee47169b-kube-api-access-jt2x2\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:10.063686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.063615    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f92356b-3ead-4695-a992-21afee47169b-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:10.063686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.063631    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db8cab2-241a-4875-a5ea-03bfb56b6224-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:10.063686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.063674    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db8cab2-241a-4875-a5ea-03bfb56b6224-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:10.063793 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.063687    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzvcb\" (UniqueName: \"kubernetes.io/projected/2db8cab2-241a-4875-a5ea-03bfb56b6224-kube-api-access-jzvcb\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:10.063846 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.063830    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81b4e1c1-586b-43db-acfa-03502e9ef8dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "81b4e1c1-586b-43db-acfa-03502e9ef8dd" (UID: "81b4e1c1-586b-43db-acfa-03502e9ef8dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:10.065454 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.065432    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b4e1c1-586b-43db-acfa-03502e9ef8dd-kube-api-access-fqsmz" (OuterVolumeSpecName: "kube-api-access-fqsmz") pod "81b4e1c1-586b-43db-acfa-03502e9ef8dd" (UID: "81b4e1c1-586b-43db-acfa-03502e9ef8dd"). InnerVolumeSpecName "kube-api-access-fqsmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:10.165023 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.164928    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqsmz\" (UniqueName: \"kubernetes.io/projected/81b4e1c1-586b-43db-acfa-03502e9ef8dd-kube-api-access-fqsmz\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:10.165023 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.164963    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81b4e1c1-586b-43db-acfa-03502e9ef8dd-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:10.257465 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.257440    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"]
Jul 24 16:56:10.261456 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.261434    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-633b54-7b486488b8-kb7bv"]
Jul 24 16:56:10.271280 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.271252    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"]
Jul 24 16:56:10.273739 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.273717    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-633b54-5f6cb49b6-f2ptj"]
Jul 24 16:56:10.283895 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.283875    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"]
Jul 24 16:56:10.287508 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.287483    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-633b54-fbcf6b448-bzjvm"]
Jul 24 16:56:10.507772 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.507680    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2db8cab2-241a-4875-a5ea-03bfb56b6224" path="/var/lib/kubelet/pods/2db8cab2-241a-4875-a5ea-03bfb56b6224/volumes"
Jul 24 16:56:10.508122 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.508102    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81b4e1c1-586b-43db-acfa-03502e9ef8dd" path="/var/lib/kubelet/pods/81b4e1c1-586b-43db-acfa-03502e9ef8dd/volumes"
Jul 24 16:56:10.508454 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:10.508437    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f92356b-3ead-4695-a992-21afee47169b" path="/var/lib/kubelet/pods/8f92356b-3ead-4695-a992-21afee47169b/volumes"
Jul 24 16:56:12.745128 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:12.745095    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:56:31.748033 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:31.747997    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"]
Jul 24 16:56:31.748935 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:31.748872    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r" podUID="4adc04ad-f2b5-4fad-886f-95cc57fda817" containerName="maas-api" containerID="cri-o://1d7cbe43d36bffef3fae1ba1fe174a7892810ba76cb088f73ddbb14a58f3fafe" gracePeriod=30
Jul 24 16:56:31.805926 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:31.805894    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"]
Jul 24 16:56:31.806118 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:31.806093    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb" podUID="ee64e6e6-1504-4ebc-8b5f-062b2d851f2f" containerName="payload-processing" containerID="cri-o://9e47aadf0e5b53019cacad4a749d921dd3320710f1972e154ca458c0799ce9b4" gracePeriod=30
Jul 24 16:56:31.814288 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:31.814259    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"]
Jul 24 16:56:31.814500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:31.814478    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq" podUID="413bae06-a73b-4b6c-b0eb-3b0e648b661d" containerName="payload-pre-processing" containerID="cri-o://27f74ed9f71fd5fe22059ea598422595423c900638d669feed6e079255ec7271" gracePeriod=30
Jul 24 16:56:32.044096 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.044055    2561 generic.go:356] "Generic (PLEG): container finished" podID="ee64e6e6-1504-4ebc-8b5f-062b2d851f2f" containerID="9e47aadf0e5b53019cacad4a749d921dd3320710f1972e154ca458c0799ce9b4" exitCode=0
Jul 24 16:56:32.044263 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.044090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb" event={"ID":"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f","Type":"ContainerDied","Data":"9e47aadf0e5b53019cacad4a749d921dd3320710f1972e154ca458c0799ce9b4"}
Jul 24 16:56:32.045731 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.045710    2561 generic.go:356] "Generic (PLEG): container finished" podID="4adc04ad-f2b5-4fad-886f-95cc57fda817" containerID="1d7cbe43d36bffef3fae1ba1fe174a7892810ba76cb088f73ddbb14a58f3fafe" exitCode=0
Jul 24 16:56:32.045834 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.045784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r" event={"ID":"4adc04ad-f2b5-4fad-886f-95cc57fda817","Type":"ContainerDied","Data":"1d7cbe43d36bffef3fae1ba1fe174a7892810ba76cb088f73ddbb14a58f3fafe"}
Jul 24 16:56:32.047601 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.047582    2561 generic.go:356] "Generic (PLEG): container finished" podID="413bae06-a73b-4b6c-b0eb-3b0e648b661d" containerID="27f74ed9f71fd5fe22059ea598422595423c900638d669feed6e079255ec7271" exitCode=0
Jul 24 16:56:32.047698 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.047626    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq" event={"ID":"413bae06-a73b-4b6c-b0eb-3b0e648b661d","Type":"ContainerDied","Data":"27f74ed9f71fd5fe22059ea598422595423c900638d669feed6e079255ec7271"}
Jul 24 16:56:32.091174 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.091153    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:56:32.093513 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.093494    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:56:32.115145 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.115124    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:56:32.244383 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.244346    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nd8q\" (UniqueName: \"kubernetes.io/projected/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-kube-api-access-6nd8q\") pod \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\" (UID: \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\") "
Jul 24 16:56:32.244583 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.244399    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4adc04ad-f2b5-4fad-886f-95cc57fda817-openshift-service-ca\") pod \"4adc04ad-f2b5-4fad-886f-95cc57fda817\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") "
Jul 24 16:56:32.244583 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.244423    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4adc04ad-f2b5-4fad-886f-95cc57fda817-maas-api-tls\") pod \"4adc04ad-f2b5-4fad-886f-95cc57fda817\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") "
Jul 24 16:56:32.244583 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.244440    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-plugins-config-volume\") pod \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\" (UID: \"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f\") "
Jul 24 16:56:32.244583 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.244462    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqhmz\" (UniqueName: \"kubernetes.io/projected/4adc04ad-f2b5-4fad-886f-95cc57fda817-kube-api-access-dqhmz\") pod \"4adc04ad-f2b5-4fad-886f-95cc57fda817\" (UID: \"4adc04ad-f2b5-4fad-886f-95cc57fda817\") "
Jul 24 16:56:32.244583 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.244484    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/413bae06-a73b-4b6c-b0eb-3b0e648b661d-plugins-config-volume\") pod \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\" (UID: \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\") "
Jul 24 16:56:32.244583 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.244562    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlrd8\" (UniqueName: \"kubernetes.io/projected/413bae06-a73b-4b6c-b0eb-3b0e648b661d-kube-api-access-mlrd8\") pod \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\" (UID: \"413bae06-a73b-4b6c-b0eb-3b0e648b661d\") "
Jul 24 16:56:32.244962 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.244932    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4adc04ad-f2b5-4fad-886f-95cc57fda817-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4adc04ad-f2b5-4fad-886f-95cc57fda817" (UID: "4adc04ad-f2b5-4fad-886f-95cc57fda817"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:32.245017 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.244973    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ee64e6e6-1504-4ebc-8b5f-062b2d851f2f" (UID: "ee64e6e6-1504-4ebc-8b5f-062b2d851f2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:32.245072 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.245047    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/413bae06-a73b-4b6c-b0eb-3b0e648b661d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "413bae06-a73b-4b6c-b0eb-3b0e648b661d" (UID: "413bae06-a73b-4b6c-b0eb-3b0e648b661d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:32.246888 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.246859    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4adc04ad-f2b5-4fad-886f-95cc57fda817-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4adc04ad-f2b5-4fad-886f-95cc57fda817" (UID: "4adc04ad-f2b5-4fad-886f-95cc57fda817"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:56:32.246998 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.246931    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413bae06-a73b-4b6c-b0eb-3b0e648b661d-kube-api-access-mlrd8" (OuterVolumeSpecName: "kube-api-access-mlrd8") pod "413bae06-a73b-4b6c-b0eb-3b0e648b661d" (UID: "413bae06-a73b-4b6c-b0eb-3b0e648b661d"). InnerVolumeSpecName "kube-api-access-mlrd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:32.247118 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.247100    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4adc04ad-f2b5-4fad-886f-95cc57fda817-kube-api-access-dqhmz" (OuterVolumeSpecName: "kube-api-access-dqhmz") pod "4adc04ad-f2b5-4fad-886f-95cc57fda817" (UID: "4adc04ad-f2b5-4fad-886f-95cc57fda817"). InnerVolumeSpecName "kube-api-access-dqhmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:32.247161 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.247102    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-kube-api-access-6nd8q" (OuterVolumeSpecName: "kube-api-access-6nd8q") pod "ee64e6e6-1504-4ebc-8b5f-062b2d851f2f" (UID: "ee64e6e6-1504-4ebc-8b5f-062b2d851f2f"). InnerVolumeSpecName "kube-api-access-6nd8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:32.345686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.345620    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4adc04ad-f2b5-4fad-886f-95cc57fda817-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:32.345686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.345661    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4adc04ad-f2b5-4fad-886f-95cc57fda817-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:32.345686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.345670    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:32.345686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.345680    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqhmz\" (UniqueName: \"kubernetes.io/projected/4adc04ad-f2b5-4fad-886f-95cc57fda817-kube-api-access-dqhmz\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:32.345686 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.345687    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/413bae06-a73b-4b6c-b0eb-3b0e648b661d-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:32.345918 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.345697    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlrd8\" (UniqueName: \"kubernetes.io/projected/413bae06-a73b-4b6c-b0eb-3b0e648b661d-kube-api-access-mlrd8\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:32.345918 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:32.345707    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nd8q\" (UniqueName: \"kubernetes.io/projected/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f-kube-api-access-6nd8q\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:33.053957 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.053873    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"
Jul 24 16:56:33.053957 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.053886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq" event={"ID":"413bae06-a73b-4b6c-b0eb-3b0e648b661d","Type":"ContainerDied","Data":"8053625ca19a5d747a2c4f5f2d2317888b7d0bdf9125ee2ea8ef574b045253f4"}
Jul 24 16:56:33.053957 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.053946    2561 scope.go:117] "RemoveContainer" containerID="27f74ed9f71fd5fe22059ea598422595423c900638d669feed6e079255ec7271"
Jul 24 16:56:33.055311 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.055294    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"
Jul 24 16:56:33.055388 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.055312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb" event={"ID":"ee64e6e6-1504-4ebc-8b5f-062b2d851f2f","Type":"ContainerDied","Data":"474447c80079e5edde4d86d116c7e22720faa8bc547e487870d1769fb42f64c0"}
Jul 24 16:56:33.056953 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.056929    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r" event={"ID":"4adc04ad-f2b5-4fad-886f-95cc57fda817","Type":"ContainerDied","Data":"de51990e0050922b2289452d1e531f5d1fc3172ce3130ea177576ffac382ea39"}
Jul 24 16:56:33.057096 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.056949    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"
Jul 24 16:56:33.065707 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.065692    2561 scope.go:117] "RemoveContainer" containerID="9e47aadf0e5b53019cacad4a749d921dd3320710f1972e154ca458c0799ce9b4"
Jul 24 16:56:33.073782 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.073681    2561 scope.go:117] "RemoveContainer" containerID="1d7cbe43d36bffef3fae1ba1fe174a7892810ba76cb088f73ddbb14a58f3fafe"
Jul 24 16:56:33.075508 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.075485    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"]
Jul 24 16:56:33.080391 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.080372    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a65dee-6c7ff6f85b-6sxfq"]
Jul 24 16:56:33.090714 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.090694    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"]
Jul 24 16:56:33.093685 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.093664    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a65dee-7f4cd66fc4-knh4r"]
Jul 24 16:56:33.102869 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.102848    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"]
Jul 24 16:56:33.106208 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:33.106189    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a65dee-f858b6846-fv8rb"]
Jul 24 16:56:34.507461 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:34.507431    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413bae06-a73b-4b6c-b0eb-3b0e648b661d" path="/var/lib/kubelet/pods/413bae06-a73b-4b6c-b0eb-3b0e648b661d/volumes"
Jul 24 16:56:34.507849 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:34.507826    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4adc04ad-f2b5-4fad-886f-95cc57fda817" path="/var/lib/kubelet/pods/4adc04ad-f2b5-4fad-886f-95cc57fda817/volumes"
Jul 24 16:56:34.508130 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:34.508117    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee64e6e6-1504-4ebc-8b5f-062b2d851f2f" path="/var/lib/kubelet/pods/ee64e6e6-1504-4ebc-8b5f-062b2d851f2f/volumes"
Jul 24 16:56:35.044500 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:35.044458    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:56:53.591664 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:53.591615    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"]
Jul 24 16:56:53.592397 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:53.592366    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d" podUID="f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2" containerName="maas-api" containerID="cri-o://bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a" gracePeriod=30
Jul 24 16:56:53.633831 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:56:53.633800    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69b103a_4c4b_4c8d_86cd_f30ebe32a2b2.slice/crio-conmon-bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a.scope\": RecentStats: unable to find data in memory cache]"
Jul 24 16:56:53.647059 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:53.647030    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"]
Jul 24 16:56:53.647305 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:53.647257    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g" podUID="0db0cf7b-f588-4a26-81ca-62f64ae6e893" containerName="payload-processing" containerID="cri-o://70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1" gracePeriod=30
Jul 24 16:56:53.652799 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:53.652722    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"]
Jul 24 16:56:53.653237 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:53.652937    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b" podUID="4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062" containerName="payload-pre-processing" containerID="cri-o://31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c" gracePeriod=30
Jul 24 16:56:53.904181 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:53.904153    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:56:53.933677 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:53.933614    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:56:53.936309 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:53.936288    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:56:54.014314 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.014284    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-maas-api-tls\") pod \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") "
Jul 24 16:56:54.014314 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.014316    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-openshift-service-ca\") pod \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") "
Jul 24 16:56:54.014551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.014334    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwtth\" (UniqueName: \"kubernetes.io/projected/0db0cf7b-f588-4a26-81ca-62f64ae6e893-kube-api-access-bwtth\") pod \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\" (UID: \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\") "
Jul 24 16:56:54.014551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.014372    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l8lw\" (UniqueName: \"kubernetes.io/projected/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-kube-api-access-4l8lw\") pod \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\" (UID: \"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2\") "
Jul 24 16:56:54.014551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.014447    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfqqq\" (UniqueName: \"kubernetes.io/projected/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-kube-api-access-mfqqq\") pod \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\" (UID: \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\") "
Jul 24 16:56:54.014551 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.014511    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-plugins-config-volume\") pod \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\" (UID: \"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062\") "
Jul 24 16:56:54.014814 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.014576    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db0cf7b-f588-4a26-81ca-62f64ae6e893-plugins-config-volume\") pod \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\" (UID: \"0db0cf7b-f588-4a26-81ca-62f64ae6e893\") "
Jul 24 16:56:54.014865 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.014745    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2" (UID: "f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:54.014934 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.014916    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062" (UID: "4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:54.015353 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.015327    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db0cf7b-f588-4a26-81ca-62f64ae6e893-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0db0cf7b-f588-4a26-81ca-62f64ae6e893" (UID: "0db0cf7b-f588-4a26-81ca-62f64ae6e893"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:54.016714 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.016684    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2" (UID: "f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:56:54.016714 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.016701    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-kube-api-access-4l8lw" (OuterVolumeSpecName: "kube-api-access-4l8lw") pod "f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2" (UID: "f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2"). InnerVolumeSpecName "kube-api-access-4l8lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:54.017113 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.017089    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-kube-api-access-mfqqq" (OuterVolumeSpecName: "kube-api-access-mfqqq") pod "4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062" (UID: "4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062"). InnerVolumeSpecName "kube-api-access-mfqqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:54.017113 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.017091    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db0cf7b-f588-4a26-81ca-62f64ae6e893-kube-api-access-bwtth" (OuterVolumeSpecName: "kube-api-access-bwtth") pod "0db0cf7b-f588-4a26-81ca-62f64ae6e893" (UID: "0db0cf7b-f588-4a26-81ca-62f64ae6e893"). InnerVolumeSpecName "kube-api-access-bwtth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:54.116067 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.116033    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:54.116067 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.116067    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db0cf7b-f588-4a26-81ca-62f64ae6e893-plugins-config-volume\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:54.116067 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.116078    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-maas-api-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:54.116263 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.116088    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-openshift-service-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:54.116263 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.116096    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwtth\" (UniqueName: \"kubernetes.io/projected/0db0cf7b-f588-4a26-81ca-62f64ae6e893-kube-api-access-bwtth\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:54.116263 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.116105    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l8lw\" (UniqueName: \"kubernetes.io/projected/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2-kube-api-access-4l8lw\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:54.116263 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.116113    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfqqq\" (UniqueName: \"kubernetes.io/projected/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062-kube-api-access-mfqqq\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
Jul 24 16:56:54.164008 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.163927    2561 generic.go:356] "Generic (PLEG): container finished" podID="4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062" containerID="31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c" exitCode=0
Jul 24 16:56:54.164008 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.163994    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b" event={"ID":"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062","Type":"ContainerDied","Data":"31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c"}
Jul 24 16:56:54.164162 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.164004    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"
Jul 24 16:56:54.164162 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.164102    2561 scope.go:117] "RemoveContainer" containerID="31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c"
Jul 24 16:56:54.164244 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.164087    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b" event={"ID":"4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062","Type":"ContainerDied","Data":"74537a973e6be223311c70d1b4f5a313f5609ed44b7eade2c082a0519e1176d2"}
Jul 24 16:56:54.165449 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.165430    2561 generic.go:356] "Generic (PLEG): container finished" podID="0db0cf7b-f588-4a26-81ca-62f64ae6e893" containerID="70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1" exitCode=0
Jul 24 16:56:54.165731 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.165487    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"
Jul 24 16:56:54.165731 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.165495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g" event={"ID":"0db0cf7b-f588-4a26-81ca-62f64ae6e893","Type":"ContainerDied","Data":"70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1"}
Jul 24 16:56:54.165731 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.165531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g" event={"ID":"0db0cf7b-f588-4a26-81ca-62f64ae6e893","Type":"ContainerDied","Data":"abd89c9c6a0411cc7fb8f2d30dae342fc50bca166d4199ac56d7acc32b101dc5"}
Jul 24 16:56:54.167186 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.167061    2561 generic.go:356] "Generic (PLEG): container finished" podID="f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2" containerID="bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a" exitCode=0
Jul 24 16:56:54.167186 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.167109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d" event={"ID":"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2","Type":"ContainerDied","Data":"bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a"}
Jul 24 16:56:54.167186 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.167122    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"
Jul 24 16:56:54.167186 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.167153    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d" event={"ID":"f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2","Type":"ContainerDied","Data":"1a6adf613a0ebca203a7435801143efb31c498a3d25b53b21885224026d503d3"}
Jul 24 16:56:54.176485 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.176420    2561 scope.go:117] "RemoveContainer" containerID="31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c"
Jul 24 16:56:54.176844 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:56:54.176822    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c\": container with ID starting with 31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c not found: ID does not exist" containerID="31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c"
Jul 24 16:56:54.176916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.176854    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c"} err="failed to get container status \"31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c\": rpc error: code = NotFound desc = could not find container \"31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c\": container with ID starting with 31ed8c4b6995e732c59369a0c0ea9190c2a1103cdfb667a92fcea206af041b9c not found: ID does not exist"
Jul 24 16:56:54.176916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.176876    2561 scope.go:117] "RemoveContainer" containerID="70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1"
Jul 24 16:56:54.185294 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.185278    2561 scope.go:117] "RemoveContainer" containerID="70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1"
Jul 24 16:56:54.185528 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:56:54.185510    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1\": container with ID starting with 70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1 not found: ID does not exist" containerID="70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1"
Jul 24 16:56:54.185575 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.185535    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1"} err="failed to get container status \"70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1\": rpc error: code = NotFound desc = could not find container \"70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1\": container with ID starting with 70ecb1190f480f8c954883cb2b5ff7ace21b7092ff59a06dfa9bf2c07e7e60b1 not found: ID does not exist"
Jul 24 16:56:54.185575 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.185551    2561 scope.go:117] "RemoveContainer" containerID="bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a"
Jul 24 16:56:54.193546 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.193528    2561 scope.go:117] "RemoveContainer" containerID="bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a"
Jul 24 16:56:54.193807 ip-10-0-134-143 kubenswrapper[2561]: E0724 16:56:54.193790    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a\": container with ID starting with bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a not found: ID does not exist" containerID="bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a"
Jul 24 16:56:54.193858 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.193813    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a"} err="failed to get container status \"bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a\": rpc error: code = NotFound desc = could not find container \"bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a\": container with ID starting with bafda2d43add8c4a03615d54c3559bd2c9ac2bcbe3169feefe0e44f92427276a not found: ID does not exist"
Jul 24 16:56:54.194189 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.194171    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"]
Jul 24 16:56:54.197457 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.197436    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a29da6-5bb944b44b-tg55g"]
Jul 24 16:56:54.206453 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.206426    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"]
Jul 24 16:56:54.208128 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.208106    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a29da6-867cc8f79b-t7s6b"]
Jul 24 16:56:54.217750 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.217728    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"]
Jul 24 16:56:54.219609 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.219584    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a29da6-5bdb9d844d-9m82d"]
Jul 24 16:56:54.506610 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.506536    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db0cf7b-f588-4a26-81ca-62f64ae6e893" path="/var/lib/kubelet/pods/0db0cf7b-f588-4a26-81ca-62f64ae6e893/volumes"
Jul 24 16:56:54.506890 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.506876    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062" path="/var/lib/kubelet/pods/4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062/volumes"
Jul 24 16:56:54.507198 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:54.507188    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2" path="/var/lib/kubelet/pods/f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2/volumes"
Jul 24 16:56:56.543862 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:56:56.543822    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7k46"]
Jul 24 16:57:11.666786 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:11.666758    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6c795b6-ln7c4_c9c59d29-6b9a-4370-8208-33974f3a1628/copy-manifests/0.log"
Jul 24 16:57:11.679961 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:11.679936    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6c795b6-ln7c4_c9c59d29-6b9a-4370-8208-33974f3a1628/manager/0.log"
Jul 24 16:57:12.139181 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:12.139152    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748510-xss95_868e1076-b04c-4e59-88f4-d67389686529/cleanup/0.log"
Jul 24 16:57:12.248316 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:12.248290    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748525-mhcc8_43bf8665-7d44-41ff-b502-5c8a297efbf6/cleanup/0.log"
Jul 24 16:57:13.125692 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.125661    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms_347ace90-6984-4515-8f91-7851f7b23e3e/util/0.log"
Jul 24 16:57:13.132387 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.132362    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms_347ace90-6984-4515-8f91-7851f7b23e3e/pull/0.log"
Jul 24 16:57:13.139048 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.139028    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms_347ace90-6984-4515-8f91-7851f7b23e3e/extract/0.log"
Jul 24 16:57:13.251938 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.251908    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh_2f086180-ee5b-4467-914e-61ef3499c53b/util/0.log"
Jul 24 16:57:13.258582 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.258562    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh_2f086180-ee5b-4467-914e-61ef3499c53b/pull/0.log"
Jul 24 16:57:13.265184 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.265166    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh_2f086180-ee5b-4467-914e-61ef3499c53b/extract/0.log"
Jul 24 16:57:13.378720 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.378632    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb_ff02b33a-c681-4f2d-8a58-5a36a28c9355/util/0.log"
Jul 24 16:57:13.385339 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.385321    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb_ff02b33a-c681-4f2d-8a58-5a36a28c9355/pull/0.log"
Jul 24 16:57:13.392181 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.392163    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb_ff02b33a-c681-4f2d-8a58-5a36a28c9355/extract/0.log"
Jul 24 16:57:13.505671 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.505625    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb_95e1140c-8da7-488d-a58d-f4d40407d934/extract/0.log"
Jul 24 16:57:13.513252 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.513232    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb_95e1140c-8da7-488d-a58d-f4d40407d934/util/0.log"
Jul 24 16:57:13.519872 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:13.519849    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb_95e1140c-8da7-488d-a58d-f4d40407d934/pull/0.log"
Jul 24 16:57:14.349313 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:14.349279    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-j7k46_842325ce-cfa1-4a9a-b5df-79201063e822/limitador/0.log"
Jul 24 16:57:14.937354 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:14.937321    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9rk5t_9d6f1a5d-1319-4b9f-9397-69be4432b457/discovery/0.log"
Jul 24 16:57:16.447574 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:16.447542    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-klfp9_2acd6484-5c3c-4381-a077-95aa184f9e2a/main/0.log"
Jul 24 16:57:25.232509 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:25.232478    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dscj2_29617d35-46b4-4fa4-aa91-c048ca5b9889/global-pull-secret-syncer/0.log"
Jul 24 16:57:25.365784 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:25.365753    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-swswd_2ac2a9d1-5ea3-44e2-98d5-1615d3c528ac/konnectivity-agent/0.log"
Jul 24 16:57:25.440740 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:25.440706    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-143.ec2.internal_10f0c28ca9cd19ab7159a10a4ec7a08a/haproxy/0.log"
Jul 24 16:57:29.597008 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.596981    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms_347ace90-6984-4515-8f91-7851f7b23e3e/extract/0.log"
Jul 24 16:57:29.623024 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.623001    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms_347ace90-6984-4515-8f91-7851f7b23e3e/util/0.log"
Jul 24 16:57:29.644311 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.644278    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75988hms_347ace90-6984-4515-8f91-7851f7b23e3e/pull/0.log"
Jul 24 16:57:29.670953 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.670928    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh_2f086180-ee5b-4467-914e-61ef3499c53b/extract/0.log"
Jul 24 16:57:29.692006 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.691977    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh_2f086180-ee5b-4467-914e-61ef3499c53b/util/0.log"
Jul 24 16:57:29.714463 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.714431    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gkhxh_2f086180-ee5b-4467-914e-61ef3499c53b/pull/0.log"
Jul 24 16:57:29.740902 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.740871    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb_ff02b33a-c681-4f2d-8a58-5a36a28c9355/extract/0.log"
Jul 24 16:57:29.766992 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.766963    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb_ff02b33a-c681-4f2d-8a58-5a36a28c9355/util/0.log"
Jul 24 16:57:29.789255 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.789229    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsjvb_ff02b33a-c681-4f2d-8a58-5a36a28c9355/pull/0.log"
Jul 24 16:57:29.818094 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.818068    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb_95e1140c-8da7-488d-a58d-f4d40407d934/extract/0.log"
Jul 24 16:57:29.838687 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.838665    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb_95e1140c-8da7-488d-a58d-f4d40407d934/util/0.log"
Jul 24 16:57:29.859466 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:29.859407    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f8jpb_95e1140c-8da7-488d-a58d-f4d40407d934/pull/0.log"
Jul 24 16:57:30.632748 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:30.632716    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-j7k46_842325ce-cfa1-4a9a-b5df-79201063e822/limitador/0.log"
Jul 24 16:57:32.871034 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:32.871010    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fshp_5c420587-d825-4a49-8e05-5e56b1671462/node-exporter/0.log"
Jul 24 16:57:32.892600 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:32.892576    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fshp_5c420587-d825-4a49-8e05-5e56b1671462/kube-rbac-proxy/0.log"
Jul 24 16:57:32.923655 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:32.923617    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fshp_5c420587-d825-4a49-8e05-5e56b1671462/init-textfile/0.log"
Jul 24 16:57:35.409485 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409449    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"]
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409729    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee64e6e6-1504-4ebc-8b5f-062b2d851f2f" containerName="payload-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409741    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee64e6e6-1504-4ebc-8b5f-062b2d851f2f" containerName="payload-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409749    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db8cab2-241a-4875-a5ea-03bfb56b6224" containerName="maas-api"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409755    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db8cab2-241a-4875-a5ea-03bfb56b6224" containerName="maas-api"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409762    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b4e1c1-586b-43db-acfa-03502e9ef8dd" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409767    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b4e1c1-586b-43db-acfa-03502e9ef8dd" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409778    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4adc04ad-f2b5-4fad-886f-95cc57fda817" containerName="maas-api"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409784    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4adc04ad-f2b5-4fad-886f-95cc57fda817" containerName="maas-api"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409791    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413bae06-a73b-4b6c-b0eb-3b0e648b661d" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409795    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="413bae06-a73b-4b6c-b0eb-3b0e648b661d" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409804    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db0cf7b-f588-4a26-81ca-62f64ae6e893" containerName="payload-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409809    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db0cf7b-f588-4a26-81ca-62f64ae6e893" containerName="payload-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409817    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb5e8a2b-2573-48f5-8d5c-d1664c5472d2" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409823    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb5e8a2b-2573-48f5-8d5c-d1664c5472d2" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409831    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b11ae53a-a662-416b-821c-82876a05e362" containerName="payload-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409836    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b11ae53a-a662-416b-821c-82876a05e362" containerName="payload-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409845    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2" containerName="maas-api"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409849    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2" containerName="maas-api"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409856    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409861    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409866    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f92356b-3ead-4695-a992-21afee47169b" containerName="payload-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409871    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f92356b-3ead-4695-a992-21afee47169b" containerName="payload-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409878    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409884    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062" containerName="payload-pre-processing"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409889    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d506dc-ce26-4ea6-bdf8-195d0752e190" containerName="maas-api"
Jul 24 16:57:35.409908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409894    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d506dc-ce26-4ea6-bdf8-195d0752e190" containerName="maas-api"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409936    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db0cf7b-f588-4a26-81ca-62f64ae6e893" containerName="payload-processing"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409942    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="81b4e1c1-586b-43db-acfa-03502e9ef8dd" containerName="payload-pre-processing"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409947    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2db8cab2-241a-4875-a5ea-03bfb56b6224" containerName="maas-api"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409953    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="413bae06-a73b-4b6c-b0eb-3b0e648b661d" containerName="payload-pre-processing"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409958    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea9e6a3-5d2f-4b4d-9418-66d61fbfc062" containerName="payload-pre-processing"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409963    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b11ae53a-a662-416b-821c-82876a05e362" containerName="payload-processing"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409968    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee64e6e6-1504-4ebc-8b5f-062b2d851f2f" containerName="payload-processing"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409973    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4adc04ad-f2b5-4fad-886f-95cc57fda817" containerName="maas-api"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409979    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f92356b-3ead-4695-a992-21afee47169b" containerName="payload-processing"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409984    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb5e8a2b-2573-48f5-8d5c-d1664c5472d2" containerName="payload-pre-processing"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409988    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d506dc-ce26-4ea6-bdf8-195d0752e190" containerName="maas-api"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409993    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69b103a-4c4b-4c8d-86cd-f30ebe32a2b2" containerName="maas-api"
Jul 24 16:57:35.410912 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.409997    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b787668c-3c12-4f6d-ac8f-5d5dbeb6bfc3" containerName="payload-pre-processing"
Jul 24 16:57:35.419015 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.418987    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.419669 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.419627    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"]
Jul 24 16:57:35.421287 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.421257    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vptbp\"/\"kube-root-ca.crt\""
Jul 24 16:57:35.421395 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.421293    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vptbp\"/\"openshift-service-ca.crt\""
Jul 24 16:57:35.421984 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.421969    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vptbp\"/\"default-dockercfg-r859z\""
Jul 24 16:57:35.539884 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.539848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-lib-modules\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.539884 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.539896    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-sys\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.540101 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.539919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x48cs\" (UniqueName: \"kubernetes.io/projected/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-kube-api-access-x48cs\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.540101 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.540007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-proc\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.540101 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.540046    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-podres\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.640736 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.640696    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-lib-modules\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.640916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.640749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-sys\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.640916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.640780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x48cs\" (UniqueName: \"kubernetes.io/projected/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-kube-api-access-x48cs\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.640916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.640838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-proc\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.640916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.640872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-podres\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.640916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.640884    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-sys\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.640916 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.640884    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-lib-modules\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.641163 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.640922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-proc\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.641163 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.640995    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-podres\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.648036 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.648017    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x48cs\" (UniqueName: \"kubernetes.io/projected/8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0-kube-api-access-x48cs\") pod \"perf-node-gather-daemonset-lqf9w\" (UID: \"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.729695 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.729587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:35.856403 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:35.856341    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"]
Jul 24 16:57:35.858575 ip-10-0-134-143 kubenswrapper[2561]: W0724 16:57:35.858543    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8bd7fa0d_0af8_446a_812d_fb75d6bf2dd0.slice/crio-054080b4c8f6c3fbb16e66ab1d49ad82831bfe832010032f3ce679b65c4f7d1b WatchSource:0}: Error finding container 054080b4c8f6c3fbb16e66ab1d49ad82831bfe832010032f3ce679b65c4f7d1b: Status 404 returned error can't find the container with id 054080b4c8f6c3fbb16e66ab1d49ad82831bfe832010032f3ce679b65c4f7d1b
Jul 24 16:57:36.361853 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:36.361820    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w" event={"ID":"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0","Type":"ContainerStarted","Data":"9fa54989ce1e85a955fb481c3ac8ea8b2f73a61e6bc6be56e2fb9a950172f1aa"}
Jul 24 16:57:36.362057 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:36.361869    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w" event={"ID":"8bd7fa0d-0af8-446a-812d-fb75d6bf2dd0","Type":"ContainerStarted","Data":"054080b4c8f6c3fbb16e66ab1d49ad82831bfe832010032f3ce679b65c4f7d1b"}
Jul 24 16:57:36.362057 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:36.361973    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:36.378139 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:36.378091    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w" podStartSLOduration=1.378075413 podStartE2EDuration="1.378075413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:57:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:57:36.376443705 +0000 UTC m=+3090.361134498" watchObservedRunningTime="2026-07-24 16:57:36.378075413 +0000 UTC m=+3090.362766195"
Jul 24 16:57:37.625908 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:37.625881    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-28cf9_cf62ebce-0b3e-47f9-aa38-58b858e098c3/dns/0.log"
Jul 24 16:57:37.646302 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:37.646277    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-28cf9_cf62ebce-0b3e-47f9-aa38-58b858e098c3/kube-rbac-proxy/0.log"
Jul 24 16:57:37.769139 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:37.769105    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nhx7_7813417e-8bc8-443d-840b-659310daa0ee/dns-node-resolver/0.log"
Jul 24 16:57:38.337047 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:38.337015    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6db78ddb6f-vxjx8_64ba36df-d31a-483e-9705-14cf552ffcce/registry/0.log"
Jul 24 16:57:38.357970 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:38.357949    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hgm4t_e8c1aa89-7d46-4c9c-8e7a-93155b733e35/node-ca/0.log"
Jul 24 16:57:39.468486 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:39.468456    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9rk5t_9d6f1a5d-1319-4b9f-9397-69be4432b457/discovery/0.log"
Jul 24 16:57:40.539439 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:40.539405    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ssqlw_f16e4a4f-e4f3-4718-bafb-acfe973c503c/serve-healthcheck-canary/0.log"
Jul 24 16:57:41.089041 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:41.089013    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swgns_0fa8fe71-3432-4e48-959c-afb256df4318/kube-rbac-proxy/0.log"
Jul 24 16:57:41.109040 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:41.109018    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swgns_0fa8fe71-3432-4e48-959c-afb256df4318/exporter/0.log"
Jul 24 16:57:41.131574 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:41.131548    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swgns_0fa8fe71-3432-4e48-959c-afb256df4318/extractor/0.log"
Jul 24 16:57:42.375839 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:42.375808    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-lqf9w"
Jul 24 16:57:44.155058 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:44.155021    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6c795b6-ln7c4_c9c59d29-6b9a-4370-8208-33974f3a1628/manager/0.log"
Jul 24 16:57:44.172195 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:44.172173    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6c795b6-ln7c4_c9c59d29-6b9a-4370-8208-33974f3a1628/copy-manifests/0.log"
Jul 24 16:57:45.641855 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:45.641827    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9cffb5c7d-m6rs4_c62e91a7-9b4d-4cc5-b2b0-d1ea17a93d0d/manager/0.log"
Jul 24 16:57:45.835885 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:45.835854    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9rk5t_9d6f1a5d-1319-4b9f-9397-69be4432b457/discovery/0.log"
Jul 24 16:57:47.577306 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:47.577271    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9rk5t_9d6f1a5d-1319-4b9f-9397-69be4432b457/discovery/0.log"
Jul 24 16:57:52.029369 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.029325    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7gq5q_c10afac7-1ff4-4eac-9a77-c47a4e7e4698/kube-multus/0.log"
Jul 24 16:57:52.363388 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.363366    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qhhzj_32537f3f-042f-4d3f-9b9d-722cb26ef475/kube-multus-additional-cni-plugins/0.log"
Jul 24 16:57:52.383950 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.383926    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qhhzj_32537f3f-042f-4d3f-9b9d-722cb26ef475/egress-router-binary-copy/0.log"
Jul 24 16:57:52.403572 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.403554    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qhhzj_32537f3f-042f-4d3f-9b9d-722cb26ef475/cni-plugins/0.log"
Jul 24 16:57:52.423254 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.423229    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qhhzj_32537f3f-042f-4d3f-9b9d-722cb26ef475/bond-cni-plugin/0.log"
Jul 24 16:57:52.443452 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.443436    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qhhzj_32537f3f-042f-4d3f-9b9d-722cb26ef475/routeoverride-cni/0.log"
Jul 24 16:57:52.462603 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.462585    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qhhzj_32537f3f-042f-4d3f-9b9d-722cb26ef475/whereabouts-cni-bincopy/0.log"
Jul 24 16:57:52.481798 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.481782    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qhhzj_32537f3f-042f-4d3f-9b9d-722cb26ef475/whereabouts-cni/0.log"
Jul 24 16:57:52.678219 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.678137    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qswb4_b943eabe-3fe7-4b72-b432-acb2e0a999f4/network-metrics-daemon/0.log"
Jul 24 16:57:52.697188 ip-10-0-134-143 kubenswrapper[2561]: I0724 16:57:52.697131    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qswb4_b943eabe-3fe7-4b72-b432-acb2e0a999f4/kube-rbac-proxy/0.log"